Comments (8)
Here's my script to extract a CSV of cases by DHB over time from that ESR shiny app - https://github.com/UoA-eResearch/nz-covid19-data-auto/blob/master/fetch_ESR.py
from nz-covid19-data.
I have been playing with both the ESR data and the spreadsheets - on Friday the Ministry missed 4 cases from their update - so I filled them in from the ESR data - but today the Ministry's update came through before the ESR one. So it seems that neither one is better - also I am relying on the overseas/nz/unknown case origin classifications which are not in the ESR data ...
from nz-covid19-data.
Some more inferences:
The authoritative database is presumably "ESR EpiSurv", which looks to be a SharePoint system.
Here is the form that case information is being captured with: https://surv.esr.cri.nz/episurv/CaseReportForms/Field_Coronavirus_Mar2020.pdf
I believe that partially overlapping subsets of the fields seen in that form get exported from SharePoint to (at least) two different spreadsheets:
-
One that is sent to MOH where it is published on the website, along with someone copying new case rows from the sheet into a CMS for the HTML tables (while their exercising creativity by subtly changing the format almost every day).
-
One that is uploaded to arcgis.com to drive the geospatial dashboard.
I imagine that cases imported between the times that the two spreadsheets are exported is the cause of your two missing cases.
from nz-covid19-data.
I've also been looking into this EpiSurv system, you can find it's details here (however the system itself requires a username/password to gain access):
https://surv.esr.cri.nz/episurv/index.php
I do note that the media outlet thebfd.co.nz claims to be getting data from a direct extract from this system, so possibly it's available to people outside the medical field as well:
https://thebfd.co.nz/blog/2020/04/04/covid-19-update-4-april-2020/
from nz-covid19-data.
My understanding is you are correct - everything (that the Ministry holds) sits in EpiSurv and the releases are just extracts from it.
I think the bfd is just mirroring exactly what is on the Ministry of Health update page e.g. https://www.health.govt.nz/our-work/diseases-and-conditions/covid-19-novel-coronavirus/covid-19-current-situation/covid-19-current-cases#lab
from nz-covid19-data.
Here's a more useful screenshot with the EpiSurv extract details
from nz-covid19-data.
Ah you are right, they are just copy and pasting from the dumps on health.govt.nz.
Interestingly when I was doing sleuthing on google thebfd was showing up for my search term but not health.govt.nz.
I guess the elusive true source of this data is out of reach for us non-medical folks.
from nz-covid19-data.
Okay so I've found another data source out of ESR:
https://nzcoviddashboard.esr.cri.nz/
This one seems to use a streaming API based around rstudio's shiny-server. I am not an expert in this kind of streaming API but if you find someone who is it might be a helpful data source. I have not analysed if this is any more up to date than the other sources of data.
from nz-covid19-data.
Related Issues (8)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nz-covid19-data.