Giter Club home page Giter Club logo

nz-covid19-data's Issues

South Canterbury?

South Canterbury isn't a Regional Council region (though it's a DHB). Should it be merged with Canterbury in the Region field?

Automated scraping of MOH and other sites

Hi there!

I have been scraping the MOH, MSD and covid19.govt.nz sites for a few days now and making the data available via a web API in various formats:

https://nzcovid19api.xerra.nz/

You might find the code that does the scraping useful in an offline workflow (the command line tool can output CSV and JSON): https://github.com/simeonmiteff/nzcovid19cases

Some researchers have asked me for reported dates, and I have spent some time manually joining these with the MOH table in this Google Sheet (which pulls the table from the API's CSV feed using the IMPORTDATA() function that updates every 30 minutes):

https://docs.google.com/spreadsheets/d/1NJiDg2z7Y79RUkQ-a648fFD_EmziztYLLkQW_FOrLGo/edit#gid=576672848

Please let me know if I can help out in some way.

More generally, I know of at least one initiative to build a sensible data format for MOH to do their reporting, but I don't know if there is anyone on the ministry's end to take this on (especially given that I think they have bigger problems right now).

I also found that the MOH site gets overloaded once a day, and at other times has a nasty caching bug where it alternately serves the latest, and outdated versions of the COVID-19 case page. I've been trying to find out who the tech contact is there (to offer help), but no luck yet. Please let me know if you know someone who can connect me at MOH.

Regards,
Simeon.

New source of individual case information?

I guess you folks have seen that MOH reworked the cases page now to show only case statistics.

Does someone who MOH takes seriously (NZ Herald?) know if they plan to publish individual case information at all?

More direct access to ESR database

Hi @vizowl

I did some poking around the arcgis.com dashboard linked from the MOH webste and found that it is pulling some tables that appear to be obtained from, or maintained by https://www.esr.cri.nz/. This gels with the intel @gizmoguy gathered earlier in the week (I suspect he looked at the author names in the spreadsheet metadata and tied that back to ESR).

I worked out that the right query string dumps these tables in JSON format:

Perhaps using these would be better than working with the spreadsheets?

Regards,
Simeon.

Dates?

I have made a request to MoH (through the feedback button) to add date of likely infection, swab date, and recovery/death date. You may have more away than me though.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.