gwynhannay / aussie_politics Goto Github PK

Crawler needs to be completed that can sufficiently scrape all acts on legislation.gov.au. Current version winds up with expired cookies.

First version deployed which compares different versions of the Australian Constitution.

The amount of content on legislation.gov.au is huge, so once the initial scrape is done there will need to be a method of crawling the website regularly and only fetching new information. It would be good if it didn't take too long to run.

Having a source of all federal legislation and diffs of those is the first outcome of this project. The next would be to tie those changes to which ministers were responsible for those. There needs to be a decent data source for politicians and which dates they were in charge of specific portfolios.

politics.reference-desk.net is currently running Python. Hugo would be a great replacement to generate a static website and allow for things to load faster - and also make it look better, because I am not a designer!

Once the crawler is successfully running to pull down all federal acts, expand it to bills and other relevant parts of the Federal Register of Legislation.