ca-fires-history

Tracking fire data from www.fire.ca.gov/incidents

As-of June 28th 2023

The scraped data is stored in incidents-june-2023-format.json

Up to March 2rd 2023

The scraped data was stored in incidents.json

Background on this project: Git scraping: track changes over time by scraping to a Git repository

ca-fires-history's People

Contributors

Stargazers

Watchers

ca-fires-history's Issues

Exclude AllYearIncidents.UpdatedDate

Hello,

Regularly the only change in the .json is the AllYearIncidents.UpdatedDate. When I forked this project for another purpose, I was seeing thousands of commits for a similar "rundate" member on the JSON I was watching for changes. Looks like you can have jq remove/exclude that member: | jq 'del(.AllYearIncidents.UpdatedDate)' ... in scrape.yml

I thought I'd pass it along if that's useful to you :-)

Cheers ~

Update scraper to new source

This URL started breaking a while ago: https://www.fire.ca.gov/umbraco/Api/IncidentApi/GetIncidents

Bad incoming Lat/Lon data

Happened on this:

$ git-log -G '["]Longitude["]: -1[0-9][0-9][0-9]' --patch | grep -e 'Latest data:' -e '["]Longitude["]: -1[0-9][0-9][0-9]'

    Latest data: Mon Apr 26 12:10:42 UTC 2021
+      "Longitude": -1191414610,
    Latest data: Mon Apr 26 11:49:03 UTC 2021
-      "Longitude": -1191414610,
    Latest data: Sat Apr 24 20:49:11 UTC 2021
+      "Longitude": -1191414610,
    Latest data: Sat Apr 24 15:10:14 UTC 2021
-      "Longitude": -1191414610,
    Latest data: Fri Apr 23 01:11:43 UTC 2021
-      "Longitude": -1191414610,
-      "Longitude": -1191414610,
       "Longitude": -1191414610,
    Latest data: Fri Apr 23 00:43:07 UTC 2021
+      "Longitude": -1191414610,
+      "Longitude": -1191414610,
+      "Longitude": -1191414610,

Note missing decimal point.

Recommend Projects