Need High-resolution Weather Data for Analytics or Machine-learning ? Seek no more.
The Weather Scraper downloads high-resolution weather data (often 5 min. intervals) from Wunderground's public weather stations around the world for you.
pip install -r requirements.txtpython weather_scraper.pyFirst, find the weather stations you are looking for.
Then you just have to update 2 config files before running TWS.
-
Go to https://www.wunderground.com/wundermap and zoom in to your location
🌞 Click on a weather station and then click on the Station ID (the Station Summary page will open)
🌞 Open and copy all Station ID URLs you need -
Set the weather_station urls inside stations.txt
🌞 one url per line! -
Inside config.py
🌞 Set the date-range you want to download your data from
🌞 Set the unit system you need (metric / imperial)
🌞 Set FIND_FIRST_DATE to true if you want the weather scraper to use binary search to search for the first date with data, starting from START_DATE
If you want to download data from 2020/5/1 to 2020/6/1 in metric units your config.py will look like this:
from datetime import date
# Set Date format like: YYYY, MM, DD
START_DATE = date(2020, 5, 1)
END_DATE = date(2020, 6, 1)
# set to "metric" or "imperial"
UNIT_SYSTEM = "metric"
# Automatically find first date where data is logged
FIND_FIRST_DATE = FalseNow you are read to run your downloads:
$ python weather_scraper.pyWait until TWS finishes writing your data to files with this naming pattern station_name.csv!
You resulting CSV file will look something like this (if you give it a nice format)
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent