icodein / fender Goto Github PK

Fender is a helper tool (a scraper) to extract bike data from https://www.canyon.com website to aid in a data driven bike project.

• Install Rust by running: curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
• Install geckodriver: https://medium.com/@deepankosingha/how-to-install-geckodriver-on-ubuntu-94b2075b5ad3 and add it to your $PATH

./scrape <bike_list_url_from_canyon.in site> <folder_to_save_to> - To start running geckodriver along with fender binary

For example: ./scrape https://www.canyon.com/en-in/all-road-bikes/ road-bikes ~/geometry_data