This project contains anything scraper that you maybe need, from scrap image to scrap video or text you want, anything you search can be done using our toolbox tools. For now, we support thoese scraper:
- Baidu image scraper, scrap millions images with a night, you can set multi query words.
- Wechat hot article scraper, scrap wechat hot articles
- Videos you want, just need get your video website name, and our scraper can download all videoes from that website, Any Video
this repo can be run in any platform, using **Python3.5 + **, for scrap image:
python3 scraper_images.py -q 帅哥 美女 -d ./data -m 800000
-q
: your query words, you can many words along with this mark, all images will saved into different folders.-d
: your save root directory-m
: your maxium download number of images, you can set any number, default is 80000.
(c) Jin Fagang All Rights Reserved.