codywilbourn / scrapy-cluster Goto Github PK
View Code? Open in Web Editor NEWThis project forked from istresearch/scrapy-cluster
This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
Home Page: http://scrapy-cluster.readthedocs.org/
License: MIT License