parolkar / anemone Goto Github PK
View Code? Open in Web Editor NEWThis project forked from chriskite/anemone
Anemone web-spider framework, THIS FORK has added functionality for obeying Robots.txt
Home Page: http://anemone.rubyforge.org
License: MIT License