dustmoo / crawler-user-agents Goto Github PK
View Code? Open in Web Editor NEWThis project forked from monperrus/crawler-user-agents
Lists syntactic patterns of HTTP user-agents used by bots/robots/crawlers/spiders (pull-request welcome)
License: MIT License