super-xiu / go-crawler Goto Github PK
View Code? Open in Web Editor NEWThis project forked from lizongying/go-crawler
A web crawling framework implemented in Golang, it is simple to write and delivers powerful performance. It comes with a wide range of practical middleware and supports various parsing and storage methods. Additionally, it supports distributed deployment. 基于golang实现的爬虫框架,编写简单,性能强劲。内置了丰富的实用中间件,支持多种解析、保存方式,支持分布式部署。
Home Page: https://pkg.go.dev/github.com/lizongying/go-crawler