How to use goclone for site-search ? about goclone HOT 1 CLOSED

Hey there!

So to begin Goclone is a CLI tool for copying/mirroring sites via a given URL or Domain. If you would like to extract specific data from a web page and utilize that data for some task, I would recommend looking into writing a webscraper. A great webscraping tool that I used in this project is Colly. Quick Colly example:

func main() {
	c := colly.NewCollector()

	// Find and visit all links
	c.OnHTML("a[href]", func(e *colly.HTMLElement) {
		e.Request.Visit(e.Attr("href"))
	})

	c.OnRequest(func(r *colly.Request) {
		fmt.Println("Visiting", r.URL)
	})

	c.Visit("http://go-colly.org/")
} 

Some other great examples of building a webscraper can be found here! I hope this answers your question :)

from goclone.