This crawler was written in Python by Scrapy framework in order to scrape content of Android applications which are published in Google Play store.

You can deploy it on ScrapingHub or easily set a daemon in your personal machine by scrapyd and start to scraping items.

First, make sure you are in project directory and then easily run the crawler by following command:

scrapy crawl gapps -o OUTPUTFILENAME.EXT

For example, if you're going to export your data in csv format in your current directory, you can run:

scrapy crawl gapps -o apps_data.csv

This repository is under development. Upcoming features:

• Implementing tags support in order to toggle fields in output
• Configuring AutoThrottle feature
• Setting USER-AGENT and corresponding settings