Scrapy
is open-source web scraping framework for Python. This
repository contains scrapy spiders for some myanmar websites โ that I
crawled previously for data collection.
- Install
python2.7
,pip2.7
.
sudo apt-get install python python-pip
- Install scrapy and other necessary python packages
sudo pip install Scrapy
-
Install python-myanmar (needed to convert zg->uni)
-
Run the spider using scrapy.
scrapy runspider ..._spider.py