khpeek / scraper-compose Goto Github PK
View Code? Open in Web Editor NEWScrapy example project using Tor (through Privoxy) in a Docker Compose multi-container application
Scrapy example project using Tor (through Privoxy) in a Docker Compose multi-container application
Hi @khpeek, I have tried your code and it looks so good.
But I'm getting an error when I run docker-compose up
:
scraper_1 | standard_init_linux.go:185: exec user process caused "no such file or directory"
I had to update the ./scraper/requirements.txt
:
scrapy-fake-useragent==1.0.2
to scrapy-fake-useragent==1.0.2.1
because the build was failing
I'm running Windows 10 and I just did the following:
git clone this-repo
cd this-repo
docker-compose build
docker-compose up
Probably it's just something minor and stupid but I don't know a lot about Docker... Could you help me?
I cloned the repository and tried to execute the two steps from the README.md
. The problem, when I execute docker-compose up
the following messages are show:
tor_1 | Sep 14 00:57:54.000 [notice] Bootstrapped 50%: Loading relay descriptors
tor_1 | Sep 14 00:57:57.000 [notice] Bootstrapped 56%: Loading relay descriptors
tor_1 | Sep 14 00:57:58.000 [notice] Bootstrapped 66%: Loading relay descriptors
tor_1 | Sep 14 00:57:59.000 [notice] Bootstrapped 72%: Loading relay descriptors
tor_1 | Sep 14 00:57:59.000 [notice] Bootstrapped 77%: Loading relay descriptors
tor_1 | Sep 14 00:57:59.000 [notice] Bootstrapped 80%: Connecting to the Tor network
tor_1 | Sep 14 00:58:00.000 [notice] Bootstrapped 85%: Finishing handshake with first hop
scraper_1 | Operation timed out
tor_1 | Sep 14 00:58:01.000 [notice] Bootstrapped 90%: Establishing a Tor circuit
scrapercompose_scraper_1 exited with code 1
tor_1 | Sep 14 00:58:02.000 [notice] Tor has successfully opened a circuit. Looks like client functionality is working.
tor_1 | Sep 14 00:58:02.000 [notice] Bootstrapped 100%: Done
What can be?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.