admin-else / infinity-scrape Goto Github PK

Issue

When using your scrape.py it says that the api died with the status code 403 (forbidden) but using ybetas version t works.

Steps to replicate:

1. clone this repo
2. install all requirements using pip install -r requirements.txt
3. run scrape.py using python scrape.py

Current implementation:

Suggested implementation:
Exponential backoff using the backoff library.

I'm not good at technical knowledge things, and the installation guide doesn't make any sense. Where do I use the git clone command? It doesn't work in Python.

edit: I've got it working, but I'm still confused.

When I run scrape.py, I sometimes get this error: Error: UNIQUE constraint failed: conbination.out

How do I fix this?

when I run scraper.py it says

Connecting to database...
Connected!
Starting, press CTRL+C or close this window to stop
Done...

and sits for a little bit and throws an error and says
<class 'requests.exceptions.JSONDecodeError'>: Expecting value: line 1 column 1 (char 0)
Found 0 new combinations and 0 first ever combinations!

It goes through different objects but gives an exception on the line