Comments (5)
Hello,
Can you describe how you ran it and what error it returned? Is the page you're searching on still available in your browser after you ran the script?
from lurker.
I start the bot with "git bash" program on windows.
The bot correctly list the test items, then i see:
"================="
after 300 sec, not list again the items just still:
"================="
This is repeated.
When i open the web page in browser i become a captha and a message with unusual activity detected.
I solve the captha and i can browse on emag again. The bot find the test items again.
The bot made 1 search then again become the captha issue.
from lurker.
I can confirm I can reproduce the steps, but, at least for me, this happens only if I'm not logged in on their website and if I poll the page too quickly (I'd say 10 seconds triggers the captcha but it's been hit and miss)
I'd suggest as possible solutions trying a VPN or use some proxy to hide your current IP, or altering the URL that is hardcoded in the script (I used that one over 18 months ago).
Alterantively, try using the other script - userinput.sh - and see if that wields better results when you customize the URL with emag's search filters. If that one works better I'll translate the prompts to english for ease of use (in order it asks for an URL, a keyword, max desired price, time to refresh results and number of results to show you. Only the URL is mandatory, the rest have predefined defaults they can use)
from lurker.
Thank you for answer, i tested these steps, but no result. In 5 minutes the bot run in captcha.
i tryed vpn, other URL-s, userinput.sh, logged in - logged out, but the result is the same.
from lurker.
It looks like emag did some tweaking to their website - I tested this again and it looks like a time limit kicks in the captcha verification which unfortunately makes the script pretty much useless.
I'll do some googling on how to avoid this, if at all possible.
$ i=1; while true; do echo "---------- Iteration $i ----------"; echo $(date +%H:%M:%S) "Results: $(curl -s https://www.emag.ro/search/placi_video/resigilate/filter/memorie-f2645,12-gb-v7440/rtx/c | tr "," "\n" | grep -e "product_name"" -e "quot;price"" | awk 'NR%2{printf "%s ",$0;next;}1' | awk -F ";" '{print $4 " " $NF}' | awk '{print $NF,$0}' | cut -c 2- | sort -n | cut -f2- -d' ' | sed "s/"//" | sed "s/u00ae//" | sed "s/u2122//" | tr \\ " " 2>/dev/null | grep -i rtx | wc -l)"; echo "--------------------"; i=$(($i+1));sleep 360; done
---------- Iteration 1 ----------
17:26:02 Results: 16 <-- expected number of results per query
---------- Iteration 2 ----------
17:32:02 Results: 16
---------- Iteration 3 ----------
17:38:03 Results: 16
---------- Iteration 4 ----------
17:44:03 Results: 0 <--- after `20 minutes the captcha kicked in
---------- Iteration 5 ----------
17:50:03 Results: 0
from lurker.
Related Issues (1)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lurker.