Giter Club home page Giter Club logo

Comments (5)

RamenMode avatar RamenMode commented on June 1, 2024

I may not be interpreting exactly what you are saying due to translational issues, but are you saying that you want to make custom acceptable wear ranges for different scrapers/threads? This can be done quite easily, but this will require additional modifications. You are welcome to make a pull request to add this feature, and I'll accept the changes if it looks good.

from buffbot.

RamenMode avatar RamenMode commented on June 1, 2024

A way to solve the issue is to add a new set of command line arguments with a float array for each scraper and then pass in a parameter to the methods to accept this different float parameter for each scraper.

from buffbot.

zhumip avatar zhumip commented on June 1, 2024
   首先,非常感谢你的回复,由于翻译你可能会难以理解,我是一位初学者,对于您的程序,我想要的是cookie可以直接分为一个购买账户和多个爬取账户,因为buff对于爬虫有限制,直接使用购买账户可能导致账户封禁,所以我想要对爬取账户做一个休眠,爬取一个商品休眠20秒,这个休眠时间可以自己运行时设置,这样我们需要添加多个爬取账户,我们还需要商品的价格,否则即使设置了商品磨损度也可能高价购买,商品最高价格也需要我们设置在爬取商品列表中,来限制购买价格以及磨损度,在此范围内我们再使用购买账户购买。
   对于上面的所有东西,我想要的就是添加一个购买账户,多个爬取账户,设置休眠时间,设置商品磨损度范围和最高价格,爬取账户爬取到了范围内,再用购买账户购买。

假如设置的商品数量超过了爬取账户的数量,我们就让爬取账户按顺序一个一个爬取,一个爬取账户爬取一个商品。假如商品数量等于爬取账户数量,我们就让爬取账户每个对应一个商品进行爬取。假如商品数量小于爬取账户数量,还是让爬取账户对应一个商品,多出来的账户,再按照休眠时间平均再爬取一遍商品。
非常感谢您在百忙之中回复我的信息,也希望你能对于我所提出来的问题,进行解答,或者发布修改后的程序,以供我参考学习,非常感谢

from buffbot.

RamenMode avatar RamenMode commented on June 1, 2024

I understand your request now. You are correct in wanting to set some scrapers to search and another to buy as to not risk your main account being affected. The problem with this is I am unsure as to whether buff.163.com rate limits based on ip or limits the number of requests a buff account can send. Additionally, I am not hosting free proxy servers to allow for greater scraping, nor do I have the ability to provide additional buff accounts for your use. One possible solution is to use your own additional buff accounts to scrape, but I only have one, so I cannot test if any changes I make will work. Unless there are additional questions or suggestions, I will close the issue soon.

from buffbot.

RamenMode avatar RamenMode commented on June 1, 2024

If you have any more requests, message me on Discord @ ramenmode_

from buffbot.

Related Issues (3)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.