Giter Club home page Giter Club logo

proxygrab's Introduction

ProxyGrab

Software to scrap proxies for my web scrapping and other testing purposes.

PyPI CI (pip) PyPI - Wheel Supported Python Versions Downloads Documentation

I made this software to scrap proxies for my web scrapping and other testing purposes. This program just uses requests to get the response from API and return the proxies, also it can scrape proxies from a few sites so that it can be used without using the API.

NOTE: This library isn't designed for production use. It's advised to use your own proxies or purchase a service which provides an API. These are merely free ones that are retrieved from sites and should only be used for development or testing purposes.
Update: Now you can use ProxyScrape Premium Token to get proxies for production use! It's only for people who will be using this for people who will use free proxies for intensive tasks!

Installation

The latest version of proxygrab is available via pip:

pip install proxygrab --upgrade

Also, you can even download the source code and install using:

python setup.py install

Provided Proxies:

Provider Proxy Types avaiable Url
Proxyscrape http, https, socks4, socks5 https://proxyscrape.com/
Proxy-List http, https, socks4, socks5 https://www.proxy-list.download/
SSL Proxies https https://www.sslproxies.org/
Free Proxy List http, https https://free-proxy-list.net/
US Proxies http, https https://www.us-proxy.org/
Socks Proxy socks4, socks5 https://www.socks-proxy.net/

Documentation:

https://proxygrab.netlify.com

Contribuiting

Wanna help and improve this project?

Make sure to follow these before opening a PR:

  • Make sure your PR is formatted with Black.
  • Make sure the package is working.

License

This project is licensed under the MIT License - see the LICENSE.md file for details

Thanks to:

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.