Giter Club home page Giter Club logo

vinted-scraper's Introduction

Vinted-Scraper

This is a tool to download images and scrape data from Vinted & Depop and store it in a SQLite database.

How to use

Vinted

Put the user IDs of the accounts in the users.txt and run the script. The script will download all the images and put it in the downloads folder. The data will be stored in the SQLite database.

Depop

Put the usernames of the accounts in the users.txt and run the script with -d. The script will download all the images and videos and put it in the downloads folder. The data will be stored in the SQLite database.

Arguments

-p [Vinted] scrape all images from your private messages. (requires -s to login and -u to set your userid)
-s "your_vinted_fr_session" [Vinted] to login to your account. how to get sessionid?
-u [Vinted] set your userid
-n [Depop] Disable file download (Only scrape product info)
-g [Depop] Also download sold items
-b [Depop] Start from a specific item. (example: python3 scraper.py -d -n -b "coose-navy-lee-sweatshirt-amazing-lee")

Example:

Download all images from private messages from your Vinted account
python scraper.py -p -u 123456789 -s "RS9KcmE1THMxV3NlclRsbEVRdU52ZVp4UG.......ASFe26"

Data that will be scraped

All the images of the products of the users will be downloaded. The avatar of the user will also be downloaded.

All the info will be stored in the sqlite db in the following tables:

Vinted Users

Username
User_id
Gender
Given_item_count
Taken_item_count
Followers_count
Following_count
Positive_feedback_count
Negative_feedback_count
Feedback_reputation
Avatar
Created_at
Last_loged_on_ts
City_id
City
Country_title
Verification_email
Verification_facebook
Verification_google
Verification_phone

Vinted Products

ID
User_id
Gender
Category
Size
State
Brand
Colors
Price
Images
Description
Title
Platform

Depop Users

Username
User_id
Bio
first_name
followers
following
initials
items_sold
last_name
last_seen
Avatar
reviews_rating
reviews_total
verified
website

Depop Products

ID
Sold
User_id
Gender
Category
Size
State
Brand
Colors
Price
Image
Description
Title
Platform
Address
discountedPriceAmount
dateUpdated
If you have any feature requests don't hesitate to open a issue :)

vinted-scraper's People

Contributors

gertje823 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.