Giter Club home page Giter Club logo

meituan's Introduction

美团(美食)店铺信息爬虫

  通过接口抓取美团美食店铺信息,并做相关的数据分析。

项目目录

Meituan
│  common.py
│  config.py
│  meituan.py
│  parse.py
│  token_.py
│  visual.py
│  requirements.txt
│  
├─utils
│      br.json
│      cities.json
│      ua.log
│      uuid.log
│      
└─view
        FZSTK.TTF
        key.png
        qin.png
        title.txt

环境依赖

pip3 install -r requirements.txt

解释说明

  1. 接口动态参数:uuid, _token。
  2. 接口参数 uuid 需要不定时从网页源码获取 ,否则_token 的 uuid 就会失效。
  3. 接口 _token 参数加密:二进制压缩、Base64 编码, 解密:Base64 解码、二进制解压。另外、生成 token 的 sign 参数加密解密过程与 _token 相同。

运行

  切换至 Meituan 文件夹的根目录执行:

# pip3 install -r requirements.txt
python common.py
python meituan.py

数据分析

  • 美食店铺名称词云

词云

  • 西安美食店铺排行榜前10名( 仅限美团数据 )

2

  • MySql 数据

4

  另外,还做了美食店铺评分占比、人均用餐价与评论数量的相关联性分析。

公告

本代码仅作学习交流,切勿用于商业用途,否则后果自负。若涉及美团侵权,请邮箱联系,会尽快处理。

meituan's People

Contributors

northxw avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.