Giter Club home page Giter Club logo

Welcome to My GitHub Repository

This repository primarily contains web scraping projects for various data sources, as well as practical tasks related to social media studies.

🤔If you are interested in web scraping related projects, you definitely can't miss the following:

Weibo :

https://github.com/wz289494/Crawl_Weibo_repost

https://github.com/wz289494/Crawl_Weibo_comment

https://github.com/wz289494/Crawl_Weibo_search

Facebook :

https://github.com/wz289494/Crawl_Facebook_User

🤔There are two more fun projects below:

If on social media platforms, you cannot clearly see the reply relationships, why not structure them as a tree?

https://github.com/wz289494/Comments_Tree

When you have a very large node graph, try to partition it in the following way:

https://github.com/wz289494/Connected_Component_Graph

📧 Welcome, I'm glad to communicate with you.

Email [email protected]

wechat w17570661760

Wz_SMS's Projects

airesearch icon airesearch

这是一个将chatgpt用于学术研究的项目，目前主要针对自然语言处理，可做常见的情感分析、主题编码等，也可用于尝试分析多结果，适用于多条评论、多条文本，基于AI理解能力生成分析结果

comments_tree icon comments_tree

这是一个将评论信息可视化的项目信息，用于更好的呈现热门评论的回复情况

connected_component_graph icon connected_component_graph

这是一个将 连接关系 转化为 邻接矩阵 ，再由 邻接矩阵 创造 连通分量图 的项目

crawl_douyin_uservideoinfo icon crawl_douyin_uservideoinfo

这是一个根据抖音博主id爬取博主视频信息的爬虫项目，可以批量爬取抖音视频，项目依托scrapy框架及selenium自动化技术

crawl_douyin_video icon crawl_douyin_video

这是一个根据抖音视频id保存视频至本地的爬虫项目，可以批量爬取抖音视频，项目依托scrapy框架及selenium自动化技术

crawl_facebook_user icon crawl_facebook_user

这是一个用于获取facebook个人页信息的爬虫，可获取个人资料、粉丝列表、关注列表、好友列表、发布帖子。

crawl_hotsearch icon crawl_hotsearch

这是一个用于获取各平台热搜榜单的爬虫项目，可获取社交媒体（微博、抖音热榜等）、商品（淘宝、天猫热卖榜等）

crawl_maoyan_films icon crawl_maoyan_films

这是一个用于获取电影信息的爬虫项目，借助平台猫眼电影数据

crawl_rumor icon crawl_rumor

这是一个用于获取谣言数据的爬虫项目，借助平台**互联网联合辟谣平台

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.