Giter Club home page Giter Club logo

alphabeta's Projects

scrapy-mongodb icon scrapy-mongodb

MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the items to MongoDB as soon as your spider finds data to extract.

sendemailbypython icon sendemailbypython

使用python语言编写的邮件群发程序，可发送文字及HTML格式邮件，电子邮件地址存在于MYSQL数据库中，由爬虫从互联网中爬取得到

shell icon shell

Linux命令行与shell脚本编程大全案例

simple-computer-robot icon simple-computer-robot

当初为某个站长编写的爬虫，可以用来爬去优酷视频，电影天堂，搜狗等站的资源，采用多线程，可以在配置文件里面给定关键词，数据库配置信息等，自动更新到极光cms中(现在好像找不到了).所以此代码只给想要学习用python编写爬虫的同学学习

spide icon spide

网络爬虫 主要抓取的是股票数据，外汇数据，股票背景资料，股票及时新闻

spiders icon spiders

一个NodeJs爬虫集，包括知乎、豆瓣、拉勾等网站爬虫

spidr icon spidr

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

subbrute icon subbrute

A DNS meta-query spider that enumerates DNS records, and subdomains.

synapse icon synapse

Synapse: Matrix reference homeserver

tamll_spider icon tamll_spider

天猫商城数据爬取，python简单无框架源码附带数据库

ted2srt icon ted2srt

Download bilingual subtitles of TED talks

tieba-zhuaqu icon tieba-zhuaqu

百度贴吧分布式爬虫，用于贴吧数据挖掘。从贴吧维度和用户维度进行数据分析

tweetscraper icon tweetscraper

TweetScraper is a Scrapy crawler/spider for Twitter Search without using API

v2ray-core icon v2ray-core

A platform for building proxies to bypass network restrictions.

videospider icon videospider

分布式视频信息爬虫，抓取豆瓣，bilibili等中的电视剧、电影、动漫演员等信息

vps-shell icon vps-shell

收集一些自用的shell脚本，适用于懒人使用。

vpsinfo icon vpsinfo

VPSinfo is a Linux server monitoring script, written in PHP, that provides web access to system status information.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.