scraping-xx Goto Github PK

tanalyzer

Tool for text pattern recognition using LDA.

tematres-vocabulary-server

Web application for management formal representations of knowledge, like controlled vocabularies, taxonomies and thesauri

testspiders

Useful test spiders for Scrapy

text2obj

Generate a javascript object or extract data from a textual data structure

textblob

Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.

textwrap.jl

Package for wrapping text into paragraphs.

tika

Mirror of Apache Tika

topia.termextract

Updates to Zope's keyphrase extractor (forked from 1.1.0)

topicmaps

Topic Maps

tornado

Tornado is a Python web framework and asynchronous networking library, originally developed at FriendFeed.

truncatehtml

A Jekyll plugin that truncates HTML while preserving markup structure.

turbine

Low latency high throughput aggregator for real time streams

twitter-social-graph-networkx

Download, summarise and visualise the followers in a small twitter social network

validator.js

Powerful objects and strings validation in javascript for Node and the browser

visualsedimentation

Visual sedimentation is a novel design metaphor that progressively generates and updates visualizations of streaming data, inspired by the process of physical sedimentation. This process is the result of objects falling due to gravity forces, that aggregate into compact layers over time. The process is well understood since our environment is shaped by sedimentation: mountains, hills or rivers are the visible result of this long process.

vpdmfmodels

All vpdmf models built under our current system.

wappalyzer

Cross-platform utility that uncovers the technologies used on websites.

watir-webdriver-inspector

Minimal combinatorial code generation on element inspection. [Work in progress]

wayback_scraper

Scraper for retired GroupHug website

web_scraper

PHP scraper to extract Question & Answer pairs from different websites

webprotege

The webprotege code base

websocket-relay

websockify

Websockify is a WebSocket to TCP proxy/bridge. This allows a browser to connect to any application/server/service. Implementations in Python, C, Node.js and Ruby.

weibosearch

A distributed Sina Weibo Search spider base on Scrapy and Redis.

www-mechanize-formfiller

Release history of WWW-Mechanize-FormFiller

wwwclient

Advanced web browsing, scraping and automation

xpath-viewer

Chrome extension to view elements using xPath and CSS selectors

xregexp

Extended JavaScript regular expressions

ydiff

a tool for structural comparison of programs

yelp

A rails project to scrape yelp. And scrape yelp. And scrape yelp, ad infinitum!