waynee-jiang Goto Github PK

automationseleniumbot

This application uses GUI javaFX (SceneBuilder),Selenium and Jsoup libraries. Application/BOT can scrap data, register acoount and/or sing into account and add products to the cart at amazon.com

autotest-framework

UI自动化测试框架，支持APP、Web、HTML5三端， 基于SpringBoot框架， 采用Page Object设计模式，基于 TestNG 测试框架构建测试用例，支持消息通知、失败截屏、HTTP 报告、并发执行等特性

cachedev-redis.l2cache

L2 cache with redis and mybatis.

car-spider3

汽车菜单数据的抓取（品牌、厂商、车系、车型），油价，用户昵称抓取。java抓取，方式包含多线程，解析包含jsoup和正则表达式，两者相互补充。

codefocus-project

自定义分布式链路追踪traceId、基于YML动态配置创建Rabbit、基于YML动态配置Redis，集成Spring Cache，增加二级缓存caffeine，优化keys及scan命令， 过期时间扩展，使用方式和Spring Cache完全一样，支持其它更多的功能

coder-programming

Coder编程原创技术导航

cors_springboot

Simple example of spring boot + cors + selenium + running multiple spring boot apps in the same process.

crawler

Java 多线程爬虫 redis

crawler-engine

crawler-engine with HTTP, proxy, JS-Java Interoperability, MQ task consumption, dynamic crawler scripts execution. support deployment in distribution style.

crawler4j

Open Source Web Crawler for Java

crwa

selenium+jsoup+springboot+mybatis 爬取网页数据

csdnweeklyspider

spring boot + jsoup + redis 抓取CSDN每周干货知识

demo-lh-logger

lh-springboot-starter-logger框架的demo项目

design-pattern-for-ios

IOS设计模式探索(大话设计模式)

design-patterns-py

《大话设计模式》Python实现

designpatterns-objective-c

用 Objective-C 实现《大话设计模式》书中的例子，并用一些 Objective-C 的特性对例子的实现加以优化

distributedcrawlsystem

分布式爬虫系统

iggdev

javainaction

微服务中常用技术的代码例子，偏实际项目用到的技术

lettuce-core

Advanced Java Redis client for thread-safe sync, async, and reactive usage. Supports Cluster, Sentinel, Pipelining, and codecs.

mq-starter-web-crawler

基于Redis实现的具备ACK特性的消息队列 以及使用该消息队列的一个web爬虫

novelcrawel

A Crawler Tools Based on RabbitMQ

phantomjs

Scriptable Headless Browser

rabbitmq

RabbitMQ JMS producer and consumer

real-time-log-analysis-system

:penguin:基于spark streaming+flume+kafka+hbase的实时日志处理分析系统(分为控制台版本和基于springboot、Echarts等的Web UI可视化版本)

redis

Redis is an in-memory database that persists on disk. The data model is key-value, but many different kind of values are supported: Strings, Lists, Sets, Sorted Sets, Hashes, Streams, HyperLogLogs, Bitmaps.

redis-scheduler

Java implementation of a lightweight distributed task scheduler based on Redis with support for Jedis, Lettuce and Spring Data Redis

redismanager

Redis单机和集群下数据的查询和删除，支持自定义key,value的序列化方式

seimicrawler

一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.

spider-jsoup

基于jsoup的入门爬虫系统，包括接口爬、定时爬、多线程爬