Giter Club home page Giter Club logo

Altshuler's Projects

dataetl icon dataetl

1)使用mapreduce清洗数据 2)再将输入导入数据仓库(hive+hadoop)3)编写hql进行查询 需求较为复杂 注意使用开窗 行列转换 子查询等技术点

hdfs icon hdfs

采用JavaAPI 在客户端操作hdfs

intellij-idea-tutorial icon intellij-idea-tutorial

🌻 This is a tutorial of IntelliJ IDEA, you can know how to use IntelliJ IDEA better and better.

kafkapractice icon kafkapractice

kafka:1)使用kafka完成生产和消费 2)生产者消费者分别使用高阶API 和低阶API操作 3)使用kafka自定义分区

log-analysis icon log-analysis

练习使用checkPoint 保存SparkStreaming的StreamingContext

mapreduceprac icon mapreduceprac

使用Hadoop的mapreduce做以下工作:1)简单单词统计 2)使用不同的InputFormat(TextInputFormat,NLine,KeyValue,CombineTextInputFormat),以及自定义输入格式组件3)自定义输出格式组件 4)练习在map端join 和在reduce端join 5)使用辅助排序 6)完成在mapreduce模型下的topN

movierecommendsystem icon movierecommendsystem

机器学习:1)离线统计(统计数据即可),离线推荐(基于LFM隐语义模型 采用ALS算法 ,并根据最小方差计算RMSE),2)实时推荐,实时根据用户最近看过的一部电影,找到相似的电影(相似矩阵由上一个需求得出)作为候选电影,再结合最近评分的电影,推出优先级别 3)基于内容(电影)的推荐,TF-IDF算法 4) 针对冷启动问题建议打上专家标签

myseckill icon myseckill

使用redis测试商品秒杀时线程安全问题 ,采用乐观锁解决后,出现商品富余问题(抢购次数一定范围内大于商品件数时)以及秒杀不公平问题;最后采用lua脚本解决,注意:最后的打印顺序不代表lua脚本的执行顺序,回到Java之后多个线程执行时的乱序性又会出现

zookeepermine icon zookeepermine

使用Java AP客户端对Zookeeper集群进行基本操作;对Zookeeper的数据,目录进行监听;模拟 使用zookeeper完成多台服务器加路由的后台架构

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.