Basic ETL procedures in hadoop map-reduce API.
mvn package
scp target/ETL-examples-0.0.1-SNAPSHOT-jar-with-dependencies.jar <your-hadoop-host>
ssh <your-hadoop-host>
hadoop jar ETL-examples-0.0.1-SNAPSHOT-jar-with-dependencies.jar \
org.idryman.aggregation.BasicAggregation \
-Dbasic-agg.start="$(date -d 'yesterday 13:00' '+%s')000" \
-Dbasic-agg.end="$(date -d '00:00' '+%s')000" \
<input> <output>
hadoop jar ETL-examples-0.0.1-SNAPSHOT-jar-with-dependencies.jar \
org.idryman.aggregation.OneToMany <dim_input> <fact_input> <output>
TODO
CopyRight 2015 Felix Chern ALv2