Just a tiny seed of develop hadoop + spark.
git clone --recurse-submodules [email protected]:yuikns/iphigenia.git
It is managed by sbt. You can import it into IntelliJ.
You can add some more packages via mvnrepository, copy and paste the path into project/BuildIphigenia.scala
After finish your developing, you can use script
scripts/pack
and get .jar(in this case is target/scala-2.11/cse8803-0.0.1-2.11.8.jar, may be changed based on your change in configuration) package contains all the dependencies.
if you are a windows user, please type the above command instead:
sbt assembly
This is just a small seed to help you quickly initialize a project for course, you can post issue if you have any questions. DO NOT upload the real code for you homework.