Datatorrent is platform for writing real-time application on Hadoop It scales linearly with number of resources. It provides a simple programing model to write scalable application using java, and comes with more that 400 open source operators

Scala is functional/object-oriented language targeted toward jvm. As the code is targeted for JVM, scala program can use existing Java objects, which make it easier to integrate with existing Java applications/Frameworks.

SBT is the build tool for Scala, This project is using SBT to managing dependency, compilation and creation of package.

sbt compile

sbt package

The application requires malhar and scala runtime libraries to run. These can be installed on launch machine, or packaged with AppBundles feature. Example below uses locally installed scala libraries.

$ dtcli 
dt> launch -libjars /usr/share/scala/lib/* dtscalatest_2.10-1.0.jar

For more information about DataTorrent visit:

• DataTorrent - https://www.datatorrent.com/
• DataTorrent Docs - https://www.datatorrent.com/docs/
• Malhar - https://github.com/DataTorrent/Malhar