...

Clone the repo, and docker-compose up in the repo root.

It exposes the 9042 cassandra port and the 3000 server port.

Ctrl+c to stop.

docker-compose down to clean up.

Install java and sbt. Download spark 1.6.1 and unpack it.

Build:

sbt assembly

Start spark

cd [spark unpacked directory]
./sbin/start-master.sh
(look at http://localhost:8080 for spark://[SPARK_HOST:SPARK_PORT] address)
./sbin/start-slave.sh spark://[SPARK_HOST:SPARK_PORT] --cores 2 --memory 1g

Submit our application to spark for execution:

cd activity-tracking/sparkApp
spark-submit --master "spark://[SPARK_HOST:SPARK_PORT]" --class activity.Main "[GITHUB_CLONE_DIR]/activity-tracking/sparkApp/target/scala-2.10/spark-activity-tracking-assembly-1.0.jar" [CASSANDRA_IP]

(where CASSANDRA_IP for cassandra from docker-compose can be obtained by "ifconfig docker0" on linux)

To backup the cassandra files launch:

docker run --rm -v activitytracking_cassandraData:/var/lib/cassandra -v LOCALDIRECTORY:/backup ubuntu tar cvf /backup/backup.tar /var/lib/cassandra

where LOCALDIRECTORY is a directory on your system.

1. Launches ubuntu container which will get destroyed after exiting (--rm)
2. Mounts activitytracking_cassandraData volume to /var/lib/cassandra in the container.
3. Mounts your local directory (for example /opt/data on linux/OSX, or c:\opt\data on windows).
4. Packs the activitytracking_cassandraData to the backup.tar file in your local directory.

To restore the cassandra files launch:

docker volume create --name activitytracking_cassandraData

docker run --rm -v activitytracking_cassandraData:/var/lib/cassandra -v LOCALDIRECTORY:/backup ubuntu bash -c "cd /var && tar xvf /backup/backup.tar --strip 1"

where LOCALDIRECTORY is a directory on your system.

1. Launches ubuntu container which will get destroyed after exiting (--rm)
2. Mounts activitytracking_cassandraData volume to /var/lib/cassandra in the container.
3. Mounts your local directory (for example /opt/data on linux/OSX, or c:\opt\data on windows).
4. Unpacks the backup file from your local directory into the volume.

cd into the restapi directory. Run

go get -d .
go build
docker build -t cube2222/activity-tracking-rest:latest .

The image is built.