abs-tudelft / sbd Goto Github PK

In the guide which states how to run the different shells and servers
https://github.com/Tclv/SBD-tudelft/blob/0b2a9796d16a5904df028904105f1cfaea6b46d7/doc/2-guide.text#L179

the docker run command uses : in the pwd path which is not correct and gives an error in Linux

docker: Error response from daemon: create 'pwd': "'pwd'" includes invalid characters for a local volume name, only "[a-zA-Z0-9][a-zA-Z0-9_.-]" are allowed. If you intended to pass a host directory, use absolute path.

The commands work if the : is omitted.

The example project's source file starts with a package directive:

https://github.com/Tclv/SBD-tudelft/blob/604a2aeaac6ac5bc5cf630014abdf20259765d1d/example/src/main/scala/example.scala#L1

whereas the lab1 template project does not. Students have been using the example project to base their own code upon, which causes some confusion with Spark not being able to find their main class as it is scoped under a package example in lab 2.

Most convenient would probably be removing the statement altogether.

Whenever a record is decremented, it is unknown which record should take its place as records outside the top-100 are not stored by the consumer. This results in a histogram that is incorrect.

• Describe which timestamps to use to determine record age
• Make sure people don't extract timestamps from GDELT rows
• Factor in the existence of KTable.suppress, which makes using a window very easy- (actually this isn't true)
• Emphasize that the stream transformer has to be started manually using SBT
• Rule out the usage of fire-once punctuators
• Better define the docker-compose workflow overall and try to make it so that docker-compose down is not necessary to get rid of state
• Factor in timezone differences (mainly in producer)