With this CLI tool you can create pipelines in Streamsets Data collector which will pull data from different sources and push it to anodot

• How to install
• Set up dev environment

To use the CLI you need to build and run docker containers and then attach to the agent container. Currently there are two versions of the agent: release and dev.

You need to rebuild the release version of the agent every time you change code in it. Dev version will pull changes on the fly. To build the agent run

make build-all

to build a release version or

make build-all-dev

to build a dev version.

To attach to the agent container run

docker attach anodot-agent

To run all tests on a dev or release version simply run

make all

or

make all-dev

correspondingly. It will build all containers and run all tests

You can also test only a specific source, to do that you can run make test-resource-name, for example

make test-kafka

Github Wiki