Dockerfiles for building a storm cluster. Inspired by https://github.com/ptgoetz/storm-vagrant and https://github.com/wurstmeister/storm-docker.
- install docker-compose http://docs.docker.com/compose/install/
Start a cluster:
docker-compose up
Destroy a cluster:
docker-compose stop
Add more supervisors:
docker-compose scale supervisor=3
rebuild.sh
Here, SUPERVISOR_ADDRESS
is the address of the supervisor's host.
docker run -d --restart=unless-stopped \
--name storm-supervisor \
-p 8000:8000 \
-e "NIMBUS_ADDRESS=10.3.2.110" \
-e "NIMBUS_DRPC_PORT=49772" \
-e "NIMBUS_DRPCI_PORT=49773" \
-e "ZOOKEEPER_ADDRESS=10.3.2.110" \
-e "ZOOKEEPER_PORT=49181" \
-e "SUPERVISOR_ADDRESS=10.3.2.120" \
sunside/storm-supervisor:0.10.0
Take a look at docker-compose.yml:
ui:
image: sunside/storm-ui:0.10.0
ports:
- "49080:8080"
This tells Docker to expose the Docker UI container's port 8080 as port 49080 on the host
If you are running docker natively you can use localhost. If you're using boot2docker, then do:
$ boot2docker ip
The VM's Host only interface IP address is: 192.168.59.103
Which returns your docker VM's IP.
So, to open storm UI, type the following in your browser:
localhost:49080
or
192.168.59.103:49080
in my case.
Since the nimbus host and port are not default, you need to specify where the nimbus host is, and what is the nimbus port number.
Following the example above, after discovering the nimbus host IP (could be localhost, could be our docker VM ip as in the case of boot2docker), run the following command:
storm jar target/your-topology-fat-jar.jar com.your.package.AndTopology topology-name -c nimbus.host=192.168.59.103 -c nimbus.thrift.port=49627