hey-johnnypark / docker-kafka-zookeeper Goto Github PK
View Code? Open in Web Editor NEWDocker image for Kafka (0.10.x - 0.11.x - 1.x, 2.x) message broker including Zookeeper
Home Page: https://hub.docker.com/r/johnnypark/kafka-zookeeper/
Docker image for Kafka (0.10.x - 0.11.x - 1.x, 2.x) message broker including Zookeeper
Home Page: https://hub.docker.com/r/johnnypark/kafka-zookeeper/
Hi @hey-johnnypark ,
I'm new to kafka. I don't know anything about Kafka so far but I want to use your docker to understand how kafka works. Could you please help me?
I could run the first command
"docker run -p 2181:2181 -p 9092:9092 -e ADVERTISED_HOST=127.0.0.1 -e NUM_PARTITIONS=10 johnnypark/kafka-zookeeper"
It seems to be running fine (at least I didn't get any errors). Now I want to test it.
And I don't know how to test it.
Where/how do I run the consumer and producer?
Thanks in advance.
The container is failing to start as a fargate task with following logs,
**2022-03-21T14:04:31.833Z Num Partitions: 10
2022-03-21T14:04:31.838Z default number of partition: 10
2022-03-21T14:04:32.790Z 2022-03-21 14:04:32,789 WARN received SIGTERM indicating exit request
2022-03-21T14:04:32.790Z 2022-03-21 14:04:32,789 INFO waiting for zookeeper, kafka to die
2022-03-21T14:04:32.797Z 2022-03-21 14:04:32,796 INFO success: zookeeper entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2022-03-21T14:04:32.797Z 2022-03-21 14:04:32,797 INFO stopped: kafka (terminated by SIGTERM)
2022-03-21T14:04:32.805Z 2022-03-21 14:04:32,799 INFO stopped: zookeeper (terminated by SIGTERM)**
Hi!
How to use SASL mechanism? Does the image have some environment values for usage of this?
When I execute docker build .
I get following error
[+] Building 6.8s (6/15) docker:desktop-linux
=> [internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 1.39kB 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/library/alpine:3.9.2 4.3s
=> [ 1/11] FROM docker.io/library/alpine:3.9.2@sha256:644fcb1a676b5165371437feaa922943aaf7afcfa8bfee4472f6860 1.7s
=> => resolve docker.io/library/alpine:3.9.2@sha256:644fcb1a676b5165371437feaa922943aaf7afcfa8bfee4472f6860aa 0.0s
=> => sha256:f663714dca1af21af37546a875f0146db50643d8ac894c09f4f01639cefcca6b 1.51kB / 1.51kB 0.0s
=> => sha256:3b00a3925ee4b356facd24aea8ece58982a66577023cb3596ce3a321aef976f9 2.69MB / 2.69MB 1.5s
=> => sha256:644fcb1a676b5165371437feaa922943aaf7afcfa8bfee4472f6860aad1ef2a0 2.36kB / 2.36kB 0.0s
=> => sha256:65faa9b36980bbcca914e5e6d3baa005261be9b0f305546553d670a6de939bcb 528B / 528B 0.0s
=> => extracting sha256:3b00a3925ee4b356facd24aea8ece58982a66577023cb3596ce3a321aef976f9 0.1s
=> [internal] load build context 0.0s
=> => transferring context: 5.36kB 0.0s
=> ERROR [ 2/11] RUN apk add --update openjdk8-jre supervisor bash gcompat 0.7s
------
> [ 2/11] RUN apk add --update openjdk8-jre supervisor bash gcompat:
0.142 fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/main/aarch64/APKINDEX.tar.gz
0.513 fetch http://dl-cdn.alpinelinux.org/alpine/v3.9/community/aarch64/APKINDEX.tar.gz
0.781 ERROR: unsatisfiable constraints:
0.786 gcompat (missing):
0.786 required by: world[gcompat]
------
Dockerfile:6
--------------------
4 | USER root
5 |
6 | >>> RUN apk add --update openjdk8-jre supervisor bash gcompat
7 |
8 | ENV ZOOKEEPER_VERSION 3.4.13
--------------------
ERROR: failed to solve: process "/bin/sh -c apk add --update openjdk8-jre supervisor bash gcompat" did not complete successfully: exit code: 1
SOLUTION: The error is because the package gcompat
is not available in the Alpine Linux package repository you are using (Alpine 3.9.2).
gcompat
was available in older Alpine versions but may not be available in Alpine 3.9.2, which is a relatively older version. You can either update your Docker image to use a newer version of Alpine Linux or modify your Dockerfile to use a different base image that includes gcompat
or doesn't require it.
So just replace FROM alpine:3.9.2
with FROM alpine:3.14
and done.
In this docker image, new topics are not created automatically. How do I set auto.create.topics.enable=true in this docker image so that new topics are created automatically?
Hi, I really want to be able to use this docker image with https://github.com/testcontainers/testcontainers-rs but the problem is the ports will be randomly mapped for me and it seems like that breaks some things internally. Is it possible to use this container with randomly chosen mapped ports? I can run some exec commands after the fact if that's the only way.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.