Giter Club home page Giter Club logo

kafkacat-images's Introduction

Docker images for Kafkacat

This repo provides build files for kcat Docker images.

Properties

Properties are inherited from a top-level POM. Properties may be overridden on the command line (-Ddocker.registry=testing.example.com:8080/), or in a subproject's POM.

  • docker.skip-build: (Optional) Set to false to include Docker images as part of build. Default is 'false'.
  • docker.skip-test: (Optional) Set to false to include Docker image integration tests as part of the build. Requires Python 2.7, tox. Default is 'true'.
  • docker.registry: (Optional) Specify a registry other than placeholder/. Used as DOCKER_REGISTRY during docker build and testing. Trailing / is required. Defaults to placeholder/.
  • docker.tag: (Optional) Tag for built images. Used as DOCKER_TAG during docker build and testing. Defaults to the value of project.version.
  • docker.upstream-registry: (Optional) Registry to pull base images from. Trailing / is required. Used as DOCKER_UPSTREAM_REGISTRY during docker build. Defaults to the value of docker.registry.
  • docker.upstream-tag: (Optional) Use the given tag when pulling base images. Used as DOCKER_UPSTREAM_TAG during docker build. Defaults to the value of docker.tag.
  • docker.test-registry: (Optional) Registry to pull test dependency images from. Trailing / is required. Used as DOCKER_TEST_REGISTRY during testing. Defaults to the value of docker.upstream-registry.
  • docker.test-tag: (Optional) Use the given tag when pulling test dependency images. Used as DOCKER_TEST_TAG during testing. Defaults to the value of docker.upstream-tag.
  • docker.os_type: (Optional) Specify which operating system to use as the base image by using the Dockerfile with this extension. Valid values are ubi8. Default value is ubi8.

Building

This project uses maven-assembly-plugin and dockerfile-maven-plugin to build Docker images via Maven.

To build SNAPSHOT images, configure .m2/settings.xml for SNAPSHOT dependencies. These must be available at build time.

mvn clean package -Pdocker -DskipTests # Build local images

License

Usage of this image is subject to the license terms of the software contained within. Please refer to Confluent's Docker images documentation reference for further information. The software to extend and build the custom Docker images is available under the Apache 2.0 License.

kafkacat-images's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

kafkacat-images's Issues

kafkacat not support -G or -X

Version: 5.0.4

prod@infra-tb800-06:~$ docker run --rm --name kafkacp1-src confluentinc/cp-kafkacat:5.0.4 kafkacat -C -b 192.168.2.16:9092,192.168.2.17:9092,192.168.2.18:9092 -t itcnd-tencent-50-f3-bdc -G kafkacp01 -X auto.offset.reset=earliest
% ERROR: Failed to subscribe to 0 topics: Local: Invalid argument or configuration

prod@infra-tb800-06:~$ docker run --rm --name kafkacp1-src confluentinc/cp-kafkacat:5.0.3 kafkacat -C -b 192.168.2.16:9092,192.168.2.17:9092,192.168.2.18:9092 -t itcnd-tencent-50-f3-bdc -G kafkacp01 -X auto.offset.reset=earliest
Unable to find image 'registry.inventec/hub/confluentinc/cp-kafkacat:5.0.3' locally
5.0.3: Pulling from hub/confluentinc/cp-kafkacat
f7e2b70d04ae: Pull complete 
2d44f0aae703: Pull complete 
c868d41e3946: Pull complete 
Digest: sha256:3eb41769c16258dff56aa818587978f53da94481be66b333a7732d52c052a246
Status: Downloaded newer image for registry.inventec/hub/confluentinc/cp-kafkacat:5.0.3
% ERROR: Failed to subscribe to 0 topics: Local: Invalid argument or configuration

Include pv in container

I've been using this container in kubernetes to create test loads, works a treat.

Overridden the entrypoint and executing a script inside the container - again works well.

I'd love to have some control over the throughput of the producers.

Script in question:

cat /dev/urandom | base64 | kafkacat -P -t test-topic -b "${BOOTSTRAP_HOST}" -l -X linger.ms=1000

I'd propose to be able to use pv:

cat /dev/urandom | base64 | pv --line-mode --rate-limit 100K | kafkacat -P -t test-topic -b "${BOOTSTRAP_HOST}" -l -X linger.ms=1000

Likewise you could consume and pipe it through pv to emulate a slow writing/processing consumer.

I appreciate this could be out of scope but I figured it's worth asking.

Thanks again.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.