Producer helps produce a big number of system messages simultaneously to all partitions. Every message waits response with successful emitting to broker.
Consumer - read provided topic with unit group per thread with auto-commit option.
application follows the best CLI practises, so it contains help information about environment, supported, etc.
go install github.com/d7561985/kafka-ab@latestOPTIONS:
--topic value (default: "my-topic") [$TOPIC]
--kafka-server value (default: "PLAINTEXT://127.0.0.1:9094") [$KAFKA_SERVER]
--concurrency value (default: 10) [$CONCURRENCY]
--timelimit value, -t value Stop all tasks instantly. In case of desired request not reach will exist with status 1 (default: Seconds to max. to spend on benchmarking.) [$TIME_LIMIT]
--requests value, -n value require duration postfix: s - seconds, h - hours and etc (default: Number of requests to perform/consume) [$REQUESTS]
--verbosity value, -v value (default: How much troubleshooting info to print) [$VERBOSITY]
--force-name value, -f value (default: all consumer's groups have the same group name which pass throughout) [$FORCE_NAME]
--static, -s (default: all consumer's groups hase unique but static name (group-1, group-2 and group-...) [$STATIC]
--auto, -a (default: auto-commit option) [$AUTO_COMMIT]
--earliest, -e (default: read from the very beginning of log) [$EARLIEST]
--help, -h show help (default: false)OPTIONS:
--topic value (default: "my-topic") [$TOPIC]
--kafka-server value, --srv value (default: "PLAINTEXT://127.0.0.1:9094") [$KAFKA_SERVER]
--windowsize value, -b value Size of message send/receive buffer, in bytes (default: 1024) [$WINDOW_SIZE]
--concurrency value, -c value (default: Number of multiple requests to make/read at a time) [$CONCURRENCY]
--requests value, -n value (default: Number of requests to perform/consume) [$REQUESTS]
--timelimit value, -t value Stop all tasks instantly. In case of desired request not reach will exist with status 1 (default: Seconds to max. to spend on benchmarking.) [$TIME_LIMIT]
--timeout value, -s value require duration postfix: s - seconds, h - hours and etc (default: Seconds to max. wait for each response) [$TIME_OUT]
--verbosity value, -v value (default: How much troubleshooting info to print) [$VERBOSITY]
--help, -h show help (default: false)$ go run main.go c --topic my-topic --kafka-server 127.0.0.1:9094 --threads 10$ docker run --rm -it d7561985/kafka-ab:v1.0.0 -kafka-server PLAINTEXT://host.docker.internal:9094 consumer
$ docker run --rm -it -e KAFKA_SERVER=PLAINTEXT://host.docker.internal:9094 d7561985/kafka-ab:v1.0.0 producer$ kubectl run producer --image d7561985/kafka-ab:v1.0.2 --env KAFKA_SERVER=my-cluster-kafka-external-bootstrap:9094 --restart=Never -it --rm -- p -h
$ kubectl run producer --image d7561985/kafka-ab:v1.0.2 --env KAFKA_SERVER=my-cluster-kafka-external-bootstrap:9094 --restart=Never -it --rm -- c -hassume that we have topic with 50 partitions and some replicas
apiVersion: kafka.strimzi.io/v1beta1
kind: KafkaTopic
metadata:
name: my-topic
labels:
strimzi.io/cluster: my-cluster
spec:
partitions: 50
replicas: 2
config:
retention.ms: 3600000
segment.bytes: 1073741824for test topic try to use small retention time as log is filled very significantly
Application exits with status 1 when it can't meet some target.
For example: consumer don't read any message or consumer not reads desired requests number which helps to perform some CI tests ;)
--timelimitif any of consumer not read any message at the and of limit will exit with status 1--requestsexit with status 0 when request meat desired number, but if timelimit comes - status will be 1- Concurrent (
--concurrency) consumer with the force name (--force-name) - one group reads from different partitions --staticevery run consumers will have the same name. This helps to check auto-commit option for example--earliestoption allow to deside do you need read from the start of just new income. Set false to read new income only.
kubectl port-forward service/grafana -n global 3000:3000
kubectl -n global port-forward svc/kafka-cluster-strimzi-helm-kafka-external-bootstrap 9094:9094
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent