[inputs. kafka_consumer] Multiple Telegraf instances in the same group but only one is consuming about telegraf HOT 6 CLOSED

Hello! I recommend posting this question in our Community Slack or Community Forums, we have a lot of talented community members there who could help answer your question more quickly. You can also learn more about Telegraf by enrolling at InfluxDB University for free!

Heads up, this issue will be automatically closed after 7 days of inactivity. Thank you!

from telegraf.

@wanggjSuper did you set individual consumer_groups? If you didn't, all telegraf instances will belong to the same consumer group and the messages will be partitioned between the clients. That's the expected Kafka behavior...

from telegraf.

@wanggjSuper did you set individual consumer_groups? If you didn't, all telegraf instances will belong to the same consumer group and the messages will be partitioned between the clients. That's the expected Kafka behavior...

Multiple Telegraf instances are configured with the same consumption group, but only one instance is consuming

from telegraf.

@wanggjSuper I see, sorry for my misunderstanding of the issue! Let me try to reproduce the issue on my machine...

from telegraf.

@wanggjSuper,

To help out with an issue, it would be very helpful if you could please provide the following:

1. config for each telegraf you are running
2. enable debug mode
3. enable client_trace in kafka
4. provide the logs from each client

Thanks

from telegraf.

Hello! I am closing this issue due to inactivity. I hope you were able to resolve your problem, if not please try posting this question in our Community Slack or Community Forums or provide additional details in this issue and reqeust that it be re-opened. Thank you!

from telegraf.