How to consume two topics with different configurations about rust-rdkafka HOT 1 CLOSED

Right, so assigning explicit partitions will blow away whatever subscriptions you've requested. What you can do instead is subscribe to both topics, and then use a rebalance callback to adjust the partition on the config topic to 0. The librdkafka has docs on how to do this for C/C++: https://github.com/edenhill/librdkafka/wiki/Manually-setting-the-consumer-start-offset.

In Rust, you'd override ConsumerContext::rebalance and then adapt the code to work with the TopicPartitionList object.

Alternatively, I think you could just set the auto.offset.reset to earliest for the config topic (when you create it). Then you could simply subscribe to both topics. This would require you to disable auto commit, though, and then manually commit offsets for the input topic (but not the config topic).

I'm going to close this out because it's unlikely that you're still interested in the answer to this one year later. Apologies!

from rust-rdkafka.