Documentation Feedback on Reactor Kafka's Observation API about reactor-kafka HOT 6 OPEN

@almogtavor, first you can try replacing ReactiveKafkaProducerTemplate by KafkaSender. This allows to confiure metrics and observation. Will be available on upcoming Reactor Kafka release.

@Bean
public SenderOptions<String, OutputPojo> kafkaProducerOptions(
        @Value("${spring.kafka.consumer.topic}") String outputTopic,
        KafkaProperties properties) {
    Map<String, Object> props = properties.buildProducerProperties();

    return SenderOptions.create(props);
}

@Bean
public KafkaSender<String, OutputPojo> kafkaSender(
        SenderOptions<String, OutputPojo> kafkaSenderOptions,
        ObservationRegistry registry) {
    return KafkaSender.create(kafkaSenderOptions
            .withObservation(registry));
}

Beside this using libs on your sample project look slightly outdated. Not sure if this still fits together...

from reactor-kafka.

upvoting this

from reactor-kafka.

@janchristian-haddorp thank you very much. I didn't know about the .withObservation method so I'll try it and update my deps to boot 3 etc. Can you refer to my 3 points I struggled with? Have you tried tracing the parallel scheduler? Buffers?

from reactor-kafka.

See an Observation support in the upcoming release: https://github.com/reactor/reactor-kafka/blob/main/src/docs/asciidoc/api-guide.adoc#micrometer-observation.

The rest of questions about parallel scheduler and buffers are out of this project scope.
See general Reactor docs:
https://projectreactor.io/docs/core/release/reference/#_observation
https://projectreactor.io/docs/core/release/reference/#context.propagation

The Otel API is definitely out of our reach at all.

Not sure what else you would like to see from the scope of this project...

from reactor-kafka.

@artembilan what is the usage of "user.receiver" inside KafkaRecordReceiverContext? (https://github.com/reactor/reactor-kafka/blob/main/src/docs/asciidoc/api-guide.adoc#micrometer-observation)

from reactor-kafka.

See KafkaRecordReceiverContext source code: https://github.com/reactor/reactor-kafka/blob/main/src/main/java/reactor/kafka/receiver/observation/KafkaRecordReceiverContext.java#L37

So, that is a receiverId - a unique id for the reactor.kafka.client.id tag in the target span.
Logical identifier of your Reactor Kafka service.

from reactor-kafka.