Gettings statistics outside of the consumer_poll flow

[mensfeld]

Is there a way to get the statistics emitted in the intervals outside of the rd_kafka_consumer_poll flow?

In the case of longer processing where #rd_kafka_consumer_poll is not called every 5 seconds, the metrics are not published for an extensive time period until rd_kafka_consumer_poll is called. Is there any way to use the Events API to achieve this and (somehow) redirect statistics to a separate queue or have them published alongside via Events API?

My goal would be to collect metrics alongside of processing, as mentioned in the docs rd_kafka_poll cannot be used to trigger cb for a consumer.

[mensfeld]

It seems I could use rd_kafka_conf_set_background_event_cb but any way to get only events I am interested in? That is only the statistics?

[mensfeld]

I can answer my own question now:

I was using rd_kafka_poll_set_consumer and redirecting the events. I can poll them independently, achieving what I need.