You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'd like to use Kafka (and librdkafka) to return messages in the correct order in my consumer every time.
The situation that I've got is a topic with multiple partitions (2 in my reproduction), with 1 producer and 1 consumer per partition. When a consumer leaves / rejoins the group, there's a consumer rebalance that occurs.
After the rebalance occurs, my consumers jump back an indeterminate number of messages, and begin consumption from there.
So, I have a few questions on this:
Is this normal behavior?
If this is normal behavior, is there anything I should be doing to prevent this?
Related
It looks like #3710 is related, but even with version 1.9.1-1-g4faeb8, I'm still seeing these offset rewind issues.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Question
I'd like to use Kafka (and librdkafka) to return messages in the correct order in my consumer every time.
The situation that I've got is a topic with multiple partitions (2 in my reproduction), with 1 producer and 1 consumer per partition. When a consumer leaves / rejoins the group, there's a consumer rebalance that occurs.
After the rebalance occurs, my consumers jump back an indeterminate number of messages, and begin consumption from there.
So, I have a few questions on this:
Related
It looks like #3710 is related, but even with version 1.9.1-1-g4faeb8, I'm still seeing these offset rewind issues.
(Lengthy) Reproduction
Beta Was this translation helpful? Give feedback.
All reactions