Kafka mirrormaker2 did not sync all messages #11122
Unanswered
freedomwarrior
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
We using kafka 3.9 in kraft mode and mirrormaker2 to sync main cluster with backup cluster in Active/Passive mode. The problem is, when we turn on sync(mm2) on backup cluster, mm2 sync only a 1/3 of messages and then stop syncing old messages and sync only new one. It feels like mm2 skipping some data for some reason. For example, we got topic with size of 30GB(~20 million messages), but only 12GB(~1.5 million) synced. We think that problem can be with
auto.offset.reset
and we set it toauto.offset.reset=earliest
but no luck. Here is our full config of mm2:Beta Was this translation helpful? Give feedback.
All reactions