Skip to content

BE: Serde: Support mm2 topics serdes #444

Open
@fallen-up

Description

@fallen-up

Issue submitter TODO list

  • I've searched for an already existing issues here
  • I'm running a supported version of the application which is listed here and the feature is not present there

Is your proposal related to a problem?

No response

Describe the feature you're interested in

mirrormaker2 has some service topics in a special format, since kafka version 2.7.0 it is now possible to view them manually.
It would be great if kafka-ui could do this too.

documentation:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-597%3A+MirrorMaker2+internal+topics+Formatters
apache/kafka#8604

examples:
HeartbeatFormatter:
./bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic heartbeats --formatter org.apache.kafka.connect.mirror.formatters.HeartbeatFormatter --from-beginning
Heartbeat{sourceClusterAlias=B, targetClusterAlias=A, timestamp=1588502119726}

CheckpointFormatter:
./bin/kafka-console-consumer.sh --bootstrap-server localhost:9093 --topic A.checkpoints.internal --formatter org.apache.kafka.connect.mirror.formatters.CheckpointFormatter --from-beginning
Checkpoint{consumerGroupId=qwert, topicPartition=A.heartbeat, upstreamOffset=631, downstreamOffset=631, metatadata=}

OffsetSyncFormatter:
./bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic mm2-offset-syncs.B.internal --formatter org.apache.kafka.connect.mirror.formatters.OffsetSyncFormatter --from-beginning
OffsetSync{topicPartition=heartbeat-0, upstreamOffset=0, downstreamOffset=0}

Describe alternatives you've considered

No response

Version you're running

1.0.0

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    area/serdeSerialization & Deserialization (plugins)scope/backendRelated to backend changesstatus/triage/completedAutomatic triage completedtype/enhancementEn enhancement/improvement to an already existing feature

    Projects

    Status

    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions