Skip to content

Commit

Permalink
Prevent Kafka sink from blocking
Browse files Browse the repository at this point in the history
Previously, we used native Kafka sink implementation through kafka-clients.
This caused an issue when actual `send` operation becomes blocking as the
record write buffer fills and an actual send operation is performed.
We're currently successfully using fs2-kafka in enrich with Enrich without
major issues. Rewriting the Sink to use a two-effect pattern makes no sense
and therefore fs2-kafka is used to prevent blocking problems.
  • Loading branch information
peel committed Mar 26, 2024
1 parent 3f77728 commit 82399b8
Show file tree
Hide file tree
Showing 4 changed files with 421 additions and 94 deletions.
Loading

0 comments on commit 82399b8

Please sign in to comment.