Skip to content

fs2-kafka v2.5.0-M2

Pre-release
Pre-release
Compare
Choose a tag to compare
@bplommer bplommer released this 21 Mar 12:10
· 296 commits to series/2.x since this release
f503479

This release is identical to v2.5.0-M1, which failed to publish.

This release adds some new features and significantly simplifies the internals of the consumer. Although we don't expect these changes to cause any problems, we're releasing this as a milestone to allow for some extra battle testing before the next stable release.

Note: there is a small change to the behaviour of consumers when using partitionedStream or partitionsMapStream. Previously, failure to deserialize a record would cause the entire consumer to fail; now, it will only cause a single partition stream to fail.

What's Changed

New features

  • Add produce method to KafkaProducerConnection by @bplommer in #900
    • KafkaProducerConnection allocates a producer without being tied to particular serializers, allowing creation of multiple KafkaProducer instances that share a single set of connections to the broker. With this change, it is possible to produce records directly from KafkaProducerConnection by providing serializers when calling produce.
  • Allow creating settings with placeholder serdes, changing serdes in settings by @bplommer in #911
    • This allows creation of ProducerSettings and ConsumerSettings to be decoupled from provision of serializers and deserializers, which is particularly useful when creating multiple producers or consumers with different types.

Docs improvements

Simplification of internals

  • Move deserialization from KafkaConsumerActor to KafkaConsumer by @bplommer in #902
  • Use semaphore-like permits for some actor operations by @bplommer in #906

Dependency updates

New Contributors

Full Changelog: v2.4.0...2.5.0-M1