fs2-kafka v1.3.0

This release fixes an important bug in v1.2.0. Enormous thanks to @LMnet for finding and reporting it so quickly.

It is binary compatible with v1.0.0 and v1.1.0, but not with v1.2.0, which should not be used.

Bug fix

• Fixed 1.2.0 regression: lost guarantee of order for producer (#477)

Binary-breaking change

• Reintroduced ConcurrentEffect requirement for producers, breaking binary compatibility with v1.2.0

Updates

• Update kind-projector to 0.11.3 (#470) @scala-steward

fs2-kafka v1.2.0

Important regression (2020-01-18)

This release introduces a bug that breaks ordering guarantees for producers. Do not use.

Previous summary

This release provides several pieces of new and improved functionality, for which particular thanks are due to @LMnet. We have also made various API changes and deprecations in preparation for supporting Scala 3 and cats-effect 3.

New functionality

• Added stopConsuming method to the KafkaConsumer (#421) @LMnet
• Added commitSync and commitAsync methods to the KafkaConsumer (#420) @LMnet
• Added KafkaAdminClient methods alterConsumerGroupOffsets and deleteConsumerGroupOffsets (#408) @LMnet
• Partitions map stream (#405, #422) @LMnet
• Allow multiple KafkaProducer instances to share underlying resources (#436) @bplommer

Changes

• Improved ergonomics for instantiatingKafkaConsumer, KafkaProducer, TransactionalKafkaProducer, and KafkaAdminClient (#437, #447)
  • Factory methods in the fs2.kafka package object are deprecated in favour of (mostly) new methods on companion objects
• Decompose consumer into traits (#429) @bplommer
  • KafkaConsumer is now composed of several traits, which, unlike KafkaConsumer itself, are not sealed. By writing client code against these traits, it is possible to create mock implementations of them for testing.

Updates

• Update vulcan to 1.3.0 (#465) bplommer
• Update cats to 2.2.0 (#426) @nasadorian
• Update sbt-mdoc to 2.2.14 (#452) @scala-steward
• Update cats-effect-laws to 2.3.1 (#453) @scala-steward
• Update discipline-scalatest to 2.1.1 (#455) @scala-steward
• Update sbt to 1.4.6 (#458) @scala-steward
• Update fs2-core to 2.5.0 (#457) @scala-steward
• Update sbt-ci-release to 1.5.5 (#448) @scala-steward
• Update kafka-avro-serializer to 6.0.1 (#444) @scala-steward
• Update discipline-scalatest to 2.1.0 (#430) @scala-steward
• Update kind-projector to 0.11.1 (#432) @scala-steward
• Update sbt-mima-plugin to 0.8.1 (#412) @scala-steward
• Update scala to 2.12.12 (#403) @JackTreble
• Update kafka-avro-serializer to 6.0.0 (#402) @scala-steward

Miscellaneous

• Update copyright headers (#460) @bplommer
• Fix build (#406) @LMnet
• Drop better-monadic-for (#439) @bplommer
• Syntax changes for scala 3 support (#443) @bplommer
• Switch from Travis to GitHub Actions (#449) @vlovgr
• Weaken Producer requirements + refactoring (#418) @bplommer

fs2-kafka v1.1.0

Changes

• Add producer metrics (#335) @janstenpickle
• Fix problem with emitting same data from stream after rebalance (#331) @vavr

Updates

• Update depedencies to latest versions (#392) @vlovgr
  • Update cats-effect to 2.1.4
  • Update fs2 to 2.4.3
  • Update kafka-avro-serializer to 5.5.1
• Update fs2-core to 2.4.4 (#393) @scala-steward
• Update Kafka to 2.5.0 (#363) @vlovgr
• Update kafka-clients to 2.4.1 (#339) @scala-steward
• Update scala to 2.13.3 (#391) @vlovgr
• Update vulcan to 1.2.0 (#396) @scala-steward

Documentation

• Update documentation: Add port to bootstrap server url. (#323) @mvalle

Miscellaneous

• Change to enable mima after 1.0.0 release (#341) @vlovgr
• Update depedencies to latest versions (#392) @vlovgr
  • Update discipline-scalatest to 2.0.0
  • Update embedded-kafka to 2.6.0
• Update discipline-scalatest to 2.0.1 (#394) @scala-steward
• Update sbt to 1.3.13 (#377) @scala-steward
• Update sbt-buildinfo to 0.10.0 (#386) @scala-steward
• Update sbt-ci-release to 1.5.3 (#357) @scala-steward
• Update sbt-header to 5.6.0 (#355) @scala-steward
• Update sbt-mdoc to 2.2.8 (#400) @scala-steward
• Update sbt-mima-plugin to 0.7.0 (#333) @scala-steward
• Update sbt-scalafmt to 2.4.2 (#383) @scala-steward
• Update sbt-unidoc to 0.4.3 (#319) @scala-steward

fs2-kafka v1.0.0

Changes

• Change to not include scoped dependencies in pom (#313) @vlovgr

Updates

• Update fs2-core to 2.2.1 (#314) @scala-steward
• Update vulcan to 1.0.1 (#315) @scala-steward

Miscellaneous

• Update discipline-scalatest to 1.0.0-RC4 (#311) @vlovgr
• Update sbt to 1.3.7 (#307) @scala-steward

fs2-kafka v1.0.0-RC1

Changes

• Add apply functions for AvroSerializer and AvroDeserializer (#270) @bplommer
• Add additional consumer functionality (#273) @vavr
• Add extractors for CommittableConsumerRecord and Header (#266) @hmagrahi
• Change default ProducerSettings#parallelism to 10000 (#303) @vlovgr
• Change group id to com.github.fd4s (#301) @vlovgr
• Change to ensure revoked partition records are removed (#302) @vlovgr
• Change to maintain binary compatibility across minor versions (#306) @vlovgr
• Change to use writer schema from schema registry for deserialization (#282) @bplommer
• Rename Serializer.Record and Deserializer.Record (#304, #269) @vlovgr @bplommer

Updates

• Update confluent serializer to 5.4.0 (#300) @vlovgr
• Update fs2 to 2.1.0 (#255) @scala-steward
• Update kafka to 2.4.0 (#300) @vlovgr
• Update scala to 2.13.1 (#262) @vlovgr
• Update vulcan to 1.0.0-RC1 (#305) @vlovgr

Miscellaneous

• Change to use sbt-ci-release (#283) @vlovgr
  • A snapshot release is now being published for every push to the master branch.
  • The signing key for release artifacts has changed to E97C 64AB 4987 7F74.
• Remove direct dependency on scalatest (#298) @vlovgr
• Remove release notes in favour of github releases (#287) @vlovgr
• Update discipline-scalatest to 1.0.0-RC2 (#297) @scala-steward
• Update embedded-kafka to 2.4.0 (#300) @vlovgr
• Update sbt to 1.3.6 (#290) @scala-steward
• Update sbt-ci-release to 1.5.0 (#292) @scala-steward
• Update sbt-gpg to 0.2.1 (#268) @scala-steward
• Update sbt-header to 5.4.0 (#296) @scala-steward
• Update sbt-mdoc to 2.1.1 (#295) @scala-steward
• Update sbt-scalafmt to 2.3.0 (#275) @scala-steward
• Update sbt-sonatype to 3.8.1 (#263) @scala-steward
• Update years in copyright license (#293) @vlovgr

fs2-kafka v0.20.2

Changes

• Add support for creating, describing, and deleting ACLs. Thanks @novakov-alexey! (#250, #251)

Updates

• Update fs2 to 2.0.1. (#219)
• Update kafka to 2.3.1. (#252)
• Update scala to 2.12.10. (#226)
• Update vulcan to 0.2.2. Thanks @scala-steward! (#227)

Miscellaneous

• Update sbt to 1.3.3. (#242)
• Update sbt-mdoc to 1.3.5. Thanks @scala-steward! (#230)
• Update sbt-mima-plugin to 0.6.1. Thanks @scala-steward! (#216)
• Update sbt-release to 1.0.12. Thanks @scala-steward! (#243)
• Update sbt-scalafmt to 2.2.1. Thanks @scala-steward! (#248)
• Update sbt-sonatype to 3.8. Thanks @scala-steward! (#225)
• Update scalafmt-core to 2.2.1. Thanks @scala-steward! (#245)

Released on 2019-10-29.

fs2-kafka v0.20.1

Changes

• Add Timestamp#unknownTime. Thanks @chenharryhua! (#197, #213)
• Fix potential consumer stalling by reverting #180. Thanks @jferris! (#215)

Miscellaneous

• Update sbt-sonatype to 3.7. Thanks @scala-steward! (#212)
• Update sbt-scalafmt to 2.0.5. Thanks @scala-steward! (#214)

Released on 2019-09-19.

fs2-kafka v0.20.0

Changes

• Add describeConfigs to KafkaAdminClient. Thanks @BenFradet! (#196)
• Change the default producer setting max.retries to 0. (#211)

Updates

• Update cats-effect to 2.0.0. Thanks @scala-steward! (#208)
• Update fs2 to 2.0.0. Thanks @scala-steward! (#209)
• Update kafka-avro-serializer to 5.3.1. Thanks @scala-steward! (#210)
• Update vulcan to 0.2.0. Thanks @scala-steward! (#207)

Documentation

• Add documentation for the KafkaAdminClient. Thanks @BenFradet! (#201)

Miscellaneous

• Update sbt to 1.3.0. Thanks @scala-steward! (#199)
• Update sbt-sonatype to 3.6. Thanks @scala-steward! (#204)
• Update scalatestplus-scalacheck to 3.1.0.0-RC2. Thanks @scala-steward! (#206)

Released on 2019-09-11.

fs2-kafka v0.20.0-RC1

Changes

• Add alterConfigs to KafkaAdminClient. Thanks @joceron! (#158)
• Add assignmentStream to KafkaConsumer. Thanks @danxmoran! (#169)
• Add Auth.Bearer for authentication token support in fs2-kafka-vulcan. (#176)
• Add createPartitions to KafkaAdminClient. Thanks @BenFradet! (#191)
• Add deleteTopic and deleteTopics to KafkaAdminClient. Thanks @BenFradet! (#192)
• Add Serializer.Record and Deserializer.Record for key/value-specific serializers. (#177)
• Add withGroupInstanceId to ConsumerSettings. (#178)
• Change to convert to Chunk in CommittableProducerRecords, ProducerRecords, and ProducerResult. Thanks @danxmoran! (#174, #187)
• Change to prioritize polls over other requests. (#180)
• Change to use TransactionalProducerSettings for TransactionalKafkaProducer. Thanks @danxmoran! (#186)
• Fix incorrect poll assertion potentially causing IllegalStateExceptions. Thanks @Fristi! (#194)
• Move isKey from AvroSettings to Serializer.Record and Deserializer.Record. (#177)

Updates

• Update cats to 2.0.0-RC2. (#195)
• Update cats-effect to 2.0.0-RC2. (#195)
• Update kafka-avro-serializer to 5.3.0. Thanks @scala-steward! (#163)
• Update vulcan to 0.2.0-RC2. Thanks @scala-steward! (#188)

Documentation

• Add documentation on how to share a schema registry client instance. (#179)
• Add more documentation on KafkaProducer#produce. Thanks @SystemFw! (#193)
• Add note on Confluent resolver. Thanks @mosman128 and @justinhj! (#159, #161)

Miscellaneous

• Update better-monadic-for to 0.3.1. Thanks @scala-steward! (#162)
• Update sbt-mdoc to 1.3.2. Thanks @scala-steward! (#185)
• Update sbt-mima-plugin to 0.6.0. Thanks @scala-steward! (#184)
• Update sbt-scalafmt to 2.0.4. Thanks @scala-steward! (#189)
• Update scalafmt to 2.0.1. Thanks @scala-steward! (#181)

Released on 2019-08-30.

fs2-kafka v0.20.0-M2

Changes

• Add fs2-kafka-vulcan for integration with vulcan. (#156)

Released on 2019-07-12.