fs2-kafka v0.19.9

Changes

• Change to handle commits during rebalancing. Thanks @CremboC! (#117)

Released on 2019-04-03.

fs2-kafka v0.19.8

Additions

• Add initial debug logging using SLF4J. Thanks @backuitist! (#108, #113)

Changes

• Change to only pause/resume partitions when necessary. (#112)
• Change to only start polling after streaming has started. Thanks @Krever! (#110, #114)
• Change to revoke previous duplicate fetch and issue warning log. Thanks @backuitist! (#107)
• Fix race condition which could cause duplicate records. (#111)

Released on 2019-04-02.

fs2-kafka v0.19.7

Changes

• Fix to include state changes during poll when handling records. (#109)

Released on 2019-03-29.

fs2-kafka v0.19.6

Changes

• Fix a race condition which could result in duplicate records. Thanks @backuitist! (#105, #106)

Released on 2019-03-28.

fs2-kafka v0.19.5

Changes

• Fix Acks#toString and AutoOffsetReset#toString. (#103)

Updates

• Update fs2 to 1.0.4. (#99)
• Update Kafka to 2.2.0. Thanks @CremboC! (#104)

Miscellaneous

• There is now a Gitter room for the library.

Released on 2019-03-27.

fs2-kafka v0.19.4

Additions

• Add improved support for unkeyed records. Thanks @ranjanibrickx! (#96, #97)
  • Add Deserializer#option, and Deserializer.option and unit.
  • Add HeaderDeserializer#option, and HeaderDeserializer.option and unit.
  • Add Serializer#option, and Serializer.option, asNull, empty and unit.
  • Add HeaderSerializer#option, and HeaderSerializer.option, asNull, empty and unit.

Released on 2019-03-01.

fs2-kafka v0.19.3

Additions

• Add functions for working with consumer offsets. Thanks @backuitist! (#92, #93)
  • Add KafkaConsumer#assignment.
  • Add KafkaConsumer#position.
  • Add KafkaConsumer#seekToBeginning.
  • Add KafkaConsumer#seekToEnd.
• Add Attempt[A] aliases for deserializers. (#95)
  • Add Deserializer.Attempt[A] = Deserializer[Either[Throwable, A]].
  • Add HeaderDeserializer.Attempt[A] = HeaderDeserializer[Either[Throwable, A]].

Released on 2019-02-27.

fs2-kafka v0.19.2

Additions

• Add describeCluster and createTopics to KafkaAdminClient. Thanks @danxmoran! (#88)
• Add maxPrefetchBatches to ConsumerSettings. (#83)
  • Controls prefetching behaviour before backpressure kicks in.
  • Use withMaxPrefetchBatches to change the default setting.
• Add several constructs for working with record headers. (#85)
  • Add HeaderDeserializer for deserialization of record header values.
  • Add HeaderSerializer for serializing values to use as header values.
  • Add Header.serialize for serializing a value and creating a Header.
  • Add Header#headers for creating a Headers with a single Header.
  • Add Header#as and attemptAs for deserializing header values.
  • Add Headers#withKey and alias apply for extracting a single Header.
  • Add Headers#concat for concatenating another Headers instance.
  • Add Headers#asJava for converting to Java Kafka-compatible headers.
  • Add Headers.fromIterable to create Headers from Iterable[Header].
  • Add Headers.fromSeq to create Headers from Seq[Header].
• Add several constructs for working with record serialization. (#85)
  • Add a custom Serializer to make it easier to create and compose serializers.
  • Add a custom Deserializer to make it easier to create and compose deserializers.
  • Add ProducerSettings.apply for using implicit Serializers for the key and value.
  • Add ConsumerSettings.apply for using implicit Deserializers for the key and value.

Changes

• Change to make fs2.kafka.Id public. Thanks @chenharryhua! (#86, #87)

Updates

• Update Kafka to 2.1.1. Thanks @sebastianvoss! (#90, #91)

Documentation

• Add a technical details section explaining backpressure. Thanks @backuitist! (#82, #84)

Released on 2019-02-22.

fs2-kafka v0.19.1

Additions

• Add CommittableOffsetBatch#fromFoldableMap. (#80)

Updates

• Update fs2 to 1.0.3. (#81)

Released on 2019-01-29.

fs2-kafka v0.19.0

Changes

• Add KafkaProducer#producePassthrough for only keeping the passthrough after producing. (#74)
• Change KafkaConsumer#stream to be an alias for partitionedStream.parJoinUnbounded. (#78)
  • This also removes ConsumerSettings#fetchTimeout as it is now unused.
• Change to improve type inference of ProducerMessage. (#74, #76)
  • To support better type inference, a custom fs2.kafka.ProducerRecord has been added.
  • If you were using the Java ProducerRecord, change to fs2.kafka.ProducerRecord.
• Change to replace Sinks with Pipes, and usage of Stream#to with Stream#through. (#73)
• Remove ProducerMessage#single, multiple, and passthrough. (#74)
  • They have been replaced with ProducerMessage#apply and ProducerMessage#one.
  • If you were previously using single in isolation, then you can now use one.
  • For all other cases, you can now use ProducerMessage#apply instead.
• Rename KafkaProducer#produceBatched to produce. (#74)
• Remove the previous KafkaProducer#produce.
  • For previous behavior, flatten the result from produce. (#74)

Miscellaneous

• Change to include current year in license notices. (#72)

Released on 2019-01-18.