Version 3.1.0

Changes

• Fix Acl auth in Spark 3, Updating jedis @fe2s (#345)
• Update badge in README.md with the latest version @fe2s (#327)

Full Changelog: v3.0.0...v3.1.0

Version 2.7.0

What's Changed

• Fix python docs (2.4) by @fe2s in #184
• issue #250: fixed streaming doc page (added ssc.start()) by @fe2s in #251
• issue-257 : mostly typo / manually tested in python by @tgrall in #259
• Issue 265: Remove filterKeysByType step when getting data from redis by @mayankasthana in #266
• Issue 49: added toRedisHASHes function (#49) by @phyok in #269
• fix arg exception msg in redis source relation by @bsipin20 in #273
• issue #328: add user/password authentication (Redis 6 ACL feature) by @fe2s in #333

New Contributors

• @tgrall made their first contribution in #259
• @mayankasthana made their first contribution in #266
• @phyok made their first contribution in #269
• @bsipin20 made their first contribution in #273

Full Changelog: v2.6.0...v2.7.0

Version 3.0.0🌈

Changes

• Allow to override Redis options for spark.readStream @alexott (#286)
• #304: added toRedisByteHASHes function @fe2s (#306)
• CI maven fix @chayim (#315)
• release drafter and new release workflows @chayim (#310)
• Update code to use Spark 3.0 & Scala 2.12 @alexott (#282)

2.6.0

• Added new API: toRedisHASHes function
• Performance optimization (removed filterKeysByType step when getting data from Redis)
• Minor fixes of documentation and exception messages

2.5.0

• Add ssl params to all invocations of RedisEndpoint ctor. (#235)

2.4.2

• #195: support scala 2.12 (#223)
• #217: added toRedisLISTs() function (#221)

2.4.1

• Dataframe created from a specific key (not a pattern) and specified key doesn't exist in Redis (#194)
• A prototype of toRedisByteLIST() function (#205)

2.4.0

Version upgrades:

• Support for Spark 2.4.0
• Upgrade jedis to 3.1.0-m1

Backward incompatible changes:

• Issue #165 - RDD and Streaming implicit were split to two different packages to avoid extra spark-streaming dependency when only RDD functions are used. Streaming functions are now enabled through "import com.redislabs.provider.redis.streaming._"

Fixes:

• Issue #134 - Fixes an issue when SBT cannot resolve jedis dependency ()

Enhancements:

• Enables Structured Streaming output to Redis using foreachBatch, docs updated
• Added dev environment docs

Upgrading notice from 2.3.1 to 2.4.0:

• If Spark Streaming functionality (createRedisXStream, createRedisStream or createRedisStreamWithoutListname) is used, add additional import statement "import com.redislabs.provider.redis.streaming._" to prevent compilation errors

2.3.1

• Add support for DataFrames
• Add support for Structured Streaming

2.3.1-RC1

• Add support for Structured stream