Releases: spotify/scio
Release v0.11.6
🚀 Enhancements
- Add scio-elasticsearch8 module (#4311) @RustedBones
- Mock BQ wildcard table (#4314) @RustedBones
- Include which user is authenticated in BQ 403 exceptions (#4191) @clairemcginty
- Move PopulateTestData script to GHA (#4294) @clairemcginty
🐛 Bug Fixes
- (fix #4216) extend BQ CoderInstances in main package (#4328) @clairemcginty
- Support build metadata to identify proper previous version (#4332) @RustedBones
- Fix GHA publish due to non-deterministic implicit (#4323) @RustedBones
- Fix projection for parquet.tensorflow JobTest + add example job (#4305) @clairemcginty
- (fix #4285) Set expiration time explicitly for temp BQ view tables (#4292) @clairemcginty
📗 Documentation
- Prepare documentation for release v0.11.6 (#4346) @RustedBones
- Add spotify OSS maintainer metadata (#4326) @kellen
🌱 Dependency Updates
- Update beam to 2.38.0 (#4318) @scala-steward
- Pin caffeine dependency (#4344) @regadas
- Ignore beam dependent version updates (#4345) @RustedBones
- Update pprint to 0.7.3 (#4298) @scala-steward
- Update cassandra-driver-core to 3.11.2 (#4342) @scala-steward
- Update scalatestplus scalacheck artifact (#4343) @RustedBones
- Update elasticsearch, ... to 7.17.3 (#4337) @scala-steward
- Update mysql-connector-java to 8.0.29 (#4329) @scala-steward
- Bump JamesIves/github-pages-deploy-action from 4.3.2 to 4.3.3 (#4331) @dependabot
- Update scalatest to 3.2.12 (#4325) @scala-steward
- Update tensorflow-core-api, ... to 0.4.1 (#4301) @scala-steward
- Update scalacheck to 1.16.0 (#4309) @scala-steward
- Update scalafmt-core to 3.5.2 (#4317) @scala-steward
- Update sbt-header to 5.7.0 (#4319) @scala-steward
- Update sbt-bloop to 1.5.0 (#4321) @scala-steward
- Update zoltar-api, zoltar-core, ... to 0.6.0 (#4320) @scala-steward
- Update magnolify-avro, magnolify-bigtable, ... to 0.4.8 (#4316) @scala-steward
- Update sbt-scalafix to 0.10.0 (#4308) @scala-steward
- Update sparkey to 3.2.2 (#4312) @scala-steward
- Bump actions/setup-java from 2 to 3 (#4310) @dependabot
- Update sbt-mima-plugin to 1.1.0 (#4307) @scala-steward
- Update jackson-module-scala to 2.13.2 (#4283) @scala-steward
- Bump actions/checkout from 2.4.0 to 3 (#4275) @dependabot
- Update jna to 5.11.0 (#4296) @scala-steward
- Update mysql-socket-factory to 1.5.0 (#4304) @scala-steward
- Update shapeless to 2.3.9 (#4297) @scala-steward
- Update sbt-api-mappings to 3.0.2 (#4290) @scala-steward
- Update sbt-mdoc to 2.3.2 (#4299) @scala-steward
- Update joda-time to 2.10.14 (#4291) @scala-steward
- Update scala-collection-compat to 2.7.0 (#4293) @scala-steward
Contributors to this release
@RustedBones, @clairemcginty, @dependabot, @dependabot[bot], @kellen, @regadas, @scala-steward and @stormy-ua
0.11.5
PLEASE READ: Beam 2.36.0 & Beam 2.37.0 contain a regression affecting Cogroup operations with key groups >10,000 elements on Dataflow V1 Runner. We recommend downgrading to Scio 0.11.4 to mitigate this until Beam 2.38.0 is released.
🚀 Enhancements
- Add parameter to skip cloning in typedParquetFile (#4215) @lofifnc
- Add support for mocking PTransform in tests (#4210) @kellen
- Add missing inEarlyPane assertion (#4229) @mkuthan
- Adding a warning message to groupBy (#4250) @davidvspot
- Add BigQuery jobs to pre-release check in GHA (#4263) @clairemcginty
- Update BigtableExample to waitUntilDone (#4246) @csteegz
🔧 Breaking changes
- Apache Beam 2.36.0 contains a
jedis
major version upgrade from 3.x to 4.x. Thus, the signatures of someRedisDoFn
APIs have changed. See this PR for more details.
📗 Documentation
- Update HyperLogLog.md (#4240) @mkurek
- Fix site and update Beam matrix (#4278) @clairemcginty
🌱 Dependency Updates
- Upgrade to beam 2.36.0 (#4243) @clairemcginty
- Update Magnolify to 0.4.7 (#4276) @clairemcginty
- Update parquet-avro, parquet-tensorflow to 0.4.3 (#4225) @scala-steward
- update Cats to 2.7.0 (#4270) @clairemcginty
- Update sbt-mdoc to 2.3.1 (#4265) @scala-steward
- Update mysql-socket-factory to 1.4.4 (#4274) @scala-steward
- Update sbt-bloop to 1.4.13 (#4258) @scala-steward
- Update elasticsearch-rest-client, ... to 7.17.1 (#4267) @scala-steward
- Bump JamesIves/github-pages-deploy-action from 4.2.3 to 4.2.5 (#4256) @dependabot
- Update sbt-buildinfo to 0.11.0 (#4257) @scala-steward
- Update slf4j-api, slf4j-nop, slf4j-simple to 1.7.36 (#4244) @scala-steward
- Update sbt-header to 5.6.5 (#4241) @scala-steward
- Update cassandra-all to 3.11.12 (#4249) @scala-steward
- Update shapeless to 2.3.8 (#4252) @scala-steward
- Update scalafmt-core to 3.3.3 (#4219) @scala-steward
- Update scalactic to 3.2.11 (#4220) @scala-steward
- Update scalatest to 3.2.11 (#4221) @scala-steward
- Update sbt to 1.6.2 (#4231) @scala-steward
Release v0.11.4
NOTE This is a bug fix release for 0.11.3. We removed the compile-scalacheck dependency from scio-test (#4208). That feature will be moved to Ratatool in a subsequent release.
🌱 Dependency Updates
- update socco-ng to 0.1.7 (#4213) @clairemcginty
- Update mysql-connector-java to 8.0.28 (#4211) @scala-steward
- update tests.yml to use scala 2.13.8 (#4209) @clairemcginty
- Update sbt-bloop to 1.4.12 (#4194) @scala-steward
Release v0.11.3
NOTE Please skip to v0.11.4, it contains a bug fix from this release. Thanks!
🚀 Enhancements
- Un-deprecate AvroConverters by @kellen in #4185
- Add helper methods for org.scalacheck.Gen to PipelineSpec by @kellen in #4157
- Add support for Redis ZADD command for RedisIO Write by @anish749 in #4169
- Add methods for sortMergeTransform to read additional sources by @bkalra23 in #4091
- use google-github-actions/auth in GHA by @clairemcginty in #4176
🐛 Bug Fixes
- Fix build regex handling by @kellen in #4173
- Fix sortMergeTransform return type by @regadas in #4179
- Fix parquet avro generic records read by @stormy-ua in #4195
📗 Documentation
- update SMB Tuning page on github site by @clairemcginty in #4170
- Update Beam version matrix + include info on Beam dependencies by @clairemcginty in #4192
- add Beam info for 0.11.3 release by @clairemcginty in #4204
- add a note about parquet issue in 0.11.2 by @stormy-ua in #4205
🌱 Dependency Updates
- upgrade to Beam 2.35.0 by @clairemcginty in #4168
- Switch from adopt jvm to temurin by @regadas in #4150
- Update socco-ng to v0.1.6 by @regadas in #4156
- Update sbt to 1.6.1 by @scala-steward in #4163
- Update sbt-scalafmt to 2.4.6 by @scala-steward in #4160
- Update scalafmt-core to 3.2.2 by @scala-steward in #4159
- Update junit-interface to 0.13.3 by @scala-steward in #4164
- Update scalafmt-core to 3.3.1 by @scala-steward in #4167
- Update protobuf-java to 3.18.2 by @scala-steward in #4172
- Update mysql-socket-factory to 1.4.2 by @scala-steward in #4174
- Use scala213source3 salafmt dialect by @regadas in #4181
- bump gcs-connector to 2.2.4 by @clairemcginty in #4183
- Update Flink runner to 1.13 by @regadas in #4180
- Update sbt-scalafix to 0.9.34 by @scala-steward in #4189
- Update sbt-scoverage to 1.9.3 by @scala-steward in #4188
- Bump JamesIves/github-pages-deploy-action from 4.2.1 to 4.2.2 by @dependabot in #4187
- Update transport to 6.8.23 by @scala-steward in #4199
- update grpc to 1.41.1 by @clairemcginty in #4202
- Update elasticsearch-rest-client, ... to 7.16.3 by @scala-steward in #4198
- Update slf4j-api, slf4j-nop, slf4j-simple to 1.7.33 by @scala-steward in #4201
- Update scala-compiler, scala-library, ... to 2.13.8 by @scala-steward in #4200
Full Changelog: v0.11.2...v0.11.3
Release v0.11.2
"Batavia"
🚀 Enhancements
- Deduplicate async lookup requests (#4100) @kellen
- update GcsConnectorUtil to remove deprecated auth & search for ADC (#4099) @clairemcginty
- Set value coder for HadoopIO in ParquetTypeIO (#4108) @lofifnc
- add unit test for Avro Source+PTransform serialization (#4052) @clairemcginty
- Add support for using the Elasticsearch credentials in IndexAdmin (#4067) @jordiolivares
- Whitelist ~/.m2 ~/.ivy2 and ~/.cache/coursier, fixes #4016 (#4090) @kellen
🐛 Bug Fixes
- Fix SMBTransform callsite name for Dataflow graph (#4127) @clairemcginty
- (fix #4082) numBuckets should be a required SMB param (#4093) @clairemcginty
📗 Documentation
- Clarify ParquetExample inputs and outputs (#4128) @clairemcginty
- Parquet schema evolution doc: no need to append new fields to the end of a record. (#4096) @stormy-ua
- Add link to hub install documentation (#4060) @kellen
- Remove
scio_sql
since it get dropped in latest release (#4086) @izhangzhihao
🌱 Dependency Updates
- Update sbt to 1.5.6 (#4129) @scala-steward
- upgrade google-cloud libraries according to BOM (#4124) @clairemcginty
- update to elasticsearch 7.16.0 (#4125) @clairemcginty
- Update mysql-socket-factory to 1.4.1 (#4121) @scala-steward
- Bump magnolify to 0.4.5 (#4119) @stormy-ua
- Update caffeine to 2.9.3 (#4111) @scala-steward
- Update scalafmt-core to 3.2.1 (#4112) @scala-steward
- Update sbt-scalafmt to 2.4.5 (#4114) @scala-steward
- Upgrade Beam to 2.34 (#4104) @jto
- Update algebra to 2.7.0 (#4106) @scala-steward
- Update scala-collection-compat to 2.6.0 (#4081) @scala-steward
- Update sbt-avro to 3.4.0 (#4092) @scala-steward
- Bump actions/checkout from 2.3.5 to 2.4.0 (#4076) @dependabot
- Update elasticsearch, ... to 7.15.2 (#4083) @scala-steward
- Update algebird-core, algebird-test to 0.13.9 (#4079) @scala-steward
- Update jna to 5.10.0 (#4080) @scala-steward
- Bump JamesIves/github-pages-deploy-action from 4.1.5 to 4.1.7 (#4107) @dependabot
- Update sbt-scalafix to 0.9.33 (#4105) @scala-steward
- Update auto-service to 1.0.1 (#4078) @scala-steward
- Update mysql-socket-factory to 1.4.0 (#4077) @scala-steward
- Revert "Update zoltar-api, zoltar-core, ... to 0.6.0-M4" (#4103) @regadas
- Update scalafmt-core to 3.0.8 (#4072) @scala-steward
- Update sbt-scoverage to 1.9.2 (#4074) @scala-steward
- Update sbt-java-formatter to 0.7.0 (#4095) @scala-steward
- Update sbt-scalafmt to 2.4.4 (#4097) @scala-steward
- Update sbt-bloop to 1.4.11 (#4075) @scala-steward
- Update scalactic to 3.2.10 (#4007) @scala-steward
- Update sbt-bloop to 1.4.10 (#4059) @scala-steward
- Update zoltar-api, zoltar-core, ... to 0.6.0-M4 (#4068) @scala-steward
- Update joda-time to 2.10.13 (#4064) @scala-steward
- Update sbt-scalafix to 0.9.32 (#4089) @scala-steward
- Bump dep versions for M1 Apple silicon (#4051) @troyd-spotify-com
- Update sbt-mdoc to 2.2.24 (#4056) @scala-steward
- Update scalafmt-core to 3.0.7 (#4057) @scala-steward
- Update sbt-unidoc to 0.5.0 (#4062) @scala-steward
- Update junit-interface to 0.13.2 (#4063) @scala-steward
Contributors to this release
@clairemcginty, @dependabot, @dependabot[bot], @izhangzhihao, @jordiolivares, @jto, @kellen, @lofifnc, @regadas, @scala-steward, @stormy-ua and @troyd-spotify-com
Release v0.11.1
"Armorica"
🚀 Enhancements
- upgrade beam to 2.33.0 (#4041) @clairemcginty
🐛 Bug Fixes
- (fix #4054) synchronize lazy initializing in ParquetBucketMetadata (#4055) @clairemcginty
- (fix #4034) support setting tempDirectory in file writes (#4035) @clairemcginty
- Fix contains in any order matcher (#3992) @jwiklund
- Set max heap size for the docs generating workflow (#3986) @stormy-ua
- Do not unwrap a wrapped Beam coder to avoid NPE (#4006) @stormy-ua
📗 Documentation
🪦 Deprecations
- n/a
🌱 Dependency Updates
- Update sbt-scoverage to 1.9.1 (#4039) @scala-steward
- Update protobuf-java to 3.18.1 (#4029) @scala-steward
- Update scala-compiler, scala-library, ... to 2.12.15 (#3998) @scala-steward
- Update elasticsearch, ... to 7.14.2 (#4012) @scala-steward
- Update elasticsearch, ... to 6.8.19 (#4011) @scala-steward
- Update scalafmt-core to 3.0.6 (#4027) @scala-steward
- Update breeze to 2.0 (#4028) @scala-steward
- Update mysql-socket-factory to 1.3.4 (#4031) @scala-steward
- Update sbt-mima-plugin to 1.0.1 (#4032) @scala-steward
- Update sbt-protobuf to 0.7.1 (#4025) @scala-steward
- Update sbt-avro to 3.3.0 (#4000) @scala-steward
- Update protobuf-java to 3.18.0 (#4001) @scala-steward
- Update kantan.csv to 0.6.2 (#4022) @scala-steward
- Update joda-time to 2.10.12 (#4021) @scala-steward
- Update scalafmt-core to 3.0.5 (#4020) @scala-steward
- Update sbt-ci-release to 1.5.9 (#4017) @scala-steward
- Update scalatest to 3.2.10 (#4009) @scala-steward
- Update sbt-scoverage to 1.9.0 (#4003) @scala-steward
- Update sbt-scalafix to 0.9.31 (#4004) @scala-steward
- Update transport to 6.8.19 (#4014) @scala-steward
- Update sbt-ci-release to 1.5.10 (#4042) @scala-steward
- Bump actions/checkout from 2.3.4 to 2.3.5 (#4048) @dependabot
- Update mysql-connector-java to 8.0.27 (#4050) @scala-steward
- Update parquet-avro, parquet-column, ... to 1.12.2 (#4033) @scala-steward
- Update scalafmt-core to 3.0.3 (#3995) @scala-steward
- Update sbt-bloop to 1.4.9 (#3997) @scala-steward
- Update mysql-socket-factory to 1.3.3 (#3991) @scala-steward
- Update scalafmt-core to 3.0.2 (#3987) @scala-steward
- Update elasticsearch, ... to 6.8.20 (#4043) @scala-steward
- Update elasticsearch-rest-client, ... to 7.15.1 (#4046) @scala-steward
Contributors to this release
@clairemcginty, @dependabot, @dependabot[bot], @jwiklund, @kellen, @scala-steward and @stormy-ua
Release v0.11.0
"Ariana"
🚀 Enhancements
- Side inputs for SMB transforms (#3915) @kellen
- (fix #3944) ToTable implements selectedFields (#3956) @clairemcginty
- Add outputParallelization for JdbcReadOptions (#3941) @LeReunionais
- (fix #3913) parquet-avro TestIO includes map function (#3924) @clairemcginty
- make SMB rename more fault-tolerant, fix #3766 (#3949) @nevillelyh
- Shade updated AvroCoder until Beam 2.33.0 is released (#3957) @clairemcginty
- Remove printstacktrace in Coders (#3982) @jto
- Add a script and methods for smb cogroup with additional sources (#3904) @bkalra23
- Replace setup-scala action and tweak .jvmopts (#3925) @regadas
🐛 Bug Fixes
- Rename Sparkey hash* methods to avoid shadowing regular methods (#3894) @devictr
- Rollback covary* resetting coder logic (#3969) @stormy-ua
- Ensure MutableScalableBloomFilter initialCapacity > 0 (#3961) @kellen
- Defer ResourceId materialization in SMB to get around Flink FileSystems init issue (#3954) @stormy-ua
- (fix #3912) fix unionAll withName issue (#3931) @clairemcginty
- Get rid of an Iterable re-iteration twice in the asMapSingletonSideInput (#3926) @stormy-ua
- Fix Elasticsearch authentication (#3888) @mrkm4ntr
- update zone in BigtableIT (#3984) @clairemcginty
- explicitly set coders.tableRowCoder in BQ write (#3942) @clairemcginty
📗 Documentation
- Update the REPL documentation to use vals in place of defs. (#3891) @jmcconnell
- Adds a Parquet example (#3903) @live-wire
- 0.11.0 release docs update (#3985) @stormy-ua
- Add SMB String decoding doc to Site (#3980) @clairemcginty
- Release v0.10.4 docs updates (#3886) @live-wire
🪦 Deprecations
- Disable mdoc for scio-sql code blocks in the documentation (#3983) @stormy-ua
- Deprecate pacakage com.spotify.scio.extra.bigquery #3494 (#3974) @stormy-ua
- Deprecate and remove scio-sql #3695 (#3973) @stormy-ua
🌱 Dependency Updates
- Bump TensorFlow to 0.3.2 plus related dependencies (#3971) @nevillelyh
- Update elasticsearch to 7.14.0 (#3976) @regadas
- Bump beam deps to 2.32.0 + bigdataoss to 2.2.2 (#3967) @stormy-ua
- Remove support for the case-app typed arguments parsing #3772 (#3970) @stormy-ua
- Update magnolify-avro, magnolify-bigtable, ... to 0.4.4 (#3962) @scala-steward
- Update jackson-module-scala to 2.12.5 (#3965) @scala-steward
- Update jna to 5.9.0 (#3951) @scala-steward
- Update tensorflow-core-platform to 0.3.3 (#3975) @scala-steward
- Update elasticsearch, ... to 7.14.1 (#3977) @scala-steward
- update scalafix to 0.9.30 (#3946) @nevillelyh
- Update scalafmt-core to 3.0.1 (#3968) @scala-steward
- Bump JamesIves/github-pages-deploy-action from 4.1.4 to 4.1.5 (#3964) @dependabot
- Update sbt-mdoc to 2.2.23 (#3966) @scala-steward
- Update sbt-java-formatter to 0.6.1 (#3958) @scala-steward
- Update sbt-mima-plugin to 1.0.0 (#3955) @scala-steward
- Update scalafmt to 3.0.0 (#3953) @nevillelyh
- Update breeze to 1.3 (#3943) @scala-steward
- Update case-app, case-app-annotations, ... to 2.1.0-M6 (#3940) @scala-steward
- Bump shapeless to 2.3.7 plus downstreams (#3869) @nevillelyh
- Update transport to 6.8.18 (#3935) @scala-steward
- Update mysql-socket-factory to 1.3.2 (#3936) @scala-steward
- Update cassandra-all to 3.11.11 (#3929) @scala-steward
- Update elasticsearch-rest-client, ... to 7.13.4 (#3921) @scala-steward
- Update sbt-mdoc to 2.2.22 (#3923) @scala-steward
- Update mysql-connector-java to 8.0.26 (#3918) @scala-steward
- Update commons-io to 2.11.0 (#3914) @scala-steward
- Update sbt to 1.5.5 (#3909) @scala-steward
- Update slf4j-api, slf4j-nop, slf4j-simple to 1.7.32 (#3920) @scala-steward
- Update commons-compress to 1.21 (#3911) @scala-steward
- Update mysql-socket-factory to 1.3.1 (#3916) @scala-steward
- Update auto-value, auto-value-annotations to 1.8.2 (#3917) @scala-steward
- Update elasticsearch, ... to 7.13.3 (#3900) @scala-steward
- Update sbt-scalafmt to 2.4.3 (#3906) @scala-steward
- Update scala-collection-compat to 2.5.0 (#3907) @scala-steward
- Update elasticsearch, ... to 6.8.17 (#3899) @scala-steward
- Update jackson-module-scala to 2.12.4 (#3898) @scala-steward
- Update caffeine to 2.9.2 (#3892) @scala-steward
Contributors to this release
@LeReunionais, @bkalra23, @clairemcginty, @dependabot, @dependabot[bot], @devictr, @jmcconnell, @jto, @kellen, @live-wire, @mrkm4ntr, @nevillelyh, @regadas, @scala-steward and @stormy-ua
Release v0.10.4
"Edessa"
🚀 Enhancements
- Yet another build tweak (#3865) @regadas
- covary etc. should reset coder #3809 (#3868) @stormy-ua
- Remove java8 steps (#3860) @regadas
- deprecate case-app based typed argument parsing, #3772 (#3857) @nevillelyh
🐛 Bug Fixes
- Fix algebirds Moments Coder (#3883) @jto
- Fix memory leak in AsyncDoFns due to race-condition and large bundles (#3882) @jordiolivares
- Fix RedisDoFn ExecutionContext (#3842) @regadas
🌱 Dependency Updates
- Bump Beam to 2.30.0, update transitives (#3880) @nevillelyh
- Update slf4j-api, slf4j-nop, slf4j-simple to 1.7.31 (#3881) @scala-steward
- Update elasticsearch-rest-client, ... to 7.13.2 (#3876) @scala-steward
- Update sbt to 1.5.4 (#3874) @scala-steward
- Update commons-io to 2.10.0 (#3873) @scala-steward
- Update protobuf-java to 3.17.3 (#3870) @scala-steward
- Bump JamesIves/github-pages-deploy-action from 4.1.3 to 4.1.4 (#3867) @dependabot
- Update chill, chill-algebird, chill-java, ... to 0.10.0 (#3866) @scala-steward
- Update sbt to 1.5.3 (#3849) @scala-steward
- Bump sbt-scalafix to 0.9.29 (#3863) @nevillelyh
- Bump scala versions in CI (#3862) @nevillelyh
- Bump scala to 2.13.6 (#3861) @nevillelyh
- Update scala-compiler, scala-library, ... to 2.12.14 (#3843) @scala-steward
- Update socco-ng to v0.1.5 (#3859) @regadas
- Update protobuf-java to 3.17.2 (#3858) @scala-steward
- Update elasticsearch, ... to 7.13.1 (#3854) @scala-steward
- Update elasticsearch-rest-client, ... to 7.13.1 (#3855) @scala-steward
- Bump actions/create-release from 1 to 1.1.4 (#3810) @dependabot
- Bump JamesIves/github-pages-deploy-action from 4.1.1 to 4.1.3 (#3811) @dependabot
- Bump olafurpg/setup-scala from 10 to 12 (#3853) @dependabot
- Update mysql-socket-factory to 1.3.0 (#3852) @scala-steward
- Update sbt-jmh to 0.4.3 (#3850) @scala-steward
- Update sbt-scoverage to 1.8.2 (#3845) @scala-steward
- Update algebra to 2.2.3 (#3846) @scala-steward
- update bump_scio.rb with correct REPL asset path (#3844) @clairemcginty
Contributors to this release
@clairemcginty, @dependabot, @dependabot[bot], @jordiolivares, @jto, @nevillelyh, @regadas, @scala-steward, @stormy-ua and @syodage
Release v0.10.3
"Dallasium"
🚀 Enhancements
- Add support for tearing down the resources automatically if the resource is AutoCloseable (#3828) @jordiolivares
- Document ordering of selectedFields (#3824) @iezer
- add SMB local disk buffer (#3805) @nevillelyh
- Add some SMB read tuning options (#3758) @nevillelyh
- support multiple input directories in JsonSortedBucketIO (#3749) @nevillelyh
- Use the same hash fn in hashPartition and hashPartitionByKey (#3771) @anish749
- Update the deprecated SemanticRuleSuite trait in Scalafix (#3796) @mlachkar
- Increase counters in ElasticsearchWriter that tracks request size (#3762) @mkrajc
- Make beam version mismatch a warning (#3748) @jto
🐛 Bug Fixes
- fix specific record NPE in ParquetAvroSortedBucketIO (#3834) @nevillelyh
- Fix removed dependency (#3820) @kndarp
- Fix #3753, SMB source coder warning (#3791) @nevillelyh
- fix deprecated sbt syntax (#3786) @nevillelyh
- fix sparse transforms split on the wrong side (#3770) @nevillelyh
🌱 Dependency Updates
- Bump Beam to 2.29.0 (#3793) @nevillelyh
- Update algebird-core, algebird-test to 0.13.8 (#3827) @scala-steward
- Update commons-io to 2.9.0 (#3835) @scala-steward
- Update sbt-mima-plugin to 0.9.2 (#3837) @scala-steward
- Update elasticsearch, ... to 7.13.0 (#3831) @scala-steward
- Update elasticsearch, ... to 6.8.16 (#3830) @scala-steward
- Update protobuf-java to 3.17.1 (#3829) @scala-steward
- Update sbt-scoverage to 1.8.1 (#3825) @scala-steward
- Update scalactic to 3.2.9 (#3818) @scala-steward
- Update scalatest to 3.2.9 (#3819) @scala-steward
- Update pprint to 0.6.6 (#3821) @scala-steward
- Update sbt-mdoc to 2.2.21 (#3817) @scala-steward
- Update scala-collection-compat to 2.4.4 (#3816) @scala-steward
- Update sbt-mima-plugin to 0.9.1 (#3815) @scala-steward
- Update sbt-jmh to 0.4.2 (#3814) @scala-steward
- Update protobuf-java to 3.17.0 (#3813) @scala-steward
- Update mysql-connector-java to 8.0.25 (#3806) @scala-steward
- Update sbt-scoverage to 1.8.0 (#3807) @scala-steward
- Update sbt to 1.5.2 (#3804) @scala-steward
- Update protobuf-java to 3.16.0 (#3802) @scala-steward
- Update caseapp to 2.0.6 (#3801) @nevillelyh
- Update sbt-scoverage to 1.7.3 (#3794) @scala-steward
- Update mysql-socket-factory to 1.2.3 (#3795) @scala-steward
- Update scalacheck to 1.15.4 (#3792) @scala-steward
- Update sbt-scoverage to 1.7.2 (#3788) @scala-steward
- Update elasticsearch, ... to 7.12.1 (#3779) @scala-steward
- Update caffeine to 2.9.1 (#3789) @scala-steward
- Update elasticsearch-rest-client, ... to 7.12.1 (#3780) @scala-steward
- Update pprint to 0.6.5 (#3783) @scala-steward
- Update sbt-scoverage to 1.7.0 (#3784) @scala-steward
- Update sbt to 1.5.1 (#3778) @scala-steward
- Update auto-value, auto-value-annotations to 1.8.1 (#3776) @scala-steward
- Update scalactic to 3.2.8 (#3774) @scala-steward
- Update scalatest to 3.2.8 (#3775) @scala-steward
- Update sbt-mdoc to 2.2.20 (#3773) @scala-steward
- Update mysql-connector-java to 8.0.24 (#3768) @scala-steward
- Update case-app, case-app-annotations, ... to 2.0.5 (#3764) @scala-steward
- Update breeze to 1.2 (#3763) @scala-steward
- Update auto-service to 1.0 (#3740) @scala-steward
- Update auto-value, auto-value-annotations to 1.8 (#3741) @scala-steward
- Update shapeless to 2.3.4 (#3751) @scala-steward
- Update protobuf-java to 3.15.8 (#3745) @scala-steward
- Update annoy4s to 0.10.0 (#3746) @scala-steward
Contributors to this release
@anish749, @iezer, @jordiolivares, @jto, @kndarp, @mkrajc, @mlachkar, @nevillelyh, @regadas and @scala-steward
Release v0.10.2
"Cantabrigia"
The release has the fix #3716 for the critical coder performance regression issue leading to an abnormal CPU usage due to a coder logic being evaluated per every element.
🐛 Bug Fixes
- fix coder performance regression in #3716 (#3743) @nevillelyh
🚀 Enhancements
- improve dependency hygiene (#3734) @nevillelyh
📗 Documentation
- Remove internal release steps from the How-to-Release.md (#3738) @stormy-ua
🌱 Dependency Updates
- Update mysql-socket-factory to 1.2.2 (#3742) @scala-steward
- Update protobuf-java to 3.15.7 (#3735) @scala-steward
- Update sbt to 1.5.0 (#3736) @scala-steward
- Update scalatest to 3.2.7 (#3730) @scala-steward
- Update pprint to 0.6.4 (#3731) @scala-steward
- Update sbt-scalafix to 0.9.27 (#3729) @regadas
- Update algebra to 2.2.2 (#3732) @scala-steward
- Bump JamesIves/github-pages-deploy-action from 4.1.0 to 4.1.1 (#3737) @dependabot