0.6.0
Pre-release
Pre-release
What's Changed
- fix: cast timestamp to decimal is unsupported by @wForget in #1281
- chore: Start 0.6.0 development by @andygrove in #1286
- docs: Fix links and provide complete benchmarking scripts by @andygrove in #1284
- feat: Add HasRowIdMapping interface by @viirya in #1288
- minor: update compatibility by @kazuyukitanimura in #1303
- chore: extract conversion_funcs, conditional_funcs, bitwise_funcs and array_funcs expressions to folders based on spark grouping by @rluvaton in #1223
- fix: partially fix consistency issue of hash functions with decimal input by @wForget in #1295
- chore: extract math_funcs expressions to folders based on spark grouping by @rluvaton in #1219
- chore: merge comet-parquet-exec branch into main by @andygrove in #1318
- Feat: Support array_intersect function by @erenavsarogullari in #1271
- build(deps): bump pprof from 0.13.0 to 0.14.0 in /native by @dependabot in #1319
- chore: Fix merge conflicts from merging comet-parquet-exec into main by @andygrove in #1320
- fix: Improve testing for array_remove and fallback to Spark for unsupported types by @andygrove in #1308
- chore: Revert accidental re-introduction of off-heap memory requirement by @andygrove in #1326
- fix: address post merge comet-parquet-exec review comments by @parthchandra in #1327
- chore: Fix merge conflicts from merging comet-parquet-exec into main by @mbutrovich in #1323
- Feat: Support array_join function by @erenavsarogullari in #1290
- Fix missing slash in spark script by @xleoken in #1334
- chore: Refactor QueryPlanSerde to allow logic to be moved to individual classes per expression by @andygrove in #1331
- build: re-enable upload-test-reports for macos-13 runner by @viirya in #1335
- chore: Upgrade to Arrow 53.4.0 by @andygrove in #1338
- fix: memory pool error type by @kazuyukitanimura in #1346
- Feat: Support arrays_overlap function by @erenavsarogullari in #1312
- fix: Fall back to Spark when hashing decimals with precision > 18 by @andygrove in #1325
- chore: Move all array_* serde to new framework, use correct INCOMPAT config by @andygrove in #1349
- chore: Prepare for DataFusion 45 (bump to DataFusion rev 5592834 + Arrow 54.0.0) by @andygrove in #1332
- fix: expressions doc for ArrayRemove by @kazuyukitanimura in #1356
- minor: commit compatibility doc by @kazuyukitanimura in #1358
- minor: update fuzz dependency by @kazuyukitanimura in #1357
- chore: Remove redundant processing from exprToProtoInternal by @andygrove in #1351
- fix: pass scale to DF round in spark_round by @cht42 in #1341
- feat: Upgrade to DataFusion 45 by @andygrove in #1364
- fix: Mark cast from float/double to decimal as incompatible by @andygrove in #1372
- perf: improve performance of update metrics by @wForget in #1329
- feat: Add fair unified memory pool by @kazuyukitanimura in #1369
- feat: Add unbounded memory pool by @kazuyukitanimura in #1386
- fix: Passthrough condition in StaticInvoke case block by @EmilyMatt in #1392
- chore: Adding an optional
hdfs
crate by @comphead in #1377 - fix: disable checking for uint_8 and uint_16 if complex type readers are enabled by @parthchandra in #1376
- perf: Use DataFusion FilterExec for experimental native scans by @mbutrovich in #1395
- doc: update memory tuning guide by @kazuyukitanimura in #1394
- chore: Refactor aggregate expression serde by @andygrove in #1380
- feat: make random seed configurable in fuzz-testing by @wForget in #1401
- feat: override executor overhead memory only when comet unified memory manager is disabled by @wForget in #1379
New Contributors
- @xleoken made their first contribution in #1334
- @cht42 made their first contribution in #1341
- @EmilyMatt made their first contribution in #1392
Full Changelog: 0.5.0...0.6.0