Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] Trying out arc-slice #2647

Draft
wants to merge 1 commit into
base: develop
Choose a base branch
from
Draft

[WIP] Trying out arc-slice #2647

wants to merge 1 commit into from

Conversation

AdamGS
Copy link
Contributor

@AdamGS AdamGS commented Mar 10, 2025

Ran into this very promising post on reddit, so lets see if it makes any difference for us.

@AdamGS AdamGS added the benchmark Run benchmarks on this branch label Mar 10, 2025
@github-actions github-actions bot removed the benchmark Run benchmarks on this branch label Mar 10, 2025
@codspeed-hq CodSpeed HQ
Copy link

codspeed-hq bot commented Mar 10, 2025

CodSpeed Performance Report

Merging #2647 will degrade performances by 21.68%

Comparing adamg/arc-slice (11c15a6) with develop (a92373a)

Summary

⚡ 22 improvements
❌ 10 regressions
✅ 743 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

Benchmark BASE HEAD Change
⚡ bench_compare_varbin[(100000, 512)] 488.3 µs 443.3 µs +10.15%
⚡ bench_compare_varbin[(100000, 8)] 474.1 µs 428.7 µs +10.57%
⚡ decompress_bitpacking_early_filter[i32, 0.0105] 30.2 µs 27.4 µs +10.34%
⚡ decompress_bitpacking_late_filter[i32, 0.005] 47.5 µs 39 µs +21.88%
⚡ decompress_bitpacking_late_filter[i32, 0.0105] 49.1 µs 40.6 µs +20.97%
⚡ decompress_bitpacking_late_filter[i32, 0.01] 49.7 µs 40.2 µs +23.65%
⚡ decompress_bitpacking_late_filter[i32, 0.02] 51.6 µs 42.5 µs +21.55%
⚡ decompress_bitpacking_late_filter[i32, 0.03] 53.2 µs 44.4 µs +19.78%
⚡ decompress_bitpacking_late_filter[i32, 0.04] 55.5 µs 46.5 µs +19.3%
⚡ decompress_bitpacking_late_filter[i32, 0.05] 56.8 µs 48.1 µs +17.98%
⚡ decompress_bitpacking_late_filter[i64, 0.005] 73 µs 55.4 µs +31.61%
❌ decompress_bitpacking_late_filter[i64, 0.0105] 57.4 µs 73.3 µs -21.68%
⚡ decompress_bitpacking_late_filter[i64, 0.01] 73.7 µs 56.6 µs +30.3%
❌ decompress_bitpacking_late_filter[i64, 0.02] 58.8 µs 74.6 µs -21.18%
❌ decompress_bitpacking_late_filter[i64, 0.03] 61.4 µs 76.9 µs -20.12%
❌ decompress_bitpacking_late_filter[i64, 0.04] 63.6 µs 79 µs -19.52%
❌ decompress_bitpacking_late_filter[i64, 0.05] 66.2 µs 81.5 µs -18.79%
⚡ patched_take_200k_dispersed 5.2 ms 4.3 ms +21.87%
⚡ patched_take_200k_first_chunk_only 4.9 ms 4.4 ms +13.16%
⚡ take_200k_dispersed 4.1 ms 3.2 ms +27.37%
... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

@github-actions GitHub Actions
Copy link
Contributor

Benchmarks: random_access

Table of Results
name PR 5090832 base a92373a ratio (PR/base) unit
random-access/vortex-tokio-local-disk 2333667 4.1817e+06 0.558066 ns
random-access/parquet-tokio-local-disk 243883148 2.35931e+08 1.0337 ns

@github-actions GitHub Actions
Copy link
Contributor

Benchmarks: TPC-H on NVME

Table of Results
name PR 5090832 base a92373a ratio (PR/base) unit
tpch_q01/arrow 40507127 3.95782e+07 1.02347 ns
tpch_q02/arrow 49167936 4.36743e+07 1.12579 ns
tpch_q03/arrow 31321088 2.83931e+07 1.10312 ns
tpch_q04/arrow 21613243 2.00128e+07 1.07997 ns
tpch_q05/arrow 46963724 4.36422e+07 1.07611 ns
tpch_q06/arrow 10563591 8.73955e+06 1.20871 ns
tpch_q07/arrow 74719204 7.12372e+07 1.04888 ns
tpch_q08/arrow 55605471 5.3066e+07 1.04785 ns
tpch_q09/arrow 69819708 6.68088e+07 1.04507 ns
tpch_q10/arrow 43657173 4.14532e+07 1.05317 ns
tpch_q11/arrow 23180342 2.25204e+07 1.02931 ns
tpch_q12/arrow 29711608 2.43067e+07 1.22236 ns
tpch_q13/arrow 15007458 1.35961e+07 1.1038 ns
tpch_q14/arrow 13756596 8.64968e+06 1.59042 ns
tpch_q15/arrow 24940731 2.09599e+07 1.18992 ns
tpch_q16/arrow 21898772 1.93632e+07 1.13095 ns
tpch_q17/arrow 60173877 5.38483e+07 1.11747 ns
tpch_q18/arrow 100941477 9.11726e+07 1.10715 ns
tpch_q19/arrow 28217573 2.28099e+07 1.23708 ns
tpch_q20/arrow 35379561 3.0764e+07 1.15003 ns
tpch_q21/arrow 111300635 1.08023e+08 1.03035 ns
tpch_q22/arrow 14181884 1.21707e+07 1.16524 ns
tpch_q01/parquet 114382690 1.11918e+08 1.02203 ns
tpch_q02/parquet 119138411 1.07818e+08 1.10499 ns
tpch_q03/parquet 106022242 1.01644e+08 1.04307 ns
tpch_q04/parquet 61759687 5.7485e+07 1.07436 ns
tpch_q05/parquet 116826357 1.09498e+08 1.06692 ns
tpch_q06/parquet 26068581 2.58563e+07 1.00821 ns
tpch_q07/parquet 131629055 1.26993e+08 1.03651 ns
tpch_q08/parquet 158779983 1.52874e+08 1.03864 ns
tpch_q09/parquet 208464393 2.01382e+08 1.03517 ns
tpch_q10/parquet 130438223 1.28377e+08 1.01605 ns
tpch_q11/parquet 55273425 5.26212e+07 1.0504 ns
tpch_q12/parquet 91058155 8.87396e+07 1.02613 ns
tpch_q13/parquet 147427573 1.43295e+08 1.02884 ns
tpch_q14/parquet 44072277 4.32767e+07 1.01838 ns
tpch_q15/parquet 70864735 6.19083e+07 1.14467 ns
tpch_q16/parquet 52677779 4.70951e+07 1.11854 ns
tpch_q17/parquet 131839820 1.24144e+08 1.06199 ns
tpch_q18/parquet 191191659 1.82096e+08 1.04995 ns
tpch_q19/parquet 71250106 7.07409e+07 1.0072 ns
tpch_q20/parquet 96298421 9.79163e+07 0.983477 ns
tpch_q21/parquet 181881132 1.75049e+08 1.03903 ns
tpch_q22/parquet 52029413 4.72053e+07 1.10219 ns
tpch_q01/vortex-file-compressed 37437741 3.46813e+07 1.07948 ns
tpch_q02/vortex-file-compressed 62411034 5.48574e+07 1.1377 ns
tpch_q03/vortex-file-compressed 34096990 3.07037e+07 1.11052 ns
tpch_q04/vortex-file-compressed 20365600 1.96121e+07 1.03842 ns
tpch_q05/vortex-file-compressed 48840805 4.42677e+07 1.10331 ns
tpch_q06/vortex-file-compressed 10165717 9.22232e+06 1.1023 ns
tpch_q07/vortex-file-compressed 71671281 6.73396e+07 1.06433 ns
tpch_q08/vortex-file-compressed 56664904 5.36026e+07 1.05713 ns
tpch_q09/vortex-file-compressed 70551574 6.63901e+07 1.06268 ns
tpch_q10/vortex-file-compressed 55802429 5.16008e+07 1.08143 ns
tpch_q11/vortex-file-compressed 27846182 2.61886e+07 1.06329 ns
tpch_q12/vortex-file-compressed 22299841 2.14554e+07 1.03936 ns
tpch_q13/vortex-file-compressed 27967327 2.90655e+07 0.962217 ns
tpch_q14/vortex-file-compressed 14502078 1.25915e+07 1.15174 ns
tpch_q15/vortex-file-compressed 32158898 2.95968e+07 1.08657 ns
tpch_q16/vortex-file-compressed 28841862 2.80276e+07 1.02905 ns
tpch_q17/vortex-file-compressed 57111701 5.46095e+07 1.04582 ns
tpch_q18/vortex-file-compressed 88204064 8.42542e+07 1.04688 ns
tpch_q19/vortex-file-compressed 30429033 2.87445e+07 1.0586 ns
tpch_q20/vortex-file-compressed 41704662 3.76937e+07 1.10641 ns
tpch_q21/vortex-file-compressed 92672556 8.69058e+07 1.06636 ns
tpch_q22/vortex-file-compressed 28999248 2.74406e+07 1.0568 ns

@github-actions GitHub Actions
Copy link
Contributor

Benchmarks: TPC-H on S3

Table of Results
name PR 5090832 base a92373a ratio (PR/base) unit
tpch_q01/parquet 274647658 2.59849e+08 1.05695 ns
tpch_q02/parquet 679192565 6.86296e+08 0.989649 ns
tpch_q03/parquet 421826686 4.15852e+08 1.01437 ns
tpch_q04/parquet 229643640 2.27677e+08 1.00864 ns
tpch_q05/parquet 613839408 5.96009e+08 1.02992 ns
tpch_q06/parquet 175946464 1.7148e+08 1.02605 ns
tpch_q07/parquet 635857178 6.4418e+08 0.98708 ns
tpch_q08/parquet 815720363 9.49681e+08 0.858942 ns
tpch_q09/parquet 762852596 6.89671e+08 1.10611 ns
tpch_q10/parquet 556342823 5.31093e+08 1.04754 ns
tpch_q11/parquet 279692760 2.77761e+08 1.00695 ns
tpch_q12/parquet 283398447 2.9807e+08 0.950778 ns
tpch_q13/parquet 395993433 4.06578e+08 0.973967 ns
tpch_q14/parquet 247607602 2.49628e+08 0.991906 ns
tpch_q15/parquet 481514272 4.6255e+08 1.041 ns
tpch_q16/parquet 254435656 2.73155e+08 0.931469 ns
tpch_q17/parquet 407612738 4.80484e+08 0.848338 ns
tpch_q18/parquet 585402845 5.99952e+08 0.975749 ns
tpch_q19/parquet 293233751 2.87949e+08 1.01835 ns
tpch_q20/parquet 530809674 5.14001e+08 1.0327 ns
tpch_q21/parquet 660464436 6.47303e+08 1.02033 ns
tpch_q22/parquet 279883118 2.783e+08 1.00569 ns
tpch_q01/vortex-file-compressed 152945490 1.53209e+08 0.998281 ns
tpch_q02/vortex-file-compressed 434682451 4.31464e+08 1.00746 ns
tpch_q03/vortex-file-compressed 281990545 2.85813e+08 0.986626 ns
tpch_q04/vortex-file-compressed 198000699 2.05207e+08 0.964882 ns
tpch_q05/vortex-file-compressed 340467374 3.3032e+08 1.03072 ns
tpch_q06/vortex-file-compressed 113964517 1.13324e+08 1.00565 ns
tpch_q07/vortex-file-compressed 409706056 4.01981e+08 1.01922 ns
tpch_q08/vortex-file-compressed 474143351 4.69054e+08 1.01085 ns
tpch_q09/vortex-file-compressed 402013748 3.98986e+08 1.00759 ns
tpch_q10/vortex-file-compressed 417055938 4.12537e+08 1.01095 ns
tpch_q11/vortex-file-compressed 171436780 1.56541e+08 1.09515 ns
tpch_q12/vortex-file-compressed 227360101 2.06704e+08 1.09993 ns
tpch_q13/vortex-file-compressed 192148869 1.93786e+08 0.991551 ns
tpch_q14/vortex-file-compressed 142491950 1.41126e+08 1.00968 ns
tpch_q15/vortex-file-compressed 308236552 3.05028e+08 1.01052 ns
tpch_q16/vortex-file-compressed 187968519 1.78017e+08 1.0559 ns
tpch_q17/vortex-file-compressed 214437505 2.18788e+08 0.980113 ns
tpch_q18/vortex-file-compressed 287122019 2.80379e+08 1.02405 ns
tpch_q19/vortex-file-compressed 201925785 2.06654e+08 0.97712 ns
tpch_q20/vortex-file-compressed 323950791 3.35886e+08 0.964467 ns
tpch_q21/vortex-file-compressed 482546435 5.04548e+08 0.956393 ns
tpch_q22/vortex-file-compressed 148599554 1.52755e+08 0.972797 ns

@github-actions GitHub Actions
Copy link
Contributor

Benchmarks: Clickbench on NVME

Table of Results
name PR 5090832 base a92373a ratio (PR/base) unit
clickbench_q00/parquet 2435726 2.20207e+06 1.10611 ns
clickbench_q01/parquet 32781385 3.01677e+07 1.08664 ns
clickbench_q02/parquet 65557230 6.25158e+07 1.04865 ns
clickbench_q03/parquet 52179770 5.2296e+07 0.997777 ns
clickbench_q04/parquet 319363106 3.13247e+08 1.01952 ns
clickbench_q05/parquet 309390027 2.97665e+08 1.03939 ns
clickbench_q06/parquet 2253199 2.33355e+06 0.965566 ns
clickbench_q07/parquet 32609512 3.11239e+07 1.04773 ns
clickbench_q08/parquet 370106790 3.69893e+08 1.00058 ns
clickbench_q09/parquet 565750117 5.62223e+08 1.00627 ns
clickbench_q10/parquet 118439978 1.15104e+08 1.02898 ns
clickbench_q11/parquet 140455213 1.37836e+08 1.01901 ns
clickbench_q12/parquet 310484528 3.12373e+08 0.993955 ns
clickbench_q13/parquet 483857823 4.69387e+08 1.03083 ns
clickbench_q14/parquet 315637021 3.08151e+08 1.0243 ns
clickbench_q15/parquet 345714339 3.44465e+08 1.00363 ns
clickbench_q16/parquet 765466506 7.3142e+08 1.04655 ns
clickbench_q17/parquet 683685395 6.69546e+08 1.02112 ns
clickbench_q18/parquet 1502004176 1.46869e+09 1.02268 ns
clickbench_q19/parquet 41290369 4.15134e+07 0.994627 ns
clickbench_q20/parquet 578366195 5.5106e+08 1.04955 ns
clickbench_q21/parquet 631922027 6.25797e+08 1.00979 ns
clickbench_q22/parquet 946077648 9.43917e+08 1.00229 ns
clickbench_q23/parquet 3777381968 3.79671e+09 0.99491 ns
clickbench_q24/parquet 194982333 1.91908e+08 1.01602 ns
clickbench_q25/parquet 170910682 1.71918e+08 0.994141 ns
clickbench_q26/parquet 221362611 2.16865e+08 1.02074 ns
clickbench_q27/parquet 755086438 7.32038e+08 1.03149 ns
clickbench_q28/parquet 4391986923 4.27046e+09 1.02846 ns
clickbench_q29/parquet 233889448 2.38806e+08 0.97941 ns
clickbench_q30/parquet 323982081 3.12062e+08 1.0382 ns
clickbench_q31/parquet 378414291 3.60735e+08 1.04901 ns
clickbench_q32/parquet 1837367840 1.80952e+09 1.01539 ns
clickbench_q33/parquet 1494309318 1.45403e+09 1.0277 ns
clickbench_q34/parquet 1480316954 1.43469e+09 1.03181 ns
clickbench_q35/parquet 495599999 4.9412e+08 1.00299 ns
clickbench_q36/parquet 143545112 1.41932e+08 1.01137 ns
clickbench_q37/parquet 69365779 6.64329e+07 1.04415 ns
clickbench_q38/parquet 95186005 9.19413e+07 1.03529 ns
clickbench_q39/parquet 281649439 2.75919e+08 1.02077 ns
clickbench_q40/parquet 45177737 4.40471e+07 1.02567 ns
clickbench_q41/parquet 41301265 4.05505e+07 1.01851 ns
clickbench_q42/parquet 50635466 5.13032e+07 0.986984 ns
clickbench_q00/vortex-file-compressed 4105905 4.70676e+06 0.872342 ns
clickbench_q01/vortex-file-compressed 20702597 1.74952e+07 1.18333 ns
clickbench_q02/vortex-file-compressed 32174183 3.02738e+07 1.06277 ns
clickbench_q03/vortex-file-compressed 39481125 4.22102e+07 0.935346 ns
clickbench_q04/vortex-file-compressed 328574984 2.936e+08 1.11912 ns
clickbench_q05/vortex-file-compressed 319675104 3.12473e+08 1.02305 ns
clickbench_q06/vortex-file-compressed 4803141 4.60251e+06 1.04359 ns
clickbench_q07/vortex-file-compressed 21111025 2.13054e+07 0.990879 ns
clickbench_q08/vortex-file-compressed 382762686 3.75262e+08 1.01999 ns
clickbench_q09/vortex-file-compressed 497882214 4.64971e+08 1.07078 ns
clickbench_q10/vortex-file-compressed 66864553 6.34008e+07 1.05463 ns
clickbench_q11/vortex-file-compressed 72090969 7.06395e+07 1.02055 ns
clickbench_q12/vortex-file-compressed 248124342 2.37791e+08 1.04345 ns
clickbench_q13/vortex-file-compressed 359664936 3.52203e+08 1.02119 ns
clickbench_q14/vortex-file-compressed 247329039 2.35822e+08 1.0488 ns
clickbench_q15/vortex-file-compressed 397767501 3.58752e+08 1.10875 ns
clickbench_q16/vortex-file-compressed 764057520 7.56788e+08 1.00961 ns
clickbench_q17/vortex-file-compressed 756208089 7.37703e+08 1.02508 ns
clickbench_q18/vortex-file-compressed 1286553465 1.26631e+09 1.01598 ns
clickbench_q19/vortex-file-compressed 29921340 2.84884e+07 1.0503 ns
clickbench_q20/vortex-file-compressed 460469450 4.45755e+08 1.03301 ns
clickbench_q21/vortex-file-compressed 487819695 4.40446e+08 1.10756 ns
clickbench_q22/vortex-file-compressed 621372424 5.86584e+08 1.05931 ns
clickbench_q23/vortex-file-compressed 1324006799 1.16778e+09 1.13378 ns
clickbench_q24/vortex-file-compressed 85772067 8.02329e+07 1.06904 ns
clickbench_q25/vortex-file-compressed 91233258 9.2661e+07 0.984592 ns
clickbench_q26/vortex-file-compressed 114291415 1.18038e+08 0.968258 ns
clickbench_q27/vortex-file-compressed 694730558 6.92679e+08 1.00296 ns
clickbench_q28/vortex-file-compressed 5195226886 4.7206e+09 1.10054 ns
clickbench_q29/vortex-file-compressed 248051021 2.37072e+08 1.04631 ns
clickbench_q30/vortex-file-compressed 219724944 2.12757e+08 1.03275 ns
clickbench_q31/vortex-file-compressed 234727229 2.27879e+08 1.03005 ns
clickbench_q32/vortex-file-compressed 1351563246 1.27968e+09 1.05617 ns
clickbench_q33/vortex-file-compressed 1337538393 1.30307e+09 1.02645 ns
clickbench_q34/vortex-file-compressed 1354436094 1.29253e+09 1.0479 ns
clickbench_q35/vortex-file-compressed 598108448 5.87022e+08 1.01889 ns
clickbench_q36/vortex-file-compressed 61506345 5.81023e+07 1.05859 ns
clickbench_q37/vortex-file-compressed 34116651 3.31596e+07 1.02886 ns
clickbench_q38/vortex-file-compressed 28052378 2.87534e+07 0.975619 ns
clickbench_q39/vortex-file-compressed 110929321 1.13335e+08 0.978775 ns
clickbench_q40/vortex-file-compressed 26022893 2.51474e+07 1.03482 ns
clickbench_q41/vortex-file-compressed 22333948 2.1806e+07 1.02421 ns
clickbench_q42/vortex-file-compressed 28829678 2.75433e+07 1.0467 ns

@github-actions GitHub Actions
Copy link
Contributor

Benchmarks: compress

Table of Results
name PR 5090832 base a92373a ratio (PR/base) unit
compress time/taxi throughput 0.318656 0.32361 0.984691 bytes/ns
parquet_rs-zstd compress time/taxi throughput 0.356816 0.364278 0.979516 bytes/ns
decompress time/taxi throughput 2.32329 2.26557 1.02548 bytes/ns
parquet_rs-zstd decompress time/taxi throughput 1.94526 1.97867 0.983112 bytes/ns
compress time/AirlineSentiment throughput 0.00365882 0.00338483 1.08095 bytes/ns
parquet_rs-zstd compress time/AirlineSentiment throughput 0.0627449 0.0598136 1.04901 bytes/ns
decompress time/AirlineSentiment throughput 0.0260696 0.026288 0.991691 bytes/ns
parquet_rs-zstd decompress time/AirlineSentiment throughput 0.09751 0.0970032 1.00522 bytes/ns
compress time/Arade throughput 0.24155 0.240011 1.00641 bytes/ns
parquet_rs-zstd compress time/Arade throughput 0.512568 0.519364 0.986915 bytes/ns
decompress time/Arade throughput 2.20087 2.14235 1.02732 bytes/ns
parquet_rs-zstd decompress time/Arade throughput 2.05048 2.0727 0.989278 bytes/ns
compress time/Bimbo throughput 0.594326 0.587916 1.0109 bytes/ns
parquet_rs-zstd compress time/Bimbo throughput 0.45925 0.45679 1.00539 bytes/ns
decompress time/Bimbo throughput 2.59202 2.58902 1.00116 bytes/ns
parquet_rs-zstd decompress time/Bimbo throughput 3.24447 3.2208 1.00735 bytes/ns
compress time/CMSprovider throughput 0.0747473 0.0684599 1.09184 bytes/ns
parquet_rs-zstd compress time/CMSprovider throughput 0.453414 0.448848 1.01017 bytes/ns
decompress time/CMSprovider throughput 4.90528 4.60947 1.06418 bytes/ns
parquet_rs-zstd decompress time/CMSprovider throughput 2.25543 2.2538 1.00072 bytes/ns
compress time/Euro2016 throughput 0.193005 0.191665 1.00699 bytes/ns
parquet_rs-zstd compress time/Euro2016 throughput 0.367549 0.369961 0.99348 bytes/ns
decompress time/Euro2016 throughput 3.23734 3.08381 1.04979 bytes/ns
parquet_rs-zstd decompress time/Euro2016 throughput 1.26564 1.2673 0.99869 bytes/ns
compress time/Food throughput 0.274814 0.268807 1.02235 bytes/ns
parquet_rs-zstd compress time/Food throughput 0.42125 0.424857 0.991508 bytes/ns
decompress time/Food throughput 7.02491 7.10937 0.98812 bytes/ns
parquet_rs-zstd decompress time/Food throughput 2.07145 2.09396 0.989252 bytes/ns
compress time/HashTags throughput 0.243221 0.239435 1.01581 bytes/ns
parquet_rs-zstd compress time/HashTags throughput 1.00438 0.991543 1.01294 bytes/ns
decompress time/HashTags throughput 7.82578 7.48822 1.04508 bytes/ns
parquet_rs-zstd decompress time/HashTags throughput 3.51004 3.45605 1.01562 bytes/ns
compress time/TPC-H l_comment chunked throughput 0.256128 0.257162 0.995978 bytes/ns
parquet_rs-zstd compress time/TPC-H l_comment chunked throughput 0.333762 0.335357 0.995243 bytes/ns
decompress time/TPC-H l_comment chunked throughput 3.55049 3.56934 0.994721 bytes/ns
parquet_rs-zstd decompress time/TPC-H l_comment chunked throughput 1.46824 1.48629 0.987855 bytes/ns
compress time/TPC-H l_comment canonical throughput 0.0366611 0.034 1.07827 bytes/ns
parquet_rs-zstd compress time/TPC-H l_comment canonical throughput 0.332712 0.333933 0.996343 bytes/ns
decompress time/TPC-H l_comment canonical throughput 4.03109 4.05081 0.995132 bytes/ns
parquet_rs-zstd decompress time/TPC-H l_comment canonical throughput 1.47866 1.49176 0.991217 bytes/ns
compress time/wide table cols=10 chunks=1 rows=1000 throughput 0.187318 0.183804 1.01912 bytes/ns
parquet_rs-zstd compress time/wide table cols=10 chunks=1 rows=1000 throughput 0.252383 0.250941 1.00575 bytes/ns
decompress time/wide table cols=10 chunks=1 rows=1000 throughput 0.843174 0.825076 1.02194 bytes/ns
parquet_rs-zstd decompress time/wide table cols=10 chunks=1 rows=1000 throughput 0.563524 0.56405 0.999067 bytes/ns
compress time/wide table cols=100 chunks=1 rows=1000 throughput 0.182924 0.179114 1.02127 bytes/ns
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 throughput 0.244907 0.246155 0.99493 bytes/ns
decompress time/wide table cols=100 chunks=1 rows=1000 throughput 1.35087 1.31403 1.02803 bytes/ns
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 throughput 0.555611 0.551312 1.0078 bytes/ns
compress time/wide table cols=1000 chunks=1 rows=1000 throughput 0.177596 0.176863 1.00415 bytes/ns
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 throughput 0.23886 0.242 0.987023 bytes/ns
decompress time/wide table cols=1000 chunks=1 rows=1000 throughput 1.03206 1.02963 1.00237 bytes/ns
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 throughput 0.557779 0.552846 1.00892 bytes/ns
compress time/wide table cols=10 chunks=50 rows=1000 throughput 0.0954186 0.0940649 1.01439 bytes/ns
parquet_rs-zstd compress time/wide table cols=10 chunks=50 rows=1000 throughput 0.177311 0.176104 1.00685 bytes/ns
decompress time/wide table cols=10 chunks=50 rows=1000 throughput 0.545163 0.887042 0.614585 bytes/ns
parquet_rs-zstd decompress time/wide table cols=10 chunks=50 rows=1000 throughput 0.57883 0.565316 1.02391 bytes/ns
compress time/wide table cols=100 chunks=50 rows=1000 throughput 0.0935799 0.0919214 1.01804 bytes/ns
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 throughput 0.168858 0.167698 1.00692 bytes/ns
decompress time/wide table cols=100 chunks=50 rows=1000 throughput 1.31863 1.31208 1.00499 bytes/ns
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 throughput 0.570277 0.560283 1.01784 bytes/ns
compress time/wide table cols=1000 chunks=50 rows=1000 throughput 0.0825593 0.0838248 0.984903 bytes/ns
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 throughput 0.13819 0.140747 0.981829 bytes/ns
decompress time/wide table cols=1000 chunks=50 rows=1000 throughput 1.04598 1.04303 1.00283 bytes/ns
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 throughput 0.558729 0.560626 0.996617 bytes/ns
vortex:raw size/taxi 0.119399 0.119399 1 ratio
vortex size/taxi 5.9079e+07 5.9079e+07 1 bytes
vortex:parquet-zstd size/taxi 1.05572 1.05572 1 ratio
vortex:raw size/AirlineSentiment 1.35456 1.35456 1 ratio
vortex size/AirlineSentiment 4424 4424 1 bytes
vortex:parquet-zstd size/AirlineSentiment 4.57497 4.57497 1 ratio
vortex:raw size/Arade 0.255857 0.255857 1 ratio
vortex size/Arade 3.03621e+08 3.03621e+08 1 bytes
vortex:parquet-zstd size/Arade 0.994197 0.994197 1 ratio
vortex:raw size/Bimbo 0.116911 0.116911 1 ratio
vortex size/Bimbo 8.35811e+08 8.35811e+08 1 bytes
vortex:parquet-zstd size/Bimbo 2.15331 2.15331 1 ratio
vortex:raw size/CMSprovider 0.185 0.185 1 ratio
vortex size/CMSprovider 1.16274e+09 1.16274e+09 1 bytes
vortex:parquet-zstd size/CMSprovider 1.51099 1.51099 1 ratio
vortex:raw size/Euro2016 0.399248 0.399248 1 ratio
vortex size/Euro2016 1.81667e+08 1.81667e+08 1 bytes
vortex:parquet-zstd size/Euro2016 1.52803 1.52803 1 ratio
vortex:raw size/Food 0.177323 0.177323 1 ratio
vortex size/Food 5.973e+07 5.973e+07 1 bytes
vortex:parquet-zstd size/Food 1.64863 1.64863 1 ratio
vortex:raw size/HashTags 0.139809 0.139809 1 ratio
vortex size/HashTags 2.67863e+08 2.67863e+08 1 bytes
vortex:parquet-zstd size/HashTags 1.99949 1.99949 1 ratio
vortex:raw size/TPC-H l_comment chunked 0.417568 0.41854 0.997677 ratio
vortex size/TPC-H l_comment chunked 1.04057e+08 1.04299e+08 0.997677 bytes
vortex:parquet-zstd size/TPC-H l_comment chunked 1.8276 1.83182 0.997699 ratio
vortex:raw size/TPC-H l_comment canonical 0.425529 0.425517 1.00003 ratio
vortex size/TPC-H l_comment canonical 1.06038e+08 1.06035e+08 1.00003 bytes
vortex:parquet-zstd size/TPC-H l_comment canonical 1.86241 1.86226 1.00008 ratio
vortex:raw size/wide table cols=10 chunks=1 rows=1000 0.626224 0.626224 1 ratio
vortex size/wide table cols=10 chunks=1 rows=1000 100256 100256 1 bytes
vortex:parquet-zstd size/wide table cols=10 chunks=1 rows=1000 1.07244 1.07244 1 ratio
vortex:raw size/wide table cols=100 chunks=1 rows=1000 0.623267 0.623267 1 ratio
vortex size/wide table cols=100 chunks=1 rows=1000 997736 997736 1 bytes
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.06732 1.06732 1 ratio
vortex:raw size/wide table cols=1000 chunks=1 rows=1000 0.622971 0.622971 1 ratio
vortex size/wide table cols=1000 chunks=1 rows=1000 9.97254e+06 9.97254e+06 1 bytes
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 1.06681 1.06681 1 ratio
vortex:raw size/wide table cols=10 chunks=50 rows=1000 0.6098 0.6098 1 ratio
vortex size/wide table cols=10 chunks=50 rows=1000 100256 100256 1 bytes
vortex:parquet-zstd size/wide table cols=10 chunks=50 rows=1000 1.07244 1.07244 1 ratio
vortex:raw size/wide table cols=100 chunks=50 rows=1000 0.608224 0.608224 1 ratio
vortex size/wide table cols=100 chunks=50 rows=1000 997736 997736 1 bytes
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.06732 1.06732 1 ratio
vortex:raw size/wide table cols=1000 chunks=50 rows=1000 0.608066 0.608066 1 ratio
vortex size/wide table cols=1000 chunks=50 rows=1000 9.97254e+06 9.97254e+06 1 bytes
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 1.06681 1.06681 1 ratio

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@AdamGS