chapter3-sets.report.txt

[info] welcome to sbt 1.10.1 (Eclipse Adoptium Java 21.0.4)
[info] loading settings for project global-plugins from metals.sbt,plugins.sbt ...
[info] loading global plugins from /home/gaelrenoux/.sbt/1.0/plugins
[info] loading settings for project public-scalaio2024-benchmarks-build from plugins.sbt ...
[info] loading project definition from /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/project
[success] Generated .bloop/public-scalaio2024-benchmarks-build.json
[success] Total time: 0 s, completed Nov 6, 2024, 11:17:35 AM
[info] loading settings for project public-scalaio2024-benchmarks from build.sbt ...
[info] set current project to scalaio2024-benchmarks (in build file:/home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/)
[info] running (fork) org.openjdk.jmh.generators.bytecode.JmhBytecodeGenerator /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/classes /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/src_managed/jmh /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/resource_managed/jmh default
[info] compiling 1 Scala source to /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/test-classes ...
[info] Processing 261 classes from /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/classes with "reflection" generator
[info] Writing out Java source to /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/src_managed/jmh and resources to /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/resource_managed/jmh
[info] compiling 1116 Java sources to /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/classes ...
[info] done compiling
[info] done compiling
[info] running (fork) org.openjdk.jmh.Main -i 20 -wi 10 -f1 -t1 .*chapter3.SetBenchmark_.*Invoice_HalfHit_(VerySmall|Small|Large).*
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Array
[info] # Run progress: 0.00% complete, ETA 00:18:00
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: ≈ 10⁻³ us/op
[info] # Warmup Iteration   2: ≈ 10⁻³ us/op
[info] # Warmup Iteration   3: ≈ 10⁻³ us/op
[info] # Warmup Iteration   4: ≈ 10⁻³ us/op
[info] # Warmup Iteration   5: ≈ 10⁻³ us/op
[info] # Warmup Iteration   6: ≈ 10⁻³ us/op
[info] # Warmup Iteration   7: ≈ 10⁻³ us/op
[info] # Warmup Iteration   8: ≈ 10⁻³ us/op
[info] # Warmup Iteration   9: ≈ 10⁻³ us/op
[info] # Warmup Iteration  10: ≈ 10⁻³ us/op
[info] Iteration   1: ≈ 10⁻³ us/op
[info] Iteration   2: ≈ 10⁻³ us/op
[info] Iteration   3: ≈ 10⁻³ us/op
[info] Iteration   4: ≈ 10⁻³ us/op
[info] Iteration   5: ≈ 10⁻³ us/op
[info] Iteration   6: ≈ 10⁻³ us/op
[info] Iteration   7: ≈ 10⁻³ us/op
[info] Iteration   8: ≈ 10⁻³ us/op
[info] Iteration   9: ≈ 10⁻³ us/op
[info] Iteration  10: ≈ 10⁻³ us/op
[info] Iteration  11: ≈ 10⁻³ us/op
[info] Iteration  12: ≈ 10⁻³ us/op
[info] Iteration  13: ≈ 10⁻³ us/op
[info] Iteration  14: ≈ 10⁻³ us/op
[info] Iteration  15: ≈ 10⁻³ us/op
[info] Iteration  16: ≈ 10⁻³ us/op
[info] Iteration  17: ≈ 10⁻³ us/op
[info] Iteration  18: ≈ 10⁻³ us/op
[info] Iteration  19: ≈ 10⁻³ us/op
[info] Iteration  20: ≈ 10⁻³ us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Array":
[info]   ≈ 10⁻³ us/op
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet
[info] # Run progress: 2.78% complete, ETA 00:18:01
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2863807.451 us/op
[info] # Warmup Iteration   2: 3.049 us/op
[info] # Warmup Iteration   3: 2.861 us/op
[info] # Warmup Iteration   4: 2.801 us/op
[info] # Warmup Iteration   5: 2.846 us/op
[info] # Warmup Iteration   6: 2.847 us/op
[info] # Warmup Iteration   7: 2.884 us/op
[info] # Warmup Iteration   8: 2.822 us/op
[info] # Warmup Iteration   9: 2.843 us/op
[info] # Warmup Iteration  10: 2.818 us/op
[info] Iteration   1: 2.859 us/op
[info] Iteration   2: 2.904 us/op
[info] Iteration   3: 2.868 us/op
[info] Iteration   4: 2.895 us/op
[info] Iteration   5: 2.846 us/op
[info] Iteration   6: 2.848 us/op
[info] Iteration   7: 2.913 us/op
[info] Iteration   8: 2.913 us/op
[info] Iteration   9: 2.840 us/op
[info] Iteration  10: 2.865 us/op
[info] Iteration  11: 2.814 us/op
[info] Iteration  12: 2.917 us/op
[info] Iteration  13: 2.854 us/op
[info] Iteration  14: 2.846 us/op
[info] Iteration  15: 2.820 us/op
[info] Iteration  16: 2.874 us/op
[info] Iteration  17: 2.882 us/op
[info] Iteration  18: 2.863 us/op
[info] Iteration  19: 2.848 us/op
[info] Iteration  20: 2.815 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet":
[info]   2.864 ±(99.9%) 0.028 us/op [Average]
[info]   (min, avg, max) = (2.814, 2.864, 2.917), stdev = 0.032
[info]   CI (99.9%): [2.837, 2.892] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet
[info] # Run progress: 5.56% complete, ETA 00:18:01
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3171148.312 us/op
[info] # Warmup Iteration   2: 3.001 us/op
[info] # Warmup Iteration   3: 2.927 us/op
[info] # Warmup Iteration   4: 3.620 us/op
[info] # Warmup Iteration   5: 3.624 us/op
[info] # Warmup Iteration   6: 3.561 us/op
[info] # Warmup Iteration   7: 3.574 us/op
[info] # Warmup Iteration   8: 3.571 us/op
[info] # Warmup Iteration   9: 3.630 us/op
[info] # Warmup Iteration  10: 3.600 us/op
[info] Iteration   1: 3.573 us/op
[info] Iteration   2: 3.557 us/op
[info] Iteration   3: 3.593 us/op
[info] Iteration   4: 3.598 us/op
[info] Iteration   5: 3.575 us/op
[info] Iteration   6: 3.561 us/op
[info] Iteration   7: 3.608 us/op
[info] Iteration   8: 3.575 us/op
[info] Iteration   9: 3.617 us/op
[info] Iteration  10: 3.563 us/op
[info] Iteration  11: 3.599 us/op
[info] Iteration  12: 4.149 us/op
[info] Iteration  13: 3.579 us/op
[info] Iteration  14: 3.609 us/op
[info] Iteration  15: 3.612 us/op
[info] Iteration  16: 3.574 us/op
[info] Iteration  17: 3.577 us/op
[info] Iteration  18: 3.580 us/op
[info] Iteration  19: 3.661 us/op
[info] Iteration  20: 3.564 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet":
[info]   3.616 ±(99.9%) 0.111 us/op [Average]
[info]   (min, avg, max) = (3.557, 3.616, 4.149), stdev = 0.128
[info]   CI (99.9%): [3.505, 3.727] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet
[info] # Run progress: 8.33% complete, ETA 00:17:43
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3006306.803 us/op
[info] # Warmup Iteration   2: 12.777 us/op
[info] # Warmup Iteration   3: 12.083 us/op
[info] # Warmup Iteration   4: 12.428 us/op
[info] # Warmup Iteration   5: 12.018 us/op
[info] # Warmup Iteration   6: 12.309 us/op
[info] # Warmup Iteration   7: 12.107 us/op
[info] # Warmup Iteration   8: 12.345 us/op
[info] # Warmup Iteration   9: 12.145 us/op
[info] # Warmup Iteration  10: 12.071 us/op
[info] Iteration   1: 12.293 us/op
[info] Iteration   2: 12.312 us/op
[info] Iteration   3: 12.330 us/op
[info] Iteration   4: 12.378 us/op
[info] Iteration   5: 12.279 us/op
[info] Iteration   6: 12.377 us/op
[info] Iteration   7: 12.473 us/op
[info] Iteration   8: 12.482 us/op
[info] Iteration   9: 12.209 us/op
[info] Iteration  10: 12.409 us/op
[info] Iteration  11: 12.282 us/op
[info] Iteration  12: 12.568 us/op
[info] Iteration  13: 12.029 us/op
[info] Iteration  14: 12.365 us/op
[info] Iteration  15: 12.205 us/op
[info] Iteration  16: 12.275 us/op
[info] Iteration  17: 12.535 us/op
[info] Iteration  18: 12.384 us/op
[info] Iteration  19: 12.382 us/op
[info] Iteration  20: 12.298 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet":
[info]   12.343 ±(99.9%) 0.107 us/op [Average]
[info]   (min, avg, max) = (12.029, 12.343, 12.568), stdev = 0.123
[info]   CI (99.9%): [12.236, 12.450] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Set
[info] # Run progress: 11.11% complete, ETA 00:17:15
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3019454.685 us/op
[info] # Warmup Iteration   2: 51.323 us/op
[info] # Warmup Iteration   3: 47.790 us/op
[info] # Warmup Iteration   4: 50.297 us/op
[info] # Warmup Iteration   5: 48.766 us/op
[info] # Warmup Iteration   6: 48.044 us/op
[info] # Warmup Iteration   7: 46.981 us/op
[info] # Warmup Iteration   8: 48.498 us/op
[info] # Warmup Iteration   9: 49.393 us/op
[info] # Warmup Iteration  10: 49.157 us/op
[info] Iteration   1: 48.387 us/op
[info] Iteration   2: 49.035 us/op
[info] Iteration   3: 48.924 us/op
[info] Iteration   4: 48.647 us/op
[info] Iteration   5: 52.466 us/op
[info] Iteration   6: 55.476 us/op
[info] Iteration   7: 62.456 us/op
[info] Iteration   8: 62.253 us/op
[info] Iteration   9: 63.766 us/op
[info] Iteration  10: 63.388 us/op
[info] Iteration  11: 62.929 us/op
[info] Iteration  12: 51.012 us/op
[info] Iteration  13: 55.872 us/op
[info] Iteration  14: 49.772 us/op
[info] Iteration  15: 49.239 us/op
[info] Iteration  16: 55.317 us/op
[info] Iteration  17: 48.666 us/op
[info] Iteration  18: 49.084 us/op
[info] Iteration  19: 49.128 us/op
[info] Iteration  20: 49.135 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Set":
[info]   53.748 ±(99.9%) 5.162 us/op [Average]
[info]   (min, avg, max) = (48.387, 53.748, 63.766), stdev = 5.945
[info]   CI (99.9%): [48.586, 58.910] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet
[info] # Run progress: 13.89% complete, ETA 00:16:46
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 4649642.269 us/op
[info] # Warmup Iteration   2: 677.809 us/op
[info] # Warmup Iteration   3: 648.607 us/op
[info] # Warmup Iteration   4: 661.458 us/op
[info] # Warmup Iteration   5: 674.226 us/op
[info] # Warmup Iteration   6: 674.987 us/op
[info] # Warmup Iteration   7: 678.580 us/op
[info] # Warmup Iteration   8: 669.494 us/op
[info] # Warmup Iteration   9: 683.843 us/op
[info] # Warmup Iteration  10: 677.181 us/op
[info] Iteration   1: 668.691 us/op
[info] Iteration   2: 670.007 us/op
[info] Iteration   3: 677.107 us/op
[info] Iteration   4: 681.643 us/op
[info] Iteration   5: 678.079 us/op
[info] Iteration   6: 673.324 us/op
[info] Iteration   7: 677.507 us/op
[info] Iteration   8: 672.125 us/op
[info] Iteration   9: 686.668 us/op
[info] Iteration  10: 673.769 us/op
[info] Iteration  11: 677.581 us/op
[info] Iteration  12: 678.296 us/op
[info] Iteration  13: 669.463 us/op
[info] Iteration  14: 680.729 us/op
[info] Iteration  15: 679.802 us/op
[info] Iteration  16: 672.280 us/op
[info] Iteration  17: 671.842 us/op
[info] Iteration  18: 672.460 us/op
[info] Iteration  19: 681.159 us/op
[info] Iteration  20: 673.539 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet":
[info]   675.804 ±(99.9%) 4.145 us/op [Average]
[info]   (min, avg, max) = (668.691, 675.804, 686.668), stdev = 4.773
[info]   CI (99.9%): [671.659, 679.948] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Array
[info] # Run progress: 16.67% complete, ETA 00:16:23
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1070106.889 us/op
[info] # Warmup Iteration   2: 76.284 us/op
[info] # Warmup Iteration   3: 71.816 us/op
[info] # Warmup Iteration   4: 73.072 us/op
[info] # Warmup Iteration   5: 71.738 us/op
[info] # Warmup Iteration   6: 71.515 us/op
[info] # Warmup Iteration   7: 72.207 us/op
[info] # Warmup Iteration   8: 71.594 us/op
[info] # Warmup Iteration   9: 72.706 us/op
[info] # Warmup Iteration  10: 72.670 us/op
[info] Iteration   1: 71.763 us/op
[info] Iteration   2: 71.703 us/op
[info] Iteration   3: 71.566 us/op
[info] Iteration   4: 72.784 us/op
[info] Iteration   5: 72.207 us/op
[info] Iteration   6: 71.444 us/op
[info] Iteration   7: 71.341 us/op
[info] Iteration   8: 71.877 us/op
[info] Iteration   9: 73.089 us/op
[info] Iteration  10: 71.444 us/op
[info] Iteration  11: 72.519 us/op
[info] Iteration  12: 71.833 us/op
[info] Iteration  13: 72.272 us/op
[info] Iteration  14: 72.908 us/op
[info] Iteration  15: 71.997 us/op
[info] Iteration  16: 71.617 us/op
[info] Iteration  17: 71.962 us/op
[info] Iteration  18: 72.108 us/op
[info] Iteration  19: 72.500 us/op
[info] Iteration  20: 71.811 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Array":
[info]   72.037 ±(99.9%) 0.439 us/op [Average]
[info]   (min, avg, max) = (71.341, 72.037, 73.089), stdev = 0.506
[info]   CI (99.9%): [71.598, 72.476] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet
[info] # Run progress: 19.44% complete, ETA 00:15:42
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1103053.422 us/op
[info] # Warmup Iteration   2: 1.163 us/op
[info] # Warmup Iteration   3: 1.153 us/op
[info] # Warmup Iteration   4: 0.907 us/op
[info] # Warmup Iteration   5: 0.898 us/op
[info] # Warmup Iteration   6: 0.898 us/op
[info] # Warmup Iteration   7: 0.902 us/op
[info] # Warmup Iteration   8: 0.925 us/op
[info] # Warmup Iteration   9: 0.909 us/op
[info] # Warmup Iteration  10: 0.905 us/op
[info] Iteration   1: 0.896 us/op
[info] Iteration   2: 0.904 us/op
[info] Iteration   3: 0.918 us/op
[info] Iteration   4: 0.897 us/op
[info] Iteration   5: 0.901 us/op
[info] Iteration   6: 0.907 us/op
[info] Iteration   7: 0.900 us/op
[info] Iteration   8: 0.914 us/op
[info] Iteration   9: 0.907 us/op
[info] Iteration  10: 0.913 us/op
[info] Iteration  11: 0.905 us/op
[info] Iteration  12: 0.908 us/op
[info] Iteration  13: 0.920 us/op
[info] Iteration  14: 0.909 us/op
[info] Iteration  15: 0.909 us/op
[info] Iteration  16: 0.892 us/op
[info] Iteration  17: 0.899 us/op
[info] Iteration  18: 0.915 us/op
[info] Iteration  19: 0.903 us/op
[info] Iteration  20: 0.901 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet":
[info]   0.906 ±(99.9%) 0.007 us/op [Average]
[info]   (min, avg, max) = (0.892, 0.906, 0.920), stdev = 0.008
[info]   CI (99.9%): [0.899, 0.912] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet
[info] # Run progress: 22.22% complete, ETA 00:15:04
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 66.496 us/op
[info] # Warmup Iteration   2: 2.927 us/op
[info] # Warmup Iteration   3: 2.709 us/op
[info] # Warmup Iteration   4: 2.788 us/op
[info] # Warmup Iteration   5: 2.776 us/op
[info] # Warmup Iteration   6: 2.798 us/op
[info] # Warmup Iteration   7: 2.806 us/op
[info] # Warmup Iteration   8: 2.776 us/op
[info] # Warmup Iteration   9: 2.793 us/op
[info] # Warmup Iteration  10: 2.883 us/op
[info] Iteration   1: 2.797 us/op
[info] Iteration   2: 2.879 us/op
[info] Iteration   3: 2.831 us/op
[info] Iteration   4: 2.808 us/op
[info] Iteration   5: 2.778 us/op
[info] Iteration   6: 2.799 us/op
[info] Iteration   7: 2.847 us/op
[info] Iteration   8: 2.806 us/op
[info] Iteration   9: 2.788 us/op
[info] Iteration  10: 2.783 us/op
[info] Iteration  11: 2.784 us/op
[info] Iteration  12: 2.835 us/op
[info] Iteration  13: 2.826 us/op
[info] Iteration  14: 2.814 us/op
[info] Iteration  15: 2.804 us/op
[info] Iteration  16: 2.806 us/op
[info] Iteration  17: 2.846 us/op
[info] Iteration  18: 2.799 us/op
[info] Iteration  19: 2.807 us/op
[info] Iteration  20: 2.812 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet":
[info]   2.812 ±(99.9%) 0.022 us/op [Average]
[info]   (min, avg, max) = (2.778, 2.812, 2.879), stdev = 0.025
[info]   CI (99.9%): [2.791, 2.834] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet
[info] # Run progress: 25.00% complete, ETA 00:14:27
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1054020.866 us/op
[info] # Warmup Iteration   2: 7.338 us/op
[info] # Warmup Iteration   3: 6.518 us/op
[info] # Warmup Iteration   4: 6.472 us/op
[info] # Warmup Iteration   5: 6.495 us/op
[info] # Warmup Iteration   6: 6.563 us/op
[info] # Warmup Iteration   7: 6.521 us/op
[info] # Warmup Iteration   8: 6.460 us/op
[info] # Warmup Iteration   9: 6.476 us/op
[info] # Warmup Iteration  10: 6.460 us/op
[info] Iteration   1: 6.591 us/op
[info] Iteration   2: 6.458 us/op
[info] Iteration   3: 6.475 us/op
[info] Iteration   4: 6.628 us/op
[info] Iteration   5: 6.489 us/op
[info] Iteration   6: 6.501 us/op
[info] Iteration   7: 6.395 us/op
[info] Iteration   8: 6.417 us/op
[info] Iteration   9: 6.448 us/op
[info] Iteration  10: 7.013 us/op
[info] Iteration  11: 6.556 us/op
[info] Iteration  12: 6.400 us/op
[info] Iteration  13: 6.345 us/op
[info] Iteration  14: 6.433 us/op
[info] Iteration  15: 6.411 us/op
[info] Iteration  16: 6.282 us/op
[info] Iteration  17: 6.195 us/op
[info] Iteration  18: 6.147 us/op
[info] Iteration  19: 6.173 us/op
[info] Iteration  20: 6.166 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet":
[info]   6.426 ±(99.9%) 0.171 us/op [Average]
[info]   (min, avg, max) = (6.147, 6.426, 7.013), stdev = 0.197
[info]   CI (99.9%): [6.255, 6.597] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Set
[info] # Run progress: 27.78% complete, ETA 00:13:52
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 315.931 us/op
[info] # Warmup Iteration   2: 9.376 us/op
[info] # Warmup Iteration   3: 9.066 us/op
[info] # Warmup Iteration   4: 9.087 us/op
[info] # Warmup Iteration   5: 9.164 us/op
[info] # Warmup Iteration   6: 9.097 us/op
[info] # Warmup Iteration   7: 9.255 us/op
[info] # Warmup Iteration   8: 9.173 us/op
[info] # Warmup Iteration   9: 9.068 us/op
[info] # Warmup Iteration  10: 9.193 us/op
[info] Iteration   1: 9.104 us/op
[info] Iteration   2: 9.090 us/op
[info] Iteration   3: 9.110 us/op
[info] Iteration   4: 9.155 us/op
[info] Iteration   5: 9.231 us/op
[info] Iteration   6: 9.249 us/op
[info] Iteration   7: 9.139 us/op
[info] Iteration   8: 9.139 us/op
[info] Iteration   9: 9.123 us/op
[info] Iteration  10: 9.248 us/op
[info] Iteration  11: 9.233 us/op
[info] Iteration  12: 9.092 us/op
[info] Iteration  13: 9.083 us/op
[info] Iteration  14: 9.055 us/op
[info] Iteration  15: 9.263 us/op
[info] Iteration  16: 9.103 us/op
[info] Iteration  17: 9.080 us/op
[info] Iteration  18: 9.073 us/op
[info] Iteration  19: 9.140 us/op
[info] Iteration  20: 9.266 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Set":
[info]   9.149 ±(99.9%) 0.062 us/op [Average]
[info]   (min, avg, max) = (9.055, 9.149, 9.266), stdev = 0.071
[info]   CI (99.9%): [9.087, 9.211] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet
[info] # Run progress: 30.56% complete, ETA 00:13:17
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1069657.224 us/op
[info] # Warmup Iteration   2: 20.526 us/op
[info] # Warmup Iteration   3: 18.747 us/op
[info] # Warmup Iteration   4: 18.133 us/op
[info] # Warmup Iteration   5: 19.050 us/op
[info] # Warmup Iteration   6: 18.885 us/op
[info] # Warmup Iteration   7: 18.734 us/op
[info] # Warmup Iteration   8: 18.895 us/op
[info] # Warmup Iteration   9: 19.075 us/op
[info] # Warmup Iteration  10: 19.180 us/op
[info] Iteration   1: 19.080 us/op
[info] Iteration   2: 18.748 us/op
[info] Iteration   3: 18.849 us/op
[info] Iteration   4: 19.448 us/op
[info] Iteration   5: 18.923 us/op
[info] Iteration   6: 18.745 us/op
[info] Iteration   7: 18.819 us/op
[info] Iteration   8: 19.031 us/op
[info] Iteration   9: 18.986 us/op
[info] Iteration  10: 18.962 us/op
[info] Iteration  11: 18.909 us/op
[info] Iteration  12: 18.997 us/op
[info] Iteration  13: 18.881 us/op
[info] Iteration  14: 19.044 us/op
[info] Iteration  15: 18.842 us/op
[info] Iteration  16: 19.120 us/op
[info] Iteration  17: 18.889 us/op
[info] Iteration  18: 18.738 us/op
[info] Iteration  19: 20.145 us/op
[info] Iteration  20: 20.957 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet":
[info]   19.106 ±(99.9%) 0.466 us/op [Average]
[info]   (min, avg, max) = (18.738, 19.106, 20.957), stdev = 0.536
[info]   CI (99.9%): [18.640, 19.571] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array
[info] # Run progress: 33.33% complete, ETA 00:12:43
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1110.663 us/op
[info] # Warmup Iteration   2: 4.885 us/op
[info] # Warmup Iteration   3: 4.739 us/op
[info] # Warmup Iteration   4: 4.741 us/op
[info] # Warmup Iteration   5: 4.735 us/op
[info] # Warmup Iteration   6: 4.660 us/op
[info] # Warmup Iteration   7: 4.701 us/op
[info] # Warmup Iteration   8: 4.676 us/op
[info] # Warmup Iteration   9: 4.912 us/op
[info] # Warmup Iteration  10: 4.688 us/op
[info] Iteration   1: 4.692 us/op
[info] Iteration   2: 4.669 us/op
[info] Iteration   3: 4.670 us/op
[info] Iteration   4: 4.722 us/op
[info] Iteration   5: 4.762 us/op
[info] Iteration   6: 4.695 us/op
[info] Iteration   7: 4.633 us/op
[info] Iteration   8: 4.629 us/op
[info] Iteration   9: 4.744 us/op
[info] Iteration  10: 4.644 us/op
[info] Iteration  11: 4.660 us/op
[info] Iteration  12: 4.619 us/op
[info] Iteration  13: 4.707 us/op
[info] Iteration  14: 4.692 us/op
[info] Iteration  15: 4.697 us/op
[info] Iteration  16: 4.621 us/op
[info] Iteration  17: 4.682 us/op
[info] Iteration  18: 4.631 us/op
[info] Iteration  19: 4.706 us/op
[info] Iteration  20: 4.629 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array":
[info]   4.675 ±(99.9%) 0.036 us/op [Average]
[info]   (min, avg, max) = (4.619, 4.675, 4.762), stdev = 0.042
[info]   CI (99.9%): [4.639, 4.712] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet
[info] # Run progress: 36.11% complete, ETA 00:12:10
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 27.603 us/op
[info] # Warmup Iteration   2: 1.056 us/op
[info] # Warmup Iteration   3: 1.080 us/op
[info] # Warmup Iteration   4: 0.823 us/op
[info] # Warmup Iteration   5: 0.920 us/op
[info] # Warmup Iteration   6: 0.883 us/op
[info] # Warmup Iteration   7: 0.826 us/op
[info] # Warmup Iteration   8: 0.840 us/op
[info] # Warmup Iteration   9: 0.828 us/op
[info] # Warmup Iteration  10: 0.828 us/op
[info] Iteration   1: 0.828 us/op
[info] Iteration   2: 0.822 us/op
[info] Iteration   3: 0.844 us/op
[info] Iteration   4: 0.822 us/op
[info] Iteration   5: 0.823 us/op
[info] Iteration   6: 0.820 us/op
[info] Iteration   7: 0.830 us/op
[info] Iteration   8: 0.830 us/op
[info] Iteration   9: 0.825 us/op
[info] Iteration  10: 0.814 us/op
[info] Iteration  11: 0.824 us/op
[info] Iteration  12: 0.825 us/op
[info] Iteration  13: 0.828 us/op
[info] Iteration  14: 0.822 us/op
[info] Iteration  15: 0.820 us/op
[info] Iteration  16: 0.814 us/op
[info] Iteration  17: 0.815 us/op
[info] Iteration  18: 0.831 us/op
[info] Iteration  19: 0.823 us/op
[info] Iteration  20: 0.815 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet":
[info]   0.824 ±(99.9%) 0.006 us/op [Average]
[info]   (min, avg, max) = (0.814, 0.824, 0.844), stdev = 0.007
[info]   CI (99.9%): [0.817, 0.830] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet
[info] # Run progress: 38.89% complete, ETA 00:11:36
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 45.699 us/op
[info] # Warmup Iteration   2: 1.988 us/op
[info] # Warmup Iteration   3: 2.169 us/op
[info] # Warmup Iteration   4: 2.573 us/op
[info] # Warmup Iteration   5: 2.546 us/op
[info] # Warmup Iteration   6: 2.558 us/op
[info] # Warmup Iteration   7: 2.576 us/op
[info] # Warmup Iteration   8: 2.568 us/op
[info] # Warmup Iteration   9: 2.574 us/op
[info] # Warmup Iteration  10: 2.553 us/op
[info] Iteration   1: 2.537 us/op
[info] Iteration   2: 2.591 us/op
[info] Iteration   3: 2.562 us/op
[info] Iteration   4: 2.558 us/op
[info] Iteration   5: 2.551 us/op
[info] Iteration   6: 2.536 us/op
[info] Iteration   7: 2.581 us/op
[info] Iteration   8: 2.572 us/op
[info] Iteration   9: 2.540 us/op
[info] Iteration  10: 2.554 us/op
[info] Iteration  11: 2.543 us/op
[info] Iteration  12: 2.607 us/op
[info] Iteration  13: 2.683 us/op
[info] Iteration  14: 2.573 us/op
[info] Iteration  15: 2.555 us/op
[info] Iteration  16: 2.562 us/op
[info] Iteration  17: 2.575 us/op
[info] Iteration  18: 2.570 us/op
[info] Iteration  19: 2.534 us/op
[info] Iteration  20: 2.562 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet":
[info]   2.567 ±(99.9%) 0.029 us/op [Average]
[info]   (min, avg, max) = (2.534, 2.567, 2.683), stdev = 0.033
[info]   CI (99.9%): [2.539, 2.596] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet
[info] # Run progress: 41.67% complete, ETA 00:11:04
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1087897.440 us/op
[info] # Warmup Iteration   2: 7.108 us/op
[info] # Warmup Iteration   3: 6.952 us/op
[info] # Warmup Iteration   4: 6.924 us/op
[info] # Warmup Iteration   5: 7.178 us/op
[info] # Warmup Iteration   6: 7.013 us/op
[info] # Warmup Iteration   7: 6.995 us/op
[info] # Warmup Iteration   8: 7.038 us/op
[info] # Warmup Iteration   9: 6.936 us/op
[info] # Warmup Iteration  10: 6.984 us/op
[info] Iteration   1: 7.033 us/op
[info] Iteration   2: 7.251 us/op
[info] Iteration   3: 6.915 us/op
[info] Iteration   4: 6.880 us/op
[info] Iteration   5: 6.948 us/op
[info] Iteration   6: 7.018 us/op
[info] Iteration   7: 6.976 us/op
[info] Iteration   8: 6.872 us/op
[info] Iteration   9: 6.926 us/op
[info] Iteration  10: 6.928 us/op
[info] Iteration  11: 7.032 us/op
[info] Iteration  12: 6.867 us/op
[info] Iteration  13: 6.887 us/op
[info] Iteration  14: 6.681 us/op
[info] Iteration  15: 6.609 us/op
[info] Iteration  16: 6.587 us/op
[info] Iteration  17: 6.724 us/op
[info] Iteration  18: 7.118 us/op
[info] Iteration  19: 6.532 us/op
[info] Iteration  20: 6.588 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet":
[info]   6.869 ±(99.9%) 0.168 us/op [Average]
[info]   (min, avg, max) = (6.532, 6.869, 7.251), stdev = 0.193
[info]   CI (99.9%): [6.701, 7.036] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set
[info] # Run progress: 44.44% complete, ETA 00:10:31
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1050551.200 us/op
[info] # Warmup Iteration   2: 6.942 us/op
[info] # Warmup Iteration   3: 6.565 us/op
[info] # Warmup Iteration   4: 6.494 us/op
[info] # Warmup Iteration   5: 6.588 us/op
[info] # Warmup Iteration   6: 6.549 us/op
[info] # Warmup Iteration   7: 6.549 us/op
[info] # Warmup Iteration   8: 6.487 us/op
[info] # Warmup Iteration   9: 6.531 us/op
[info] # Warmup Iteration  10: 6.566 us/op
[info] Iteration   1: 6.492 us/op
[info] Iteration   2: 6.501 us/op
[info] Iteration   3: 6.507 us/op
[info] Iteration   4: 6.481 us/op
[info] Iteration   5: 6.569 us/op
[info] Iteration   6: 6.512 us/op
[info] Iteration   7: 6.486 us/op
[info] Iteration   8: 6.457 us/op
[info] Iteration   9: 6.445 us/op
[info] Iteration  10: 6.561 us/op
[info] Iteration  11: 6.519 us/op
[info] Iteration  12: 6.460 us/op
[info] Iteration  13: 6.483 us/op
[info] Iteration  14: 6.520 us/op
[info] Iteration  15: 6.618 us/op
[info] Iteration  16: 6.425 us/op
[info] Iteration  17: 6.241 us/op
[info] Iteration  18: 6.261 us/op
[info] Iteration  19: 6.266 us/op
[info] Iteration  20: 6.312 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set":
[info]   6.456 ±(99.9%) 0.092 us/op [Average]
[info]   (min, avg, max) = (6.241, 6.456, 6.618), stdev = 0.106
[info]   CI (99.9%): [6.364, 6.548] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet
[info] # Run progress: 47.22% complete, ETA 00:09:59
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 894.297 us/op
[info] # Warmup Iteration   2: 8.570 us/op
[info] # Warmup Iteration   3: 7.565 us/op
[info] # Warmup Iteration   4: 8.217 us/op
[info] # Warmup Iteration   5: 8.273 us/op
[info] # Warmup Iteration   6: 8.320 us/op
[info] # Warmup Iteration   7: 10.149 us/op
[info] # Warmup Iteration   8: 9.125 us/op
[info] # Warmup Iteration   9: 9.017 us/op
[info] # Warmup Iteration  10: 9.024 us/op
[info] Iteration   1: 8.630 us/op
[info] Iteration   2: 8.692 us/op
[info] Iteration   3: 8.315 us/op
[info] Iteration   4: 8.476 us/op
[info] Iteration   5: 8.549 us/op
[info] Iteration   6: 8.210 us/op
[info] Iteration   7: 9.246 us/op
[info] Iteration   8: 10.929 us/op
[info] Iteration   9: 8.325 us/op
[info] Iteration  10: 8.322 us/op
[info] Iteration  11: 8.193 us/op
[info] Iteration  12: 8.174 us/op
[info] Iteration  13: 7.978 us/op
[info] Iteration  14: 8.088 us/op
[info] Iteration  15: 8.255 us/op
[info] Iteration  16: 8.182 us/op
[info] Iteration  17: 8.229 us/op
[info] Iteration  18: 8.113 us/op
[info] Iteration  19: 8.129 us/op
[info] Iteration  20: 8.270 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet":
[info]   8.465 ±(99.9%) 0.559 us/op [Average]
[info]   (min, avg, max) = (7.978, 8.465, 10.929), stdev = 0.644
[info]   CI (99.9%): [7.906, 9.025] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Array
[info] # Run progress: 50.00% complete, ETA 00:09:26
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: ≈ 10⁻³ us/op
[info] # Warmup Iteration   2: ≈ 10⁻³ us/op
[info] # Warmup Iteration   3: ≈ 10⁻³ us/op
[info] # Warmup Iteration   4: ≈ 10⁻³ us/op
[info] # Warmup Iteration   5: ≈ 10⁻³ us/op
[info] # Warmup Iteration   6: ≈ 10⁻³ us/op
[info] # Warmup Iteration   7: ≈ 10⁻³ us/op
[info] # Warmup Iteration   8: ≈ 10⁻³ us/op
[info] # Warmup Iteration   9: 0.001 us/op
[info] # Warmup Iteration  10: ≈ 10⁻³ us/op
[info] Iteration   1: ≈ 10⁻³ us/op
[info] Iteration   2: ≈ 10⁻³ us/op
[info] Iteration   3: ≈ 10⁻³ us/op
[info] Iteration   4: ≈ 10⁻³ us/op
[info] Iteration   5: 0.001 us/op
[info] Iteration   6: ≈ 10⁻³ us/op
[info] Iteration   7: ≈ 10⁻³ us/op
[info] Iteration   8: ≈ 10⁻³ us/op
[info] Iteration   9: ≈ 10⁻³ us/op
[info] Iteration  10: ≈ 10⁻³ us/op
[info] Iteration  11: ≈ 10⁻³ us/op
[info] Iteration  12: ≈ 10⁻³ us/op
[info] Iteration  13: ≈ 10⁻³ us/op
[info] Iteration  14: ≈ 10⁻³ us/op
[info] Iteration  15: ≈ 10⁻³ us/op
[info] Iteration  16: ≈ 10⁻³ us/op
[info] Iteration  17: ≈ 10⁻³ us/op
[info] Iteration  18: ≈ 10⁻³ us/op
[info] Iteration  19: ≈ 10⁻³ us/op
[info] Iteration  20: ≈ 10⁻³ us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Array":
[info]   ≈ 10⁻³ us/op
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet
[info] # Run progress: 52.78% complete, ETA 00:08:54
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2983954.884 us/op
[info] # Warmup Iteration   2: 2.979 us/op
[info] # Warmup Iteration   3: 2.973 us/op
[info] # Warmup Iteration   4: 2.847 us/op
[info] # Warmup Iteration   5: 2.825 us/op
[info] # Warmup Iteration   6: 2.863 us/op
[info] # Warmup Iteration   7: 2.844 us/op
[info] # Warmup Iteration   8: 2.828 us/op
[info] # Warmup Iteration   9: 2.857 us/op
[info] # Warmup Iteration  10: 2.826 us/op
[info] Iteration   1: 2.884 us/op
[info] Iteration   2: 2.825 us/op
[info] Iteration   3: 2.820 us/op
[info] Iteration   4: 2.834 us/op
[info] Iteration   5: 2.838 us/op
[info] Iteration   6: 2.876 us/op
[info] Iteration   7: 2.825 us/op
[info] Iteration   8: 2.831 us/op
[info] Iteration   9: 2.841 us/op
[info] Iteration  10: 2.853 us/op
[info] Iteration  11: 2.864 us/op
[info] Iteration  12: 2.831 us/op
[info] Iteration  13: 2.867 us/op
[info] Iteration  14: 3.000 us/op
[info] Iteration  15: 2.818 us/op
[info] Iteration  16: 2.864 us/op
[info] Iteration  17: 2.845 us/op
[info] Iteration  18: 2.835 us/op
[info] Iteration  19: 2.829 us/op
[info] Iteration  20: 2.830 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet":
[info]   2.850 ±(99.9%) 0.035 us/op [Average]
[info]   (min, avg, max) = (2.818, 2.850, 3.000), stdev = 0.040
[info]   CI (99.9%): [2.816, 2.885] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_BitSet
[info] # Run progress: 55.56% complete, ETA 00:08:24
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3021641.188 us/op
[info] # Warmup Iteration   2: 3.133 us/op
[info] # Warmup Iteration   3: 2.805 us/op
[info] # Warmup Iteration   4: 3.401 us/op
[info] # Warmup Iteration   5: 3.408 us/op
[info] # Warmup Iteration   6: 3.401 us/op
[info] # Warmup Iteration   7: 3.435 us/op
[info] # Warmup Iteration   8: 3.430 us/op
[info] # Warmup Iteration   9: 3.429 us/op
[info] # Warmup Iteration  10: 3.430 us/op
[info] Iteration   1: 3.426 us/op
[info] Iteration   2: 3.405 us/op
[info] Iteration   3: 3.454 us/op
[info] Iteration   4: 3.402 us/op
[info] Iteration   5: 3.565 us/op
[info] Iteration   6: 3.409 us/op
[info] Iteration   7: 3.425 us/op
[info] Iteration   8: 3.448 us/op
[info] Iteration   9: 3.444 us/op
[info] Iteration  10: 3.425 us/op
[info] Iteration  11: 3.407 us/op
[info] Iteration  12: 3.403 us/op
[info] Iteration  13: 3.475 us/op
[info] Iteration  14: 3.403 us/op
[info] Iteration  15: 3.402 us/op
[info] Iteration  16: 3.403 us/op
[info] Iteration  17: 3.436 us/op
[info] Iteration  18: 3.451 us/op
[info] Iteration  19: 3.421 us/op
[info] Iteration  20: 3.409 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_BitSet":
[info]   3.431 ±(99.9%) 0.033 us/op [Average]
[info]   (min, avg, max) = (3.402, 3.431, 3.565), stdev = 0.038
[info]   CI (99.9%): [3.398, 3.464] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet
[info] # Run progress: 58.33% complete, ETA 00:07:53
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2930855.169 us/op
[info] # Warmup Iteration   2: 11.347 us/op
[info] # Warmup Iteration   3: 10.855 us/op
[info] # Warmup Iteration   4: 11.050 us/op
[info] # Warmup Iteration   5: 10.955 us/op
[info] # Warmup Iteration   6: 11.193 us/op
[info] # Warmup Iteration   7: 10.951 us/op
[info] # Warmup Iteration   8: 10.980 us/op
[info] # Warmup Iteration   9: 10.695 us/op
[info] # Warmup Iteration  10: 10.774 us/op
[info] Iteration   1: 10.982 us/op
[info] Iteration   2: 11.347 us/op
[info] Iteration   3: 11.027 us/op
[info] Iteration   4: 10.962 us/op
[info] Iteration   5: 10.914 us/op
[info] Iteration   6: 11.265 us/op
[info] Iteration   7: 11.009 us/op
[info] Iteration   8: 11.033 us/op
[info] Iteration   9: 10.972 us/op
[info] Iteration  10: 10.903 us/op
[info] Iteration  11: 11.066 us/op
[info] Iteration  12: 10.985 us/op
[info] Iteration  13: 10.949 us/op
[info] Iteration  14: 10.711 us/op
[info] Iteration  15: 11.020 us/op
[info] Iteration  16: 11.276 us/op
[info] Iteration  17: 10.917 us/op
[info] Iteration  18: 11.059 us/op
[info] Iteration  19: 10.931 us/op
[info] Iteration  20: 10.978 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet":
[info]   11.015 ±(99.9%) 0.124 us/op [Average]
[info]   (min, avg, max) = (10.711, 11.015, 11.347), stdev = 0.143
[info]   CI (99.9%): [10.891, 11.140] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Set
[info] # Run progress: 61.11% complete, ETA 00:07:22
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2927377.597 us/op
[info] # Warmup Iteration   2: 63.968 us/op
[info] # Warmup Iteration   3: 59.494 us/op
[info] # Warmup Iteration   4: 60.234 us/op
[info] # Warmup Iteration   5: 59.143 us/op
[info] # Warmup Iteration   6: 59.314 us/op
[info] # Warmup Iteration   7: 60.445 us/op
[info] # Warmup Iteration   8: 61.293 us/op
[info] # Warmup Iteration   9: 58.473 us/op
[info] # Warmup Iteration  10: 58.099 us/op
[info] Iteration   1: 57.775 us/op
[info] Iteration   2: 58.608 us/op
[info] Iteration   3: 58.685 us/op
[info] Iteration   4: 58.373 us/op
[info] Iteration   5: 62.848 us/op
[info] Iteration   6: 57.192 us/op
[info] Iteration   7: 57.611 us/op
[info] Iteration   8: 58.678 us/op
[info] Iteration   9: 57.432 us/op
[info] Iteration  10: 57.503 us/op
[info] Iteration  11: 57.616 us/op
[info] Iteration  12: 57.740 us/op
[info] Iteration  13: 58.884 us/op
[info] Iteration  14: 58.253 us/op
[info] Iteration  15: 58.354 us/op
[info] Iteration  16: 58.203 us/op
[info] Iteration  17: 57.917 us/op
[info] Iteration  18: 58.249 us/op
[info] Iteration  19: 57.277 us/op
[info] Iteration  20: 57.892 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Set":
[info]   58.255 ±(99.9%) 1.033 us/op [Average]
[info]   (min, avg, max) = (57.192, 58.255, 62.848), stdev = 1.190
[info]   CI (99.9%): [57.221, 59.288] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet
[info] # Run progress: 63.89% complete, ETA 00:06:51
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 4600797.823 us/op
[info] # Warmup Iteration   2: 654.910 us/op
[info] # Warmup Iteration   3: 626.833 us/op
[info] # Warmup Iteration   4: 638.660 us/op
[info] # Warmup Iteration   5: 646.773 us/op
[info] # Warmup Iteration   6: 651.688 us/op
[info] # Warmup Iteration   7: 655.384 us/op
[info] # Warmup Iteration   8: 653.296 us/op
[info] # Warmup Iteration   9: 669.775 us/op
[info] # Warmup Iteration  10: 651.298 us/op
[info] Iteration   1: 683.574 us/op
[info] Iteration   2: 657.248 us/op
[info] Iteration   3: 655.615 us/op
[info] Iteration   4: 656.910 us/op
[info] Iteration   5: 723.097 us/op
[info] Iteration   6: 675.795 us/op
[info] Iteration   7: 670.680 us/op
[info] Iteration   8: 667.476 us/op
[info] Iteration   9: 686.519 us/op
[info] Iteration  10: 670.068 us/op
[info] Iteration  11: 667.512 us/op
[info] Iteration  12: 668.484 us/op
[info] Iteration  13: 670.467 us/op
[info] Iteration  14: 681.547 us/op
[info] Iteration  15: 669.596 us/op
[info] Iteration  16: 669.859 us/op
[info] Iteration  17: 665.617 us/op
[info] Iteration  18: 668.504 us/op
[info] Iteration  19: 678.704 us/op
[info] Iteration  20: 667.489 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet":
[info]   672.738 ±(99.9%) 12.526 us/op [Average]
[info]   (min, avg, max) = (655.615, 672.738, 723.097), stdev = 14.425
[info]   CI (99.9%): [660.212, 685.264] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Array
[info] # Run progress: 66.67% complete, ETA 00:06:21
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2300.459 us/op
[info] # Warmup Iteration   2: 72.930 us/op
[info] # Warmup Iteration   3: 71.572 us/op
[info] # Warmup Iteration   4: 70.784 us/op
[info] # Warmup Iteration   5: 71.075 us/op
[info] # Warmup Iteration   6: 70.705 us/op
[info] # Warmup Iteration   7: 70.894 us/op
[info] # Warmup Iteration   8: 78.154 us/op
[info] # Warmup Iteration   9: 71.390 us/op
[info] # Warmup Iteration  10: 70.838 us/op
[info] Iteration   1: 70.857 us/op
[info] Iteration   2: 70.656 us/op
[info] Iteration   3: 72.080 us/op
[info] Iteration   4: 71.182 us/op
[info] Iteration   5: 70.720 us/op
[info] Iteration   6: 70.739 us/op
[info] Iteration   7: 71.002 us/op
[info] Iteration   8: 71.819 us/op
[info] Iteration   9: 70.827 us/op
[info] Iteration  10: 71.654 us/op
[info] Iteration  11: 71.626 us/op
[info] Iteration  12: 71.093 us/op
[info] Iteration  13: 71.601 us/op
[info] Iteration  14: 70.617 us/op
[info] Iteration  15: 71.065 us/op
[info] Iteration  16: 70.626 us/op
[info] Iteration  17: 70.703 us/op
[info] Iteration  18: 71.819 us/op
[info] Iteration  19: 71.027 us/op
[info] Iteration  20: 71.184 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Array":
[info]   71.145 ±(99.9%) 0.400 us/op [Average]
[info]   (min, avg, max) = (70.617, 71.145, 72.080), stdev = 0.461
[info]   CI (99.9%): [70.744, 71.545] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet
[info] # Run progress: 69.44% complete, ETA 00:05:49
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1089162.397 us/op
[info] # Warmup Iteration   2: 1.174 us/op
[info] # Warmup Iteration   3: 1.126 us/op
[info] # Warmup Iteration   4: 0.886 us/op
[info] # Warmup Iteration   5: 0.888 us/op
[info] # Warmup Iteration   6: 0.887 us/op
[info] # Warmup Iteration   7: 0.912 us/op
[info] # Warmup Iteration   8: 0.885 us/op
[info] # Warmup Iteration   9: 0.887 us/op
[info] # Warmup Iteration  10: 0.886 us/op
[info] Iteration   1: 0.891 us/op
[info] Iteration   2: 0.894 us/op
[info] Iteration   3: 0.890 us/op
[info] Iteration   4: 0.887 us/op
[info] Iteration   5: 0.889 us/op
[info] Iteration   6: 0.887 us/op
[info] Iteration   7: 0.886 us/op
[info] Iteration   8: 0.874 us/op
[info] Iteration   9: 0.891 us/op
[info] Iteration  10: 0.877 us/op
[info] Iteration  11: 0.926 us/op
[info] Iteration  12: 0.892 us/op
[info] Iteration  13: 0.889 us/op
[info] Iteration  14: 0.889 us/op
[info] Iteration  15: 0.876 us/op
[info] Iteration  16: 0.876 us/op
[info] Iteration  17: 0.913 us/op
[info] Iteration  18: 0.882 us/op
[info] Iteration  19: 0.883 us/op
[info] Iteration  20: 0.878 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet":
[info]   0.888 ±(99.9%) 0.011 us/op [Average]
[info]   (min, avg, max) = (0.874, 0.888, 0.926), stdev = 0.012
[info]   CI (99.9%): [0.878, 0.899] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_BitSet
[info] # Run progress: 72.22% complete, ETA 00:05:17
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1070892.615 us/op
[info] # Warmup Iteration   2: 2.785 us/op
[info] # Warmup Iteration   3: 2.685 us/op
[info] # Warmup Iteration   4: 3.105 us/op
[info] # Warmup Iteration   5: 3.093 us/op
[info] # Warmup Iteration   6: 3.139 us/op
[info] # Warmup Iteration   7: 3.087 us/op
[info] # Warmup Iteration   8: 3.099 us/op
[info] # Warmup Iteration   9: 3.087 us/op
[info] # Warmup Iteration  10: 3.096 us/op
[info] Iteration   1: 3.122 us/op
[info] Iteration   2: 3.098 us/op
[info] Iteration   3: 3.086 us/op
[info] Iteration   4: 3.091 us/op
[info] Iteration   5: 3.097 us/op
[info] Iteration   6: 3.119 us/op
[info] Iteration   7: 3.093 us/op
[info] Iteration   8: 3.239 us/op
[info] Iteration   9: 3.074 us/op
[info] Iteration  10: 3.092 us/op
[info] Iteration  11: 3.101 us/op
[info] Iteration  12: 3.094 us/op
[info] Iteration  13: 3.101 us/op
[info] Iteration  14: 3.125 us/op
[info] Iteration  15: 3.094 us/op
[info] Iteration  16: 3.138 us/op
[info] Iteration  17: 3.092 us/op
[info] Iteration  18: 3.117 us/op
[info] Iteration  19: 3.091 us/op
[info] Iteration  20: 3.090 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_BitSet":
[info]   3.108 ±(99.9%) 0.030 us/op [Average]
[info]   (min, avg, max) = (3.074, 3.108, 3.239), stdev = 0.035
[info]   CI (99.9%): [3.078, 3.138] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet
[info] # Run progress: 75.00% complete, ETA 00:04:45
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 194.684 us/op
[info] # Warmup Iteration   2: 5.914 us/op
[info] # Warmup Iteration   3: 5.878 us/op
[info] # Warmup Iteration   4: 5.881 us/op
[info] # Warmup Iteration   5: 6.005 us/op
[info] # Warmup Iteration   6: 5.910 us/op
[info] # Warmup Iteration   7: 5.904 us/op
[info] # Warmup Iteration   8: 5.898 us/op
[info] # Warmup Iteration   9: 5.922 us/op
[info] # Warmup Iteration  10: 5.966 us/op
[info] Iteration   1: 5.877 us/op
[info] Iteration   2: 5.908 us/op
[info] Iteration   3: 6.553 us/op
[info] Iteration   4: 5.890 us/op
[info] Iteration   5: 6.011 us/op
[info] Iteration   6: 5.841 us/op
[info] Iteration   7: 5.914 us/op
[info] Iteration   8: 5.824 us/op
[info] Iteration   9: 5.826 us/op
[info] Iteration  10: 5.898 us/op
[info] Iteration  11: 5.845 us/op
[info] Iteration  12: 5.799 us/op
[info] Iteration  13: 5.823 us/op
[info] Iteration  14: 5.805 us/op
[info] Iteration  15: 5.973 us/op
[info] Iteration  16: 5.821 us/op
[info] Iteration  17: 5.788 us/op
[info] Iteration  18: 5.830 us/op
[info] Iteration  19: 5.815 us/op
[info] Iteration  20: 6.252 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet":
[info]   5.915 ±(99.9%) 0.159 us/op [Average]
[info]   (min, avg, max) = (5.788, 5.915, 6.553), stdev = 0.183
[info]   CI (99.9%): [5.756, 6.074] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Set
[info] # Run progress: 77.78% complete, ETA 00:04:13
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 200.413 us/op
[info] # Warmup Iteration   2: 8.119 us/op
[info] # Warmup Iteration   3: 7.702 us/op
[info] # Warmup Iteration   4: 7.624 us/op
[info] # Warmup Iteration   5: 7.725 us/op
[info] # Warmup Iteration   6: 7.556 us/op
[info] # Warmup Iteration   7: 7.595 us/op
[info] # Warmup Iteration   8: 7.602 us/op
[info] # Warmup Iteration   9: 7.596 us/op
[info] # Warmup Iteration  10: 7.575 us/op
[info] Iteration   1: 7.591 us/op
[info] Iteration   2: 7.566 us/op
[info] Iteration   3: 7.552 us/op
[info] Iteration   4: 7.611 us/op
[info] Iteration   5: 7.680 us/op
[info] Iteration   6: 7.579 us/op
[info] Iteration   7: 7.630 us/op
[info] Iteration   8: 7.599 us/op
[info] Iteration   9: 7.648 us/op
[info] Iteration  10: 7.604 us/op
[info] Iteration  11: 7.514 us/op
[info] Iteration  12: 7.532 us/op
[info] Iteration  13: 7.609 us/op
[info] Iteration  14: 7.578 us/op
[info] Iteration  15: 7.626 us/op
[info] Iteration  16: 7.619 us/op
[info] Iteration  17: 7.611 us/op
[info] Iteration  18: 7.529 us/op
[info] Iteration  19: 7.602 us/op
[info] Iteration  20: 7.600 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Set":
[info]   7.594 ±(99.9%) 0.035 us/op [Average]
[info]   (min, avg, max) = (7.514, 7.594, 7.680), stdev = 0.041
[info]   CI (99.9%): [7.559, 7.629] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet
[info] # Run progress: 80.56% complete, ETA 00:03:41
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1048465.878 us/op
[info] # Warmup Iteration   2: 19.524 us/op
[info] # Warmup Iteration   3: 17.709 us/op
[info] # Warmup Iteration   4: 19.096 us/op
[info] # Warmup Iteration   5: 18.558 us/op
[info] # Warmup Iteration   6: 18.605 us/op
[info] # Warmup Iteration   7: 18.611 us/op
[info] # Warmup Iteration   8: 19.128 us/op
[info] # Warmup Iteration   9: 19.618 us/op
[info] # Warmup Iteration  10: 20.250 us/op
[info] Iteration   1: 18.936 us/op
[info] Iteration   2: 19.041 us/op
[info] Iteration   3: 18.042 us/op
[info] Iteration   4: 19.592 us/op
[info] Iteration   5: 18.781 us/op
[info] Iteration   6: 18.670 us/op
[info] Iteration   7: 18.365 us/op
[info] Iteration   8: 19.045 us/op
[info] Iteration   9: 18.719 us/op
[info] Iteration  10: 18.770 us/op
[info] Iteration  11: 18.281 us/op
[info] Iteration  12: 18.755 us/op
[info] Iteration  13: 19.301 us/op
[info] Iteration  14: 19.203 us/op
[info] Iteration  15: 18.854 us/op
[info] Iteration  16: 18.845 us/op
[info] Iteration  17: 18.517 us/op
[info] Iteration  18: 18.656 us/op
[info] Iteration  19: 18.950 us/op
[info] Iteration  20: 18.420 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet":
[info]   18.787 ±(99.9%) 0.315 us/op [Average]
[info]   (min, avg, max) = (18.042, 18.787, 19.592), stdev = 0.363
[info]   CI (99.9%): [18.472, 19.103] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array
[info] # Run progress: 83.33% complete, ETA 00:03:09
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 160.391 us/op
[info] # Warmup Iteration   2: 4.759 us/op
[info] # Warmup Iteration   3: 4.784 us/op
[info] # Warmup Iteration   4: 4.619 us/op
[info] # Warmup Iteration   5: 4.619 us/op
[info] # Warmup Iteration   6: 4.638 us/op
[info] # Warmup Iteration   7: 4.612 us/op
[info] # Warmup Iteration   8: 4.672 us/op
[info] # Warmup Iteration   9: 4.610 us/op
[info] # Warmup Iteration  10: 4.652 us/op
[info] Iteration   1: 4.884 us/op
[info] Iteration   2: 4.630 us/op
[info] Iteration   3: 4.681 us/op
[info] Iteration   4: 4.670 us/op
[info] Iteration   5: 4.600 us/op
[info] Iteration   6: 4.624 us/op
[info] Iteration   7: 4.609 us/op
[info] Iteration   8: 4.710 us/op
[info] Iteration   9: 4.598 us/op
[info] Iteration  10: 4.569 us/op
[info] Iteration  11: 4.603 us/op
[info] Iteration  12: 4.597 us/op
[info] Iteration  13: 4.660 us/op
[info] Iteration  14: 4.558 us/op
[info] Iteration  15: 4.574 us/op
[info] Iteration  16: 4.589 us/op
[info] Iteration  17: 4.573 us/op
[info] Iteration  18: 4.619 us/op
[info] Iteration  19: 4.572 us/op
[info] Iteration  20: 4.594 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array":
[info]   4.626 ±(99.9%) 0.063 us/op [Average]
[info]   (min, avg, max) = (4.558, 4.626, 4.884), stdev = 0.073
[info]   CI (99.9%): [4.562, 4.689] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet
[info] # Run progress: 86.11% complete, ETA 00:02:37
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1082084.827 us/op
[info] # Warmup Iteration   2: 1.116 us/op
[info] # Warmup Iteration   3: 1.054 us/op
[info] # Warmup Iteration   4: 0.829 us/op
[info] # Warmup Iteration   5: 0.836 us/op
[info] # Warmup Iteration   6: 0.828 us/op
[info] # Warmup Iteration   7: 0.852 us/op
[info] # Warmup Iteration   8: 0.838 us/op
[info] # Warmup Iteration   9: 0.902 us/op
[info] # Warmup Iteration  10: 0.841 us/op
[info] Iteration   1: 0.835 us/op
[info] Iteration   2: 0.846 us/op
[info] Iteration   3: 0.844 us/op
[info] Iteration   4: 0.830 us/op
[info] Iteration   5: 0.831 us/op
[info] Iteration   6: 0.833 us/op
[info] Iteration   7: 0.843 us/op
[info] Iteration   8: 0.834 us/op
[info] Iteration   9: 0.836 us/op
[info] Iteration  10: 0.834 us/op
[info] Iteration  11: 0.827 us/op
[info] Iteration  12: 0.859 us/op
[info] Iteration  13: 0.832 us/op
[info] Iteration  14: 0.798 us/op
[info] Iteration  15: 0.826 us/op
[info] Iteration  16: 0.811 us/op
[info] Iteration  17: 0.843 us/op
[info] Iteration  18: 0.809 us/op
[info] Iteration  19: 0.818 us/op
[info] Iteration  20: 0.810 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet":
[info]   0.830 ±(99.9%) 0.013 us/op [Average]
[info]   (min, avg, max) = (0.798, 0.830, 0.859), stdev = 0.015
[info]   CI (99.9%): [0.817, 0.843] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet
[info] # Run progress: 88.89% complete, ETA 00:02:06
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1114156.692 us/op
[info] # Warmup Iteration   2: 1.994 us/op
[info] # Warmup Iteration   3: 2.060 us/op
[info] # Warmup Iteration   4: 2.538 us/op
[info] # Warmup Iteration   5: 2.491 us/op
[info] # Warmup Iteration   6: 2.536 us/op
[info] # Warmup Iteration   7: 2.500 us/op
[info] # Warmup Iteration   8: 2.525 us/op
[info] # Warmup Iteration   9: 2.509 us/op
[info] # Warmup Iteration  10: 2.516 us/op
[info] Iteration   1: 2.553 us/op
[info] Iteration   2: 2.528 us/op
[info] Iteration   3: 2.629 us/op
[info] Iteration   4: 2.513 us/op
[info] Iteration   5: 2.521 us/op
[info] Iteration   6: 2.554 us/op
[info] Iteration   7: 2.522 us/op
[info] Iteration   8: 2.512 us/op
[info] Iteration   9: 2.499 us/op
[info] Iteration  10: 2.507 us/op
[info] Iteration  11: 2.525 us/op
[info] Iteration  12: 2.488 us/op
[info] Iteration  13: 2.501 us/op
[info] Iteration  14: 2.503 us/op
[info] Iteration  15: 2.508 us/op
[info] Iteration  16: 2.514 us/op
[info] Iteration  17: 2.485 us/op
[info] Iteration  18: 2.485 us/op
[info] Iteration  19: 2.523 us/op
[info] Iteration  20: 2.507 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet":
[info]   2.519 ±(99.9%) 0.028 us/op [Average]
[info]   (min, avg, max) = (2.485, 2.519, 2.629), stdev = 0.032
[info]   CI (99.9%): [2.491, 2.547] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet
[info] # Run progress: 91.67% complete, ETA 00:01:34
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1065480.555 us/op
[info] # Warmup Iteration   2: 5.848 us/op
[info] # Warmup Iteration   3: 5.591 us/op
[info] # Warmup Iteration   4: 5.593 us/op
[info] # Warmup Iteration   5: 5.708 us/op
[info] # Warmup Iteration   6: 5.632 us/op
[info] # Warmup Iteration   7: 5.614 us/op
[info] # Warmup Iteration   8: 6.085 us/op
[info] # Warmup Iteration   9: 5.608 us/op
[info] # Warmup Iteration  10: 6.186 us/op
[info] Iteration   1: 5.654 us/op
[info] Iteration   2: 5.615 us/op
[info] Iteration   3: 5.589 us/op
[info] Iteration   4: 5.643 us/op
[info] Iteration   5: 5.649 us/op
[info] Iteration   6: 5.638 us/op
[info] Iteration   7: 5.592 us/op
[info] Iteration   8: 5.644 us/op
[info] Iteration   9: 5.599 us/op
[info] Iteration  10: 5.713 us/op
[info] Iteration  11: 5.607 us/op
[info] Iteration  12: 5.832 us/op
[info] Iteration  13: 5.634 us/op
[info] Iteration  14: 5.485 us/op
[info] Iteration  15: 5.602 us/op
[info] Iteration  16: 5.555 us/op
[info] Iteration  17: 5.508 us/op
[info] Iteration  18: 5.841 us/op
[info] Iteration  19: 5.522 us/op
[info] Iteration  20: 5.621 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet":
[info]   5.627 ±(99.9%) 0.078 us/op [Average]
[info]   (min, avg, max) = (5.485, 5.627, 5.841), stdev = 0.090
[info]   CI (99.9%): [5.549, 5.705] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set
[info] # Run progress: 94.44% complete, ETA 00:01:03
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1051124.424 us/op
[info] # Warmup Iteration   2: 5.838 us/op
[info] # Warmup Iteration   3: 5.605 us/op
[info] # Warmup Iteration   4: 5.535 us/op
[info] # Warmup Iteration   5: 5.590 us/op
[info] # Warmup Iteration   6: 5.514 us/op
[info] # Warmup Iteration   7: 5.547 us/op
[info] # Warmup Iteration   8: 5.533 us/op
[info] # Warmup Iteration   9: 5.554 us/op
[info] # Warmup Iteration  10: 5.596 us/op
[info] Iteration   1: 5.838 us/op
[info] Iteration   2: 5.553 us/op
[info] Iteration   3: 5.550 us/op
[info] Iteration   4: 5.852 us/op
[info] Iteration   5: 5.648 us/op
[info] Iteration   6: 5.561 us/op
[info] Iteration   7: 5.551 us/op
[info] Iteration   8: 5.544 us/op
[info] Iteration   9: 5.591 us/op
[info] Iteration  10: 5.602 us/op
[info] Iteration  11: 5.525 us/op
[info] Iteration  12: 5.569 us/op
[info] Iteration  13: 5.486 us/op
[info] Iteration  14: 5.468 us/op
[info] Iteration  15: 5.526 us/op
[info] Iteration  16: 5.522 us/op
[info] Iteration  17: 5.490 us/op
[info] Iteration  18: 5.458 us/op
[info] Iteration  19: 5.497 us/op
[info] Iteration  20: 5.505 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set":
[info]   5.567 ±(99.9%) 0.092 us/op [Average]
[info]   (min, avg, max) = (5.458, 5.567, 5.852), stdev = 0.106
[info]   CI (99.9%): [5.475, 5.659] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet
[info] # Run progress: 97.22% complete, ETA 00:00:31
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 278.413 us/op
[info] # Warmup Iteration   2: 8.332 us/op
[info] # Warmup Iteration   3: 7.478 us/op
[info] # Warmup Iteration   4: 8.244 us/op
[info] # Warmup Iteration   5: 8.347 us/op
[info] # Warmup Iteration   6: 8.167 us/op
[info] # Warmup Iteration   7: 8.150 us/op
[info] # Warmup Iteration   8: 8.119 us/op
[info] # Warmup Iteration   9: 8.362 us/op
[info] # Warmup Iteration  10: 8.150 us/op
[info] Iteration   1: 8.158 us/op
[info] Iteration   2: 8.119 us/op
[info] Iteration   3: 8.570 us/op
[info] Iteration   4: 8.258 us/op
[info] Iteration   5: 8.137 us/op
[info] Iteration   6: 8.151 us/op
[info] Iteration   7: 8.092 us/op
[info] Iteration   8: 8.361 us/op
[info] Iteration   9: 8.491 us/op
[info] Iteration  10: 8.125 us/op
[info] Iteration  11: 8.165 us/op
[info] Iteration  12: 8.177 us/op
[info] Iteration  13: 8.144 us/op
[info] Iteration  14: 8.398 us/op
[info] Iteration  15: 8.157 us/op
[info] Iteration  16: 8.118 us/op
[info] Iteration  17: 8.240 us/op
[info] Iteration  18: 8.179 us/op
[info] Iteration  19: 8.444 us/op
[info] Iteration  20: 8.117 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet":
[info]   8.230 ±(99.9%) 0.124 us/op [Average]
[info]   (min, avg, max) = (8.092, 8.230, 8.570), stdev = 0.142
[info]   CI (99.9%): [8.106, 8.354] (assumes normal distribution)
[info] # Run complete. Total time: 00:18:53
[info] REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on
[info] why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial
[info] experiments, perform baseline and negative tests that provide experimental control, make sure
[info] the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts.
[info] Do not assume the numbers tell you what you want them to tell.
[info] NOTE: Current JVM experimentally supports Compiler Blackholes, and they are in use. Please exercise
[info] extra caution when trusting the results, look into the generated code to check the benchmark still
[info] works, and factor in a small probability of new VM bugs. Additionally, while comparisons between
[info] different JVMs are already problematic, the performance difference caused by different Blackhole
[info] modes can be very significant. Please make sure you use the consistent Blackhole mode for comparisons.
[info] Benchmark                                                       Mode  Cnt    Score    Error  Units
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_Array            avgt   20   ≈ 10⁻³           us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet         avgt   20    2.864 ±  0.028  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet           avgt   20    3.616 ±  0.111  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet      avgt   20   12.343 ±  0.107  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_Set              avgt   20   53.748 ±  5.162  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet        avgt   20  675.804 ±  4.145  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_Array            avgt   20   72.037 ±  0.439  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet         avgt   20    0.906 ±  0.007  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet           avgt   20    2.812 ±  0.022  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet      avgt   20    6.426 ±  0.171  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_Set              avgt   20    9.149 ±  0.062  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet        avgt   20   19.106 ±  0.466  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array        avgt   20    4.675 ±  0.036  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet     avgt   20    0.824 ±  0.006  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet       avgt   20    2.567 ±  0.029  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet  avgt   20    6.869 ±  0.168  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set          avgt   20    6.456 ±  0.092  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet    avgt   20    8.465 ±  0.559  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_Array               avgt   20   ≈ 10⁻³           us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet            avgt   20    2.850 ±  0.035  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_BitSet              avgt   20    3.431 ±  0.033  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet         avgt   20   11.015 ±  0.124  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_Set                 avgt   20   58.255 ±  1.033  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet           avgt   20  672.738 ± 12.526  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_Array               avgt   20   71.145 ±  0.400  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet            avgt   20    0.888 ±  0.011  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_BitSet              avgt   20    3.108 ±  0.030  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet         avgt   20    5.915 ±  0.159  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_Set                 avgt   20    7.594 ±  0.035  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet           avgt   20   18.787 ±  0.315  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array           avgt   20    4.626 ±  0.063  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet        avgt   20    0.830 ±  0.013  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet          avgt   20    2.519 ±  0.028  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet     avgt   20    5.627 ±  0.078  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set             avgt   20    5.567 ±  0.092  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet       avgt   20    8.230 ±  0.124  us/op
[success] Total time: 1154 s (19:14), completed Nov 6, 2024, 11:36:50 AM
[info] welcome to sbt 1.10.1 (Eclipse Adoptium Java 21.0.4)
[info] loading settings for project global-plugins from metals.sbt,plugins.sbt ...
[info] loading global plugins from /home/gaelrenoux/.sbt/1.0/plugins
[info] loading settings for project public-scalaio2024-benchmarks-build from plugins.sbt ...
[info] loading project definition from /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/project
[success] Generated .bloop/public-scalaio2024-benchmarks-build.json
[success] Total time: 0 s, completed Nov 6, 2024, 11:36:57 AM
[info] loading settings for project public-scalaio2024-benchmarks from build.sbt ...
[info] set current project to scalaio2024-benchmarks (in build file:/home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/)
[info] running (fork) org.openjdk.jmh.generators.bytecode.JmhBytecodeGenerator /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/classes /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/src_managed/jmh /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/resource_managed/jmh default
[info] Processing 1377 classes from /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/classes with "reflection" generator
[info] Writing out Java source to /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/src_managed/jmh and resources to /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/target/scala-3.5.1/resource_managed/jmh
[info] running (fork) org.openjdk.jmh.Main -i 20 -wi 10 -f1 -t1 .*chapter3.SetBenchmark_.*Invoice_HalfHit_(VerySmall|Small|Large).*
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Array
[info] # Run progress: 0.00% complete, ETA 00:18:00
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: ≈ 10⁻³ us/op
[info] # Warmup Iteration   2: ≈ 10⁻³ us/op
[info] # Warmup Iteration   3: ≈ 10⁻³ us/op
[info] # Warmup Iteration   4: ≈ 10⁻³ us/op
[info] # Warmup Iteration   5: ≈ 10⁻³ us/op
[info] # Warmup Iteration   6: ≈ 10⁻³ us/op
[info] # Warmup Iteration   7: ≈ 10⁻³ us/op
[info] # Warmup Iteration   8: ≈ 10⁻³ us/op
[info] # Warmup Iteration   9: ≈ 10⁻³ us/op
[info] # Warmup Iteration  10: ≈ 10⁻³ us/op
[info] Iteration   1: ≈ 10⁻³ us/op
[info] Iteration   2: ≈ 10⁻³ us/op
[info] Iteration   3: ≈ 10⁻³ us/op
[info] Iteration   4: ≈ 10⁻³ us/op
[info] Iteration   5: ≈ 10⁻³ us/op
[info] Iteration   6: ≈ 10⁻³ us/op
[info] Iteration   7: ≈ 10⁻³ us/op
[info] Iteration   8: ≈ 10⁻³ us/op
[info] Iteration   9: ≈ 10⁻³ us/op
[info] Iteration  10: ≈ 10⁻³ us/op
[info] Iteration  11: ≈ 10⁻³ us/op
[info] Iteration  12: ≈ 10⁻³ us/op
[info] Iteration  13: ≈ 10⁻³ us/op
[info] Iteration  14: ≈ 10⁻³ us/op
[info] Iteration  15: ≈ 10⁻³ us/op
[info] Iteration  16: ≈ 10⁻³ us/op
[info] Iteration  17: ≈ 10⁻³ us/op
[info] Iteration  18: ≈ 10⁻³ us/op
[info] Iteration  19: ≈ 10⁻³ us/op
[info] Iteration  20: ≈ 10⁻³ us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Array":
[info]   ≈ 10⁻³ us/op
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet
[info] # Run progress: 2.78% complete, ETA 00:18:00
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2854691.413 us/op
[info] # Warmup Iteration   2: 3.089 us/op
[info] # Warmup Iteration   3: 2.802 us/op
[info] # Warmup Iteration   4: 2.807 us/op
[info] # Warmup Iteration   5: 2.812 us/op
[info] # Warmup Iteration   6: 2.767 us/op
[info] # Warmup Iteration   7: 2.830 us/op
[info] # Warmup Iteration   8: 2.811 us/op
[info] # Warmup Iteration   9: 2.813 us/op
[info] # Warmup Iteration  10: 2.789 us/op
[info] Iteration   1: 2.817 us/op
[info] Iteration   2: 2.856 us/op
[info] Iteration   3: 2.825 us/op
[info] Iteration   4: 2.883 us/op
[info] Iteration   5: 2.969 us/op
[info] Iteration   6: 2.817 us/op
[info] Iteration   7: 2.856 us/op
[info] Iteration   8: 2.818 us/op
[info] Iteration   9: 2.816 us/op
[info] Iteration  10: 2.807 us/op
[info] Iteration  11: 2.829 us/op
[info] Iteration  12: 2.848 us/op
[info] Iteration  13: 2.811 us/op
[info] Iteration  14: 2.840 us/op
[info] Iteration  15: 2.821 us/op
[info] Iteration  16: 2.813 us/op
[info] Iteration  17: 2.840 us/op
[info] Iteration  18: 2.802 us/op
[info] Iteration  19: 2.815 us/op
[info] Iteration  20: 2.821 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet":
[info]   2.835 ±(99.9%) 0.033 us/op [Average]
[info]   (min, avg, max) = (2.802, 2.835, 2.969), stdev = 0.037
[info]   CI (99.9%): [2.803, 2.868] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet
[info] # Run progress: 5.56% complete, ETA 00:18:00
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3002868.446 us/op
[info] # Warmup Iteration   2: 3.159 us/op
[info] # Warmup Iteration   3: 2.758 us/op
[info] # Warmup Iteration   4: 3.453 us/op
[info] # Warmup Iteration   5: 3.487 us/op
[info] # Warmup Iteration   6: 3.446 us/op
[info] # Warmup Iteration   7: 3.439 us/op
[info] # Warmup Iteration   8: 3.468 us/op
[info] # Warmup Iteration   9: 3.476 us/op
[info] # Warmup Iteration  10: 3.499 us/op
[info] Iteration   1: 3.442 us/op
[info] Iteration   2: 3.467 us/op
[info] Iteration   3: 3.438 us/op
[info] Iteration   4: 3.444 us/op
[info] Iteration   5: 3.486 us/op
[info] Iteration   6: 3.723 us/op
[info] Iteration   7: 3.444 us/op
[info] Iteration   8: 3.445 us/op
[info] Iteration   9: 3.465 us/op
[info] Iteration  10: 3.520 us/op
[info] Iteration  11: 3.445 us/op
[info] Iteration  12: 3.455 us/op
[info] Iteration  13: 3.444 us/op
[info] Iteration  14: 3.464 us/op
[info] Iteration  15: 3.487 us/op
[info] Iteration  16: 3.483 us/op
[info] Iteration  17: 3.462 us/op
[info] Iteration  18: 3.469 us/op
[info] Iteration  19: 3.473 us/op
[info] Iteration  20: 3.508 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet":
[info]   3.478 ±(99.9%) 0.054 us/op [Average]
[info]   (min, avg, max) = (3.438, 3.478, 3.723), stdev = 0.062
[info]   CI (99.9%): [3.424, 3.532] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet
[info] # Run progress: 8.33% complete, ETA 00:17:40
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3075163.913 us/op
[info] # Warmup Iteration   2: 12.525 us/op
[info] # Warmup Iteration   3: 12.046 us/op
[info] # Warmup Iteration   4: 12.296 us/op
[info] # Warmup Iteration   5: 12.075 us/op
[info] # Warmup Iteration   6: 12.085 us/op
[info] # Warmup Iteration   7: 12.330 us/op
[info] # Warmup Iteration   8: 12.165 us/op
[info] # Warmup Iteration   9: 12.317 us/op
[info] # Warmup Iteration  10: 12.104 us/op
[info] Iteration   1: 12.131 us/op
[info] Iteration   2: 12.114 us/op
[info] Iteration   3: 11.909 us/op
[info] Iteration   4: 12.099 us/op
[info] Iteration   5: 12.069 us/op
[info] Iteration   6: 12.209 us/op
[info] Iteration   7: 12.304 us/op
[info] Iteration   8: 12.782 us/op
[info] Iteration   9: 11.908 us/op
[info] Iteration  10: 12.207 us/op
[info] Iteration  11: 12.042 us/op
[info] Iteration  12: 12.331 us/op
[info] Iteration  13: 12.090 us/op
[info] Iteration  14: 12.105 us/op
[info] Iteration  15: 11.950 us/op
[info] Iteration  16: 12.120 us/op
[info] Iteration  17: 12.063 us/op
[info] Iteration  18: 12.293 us/op
[info] Iteration  19: 11.940 us/op
[info] Iteration  20: 12.003 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet":
[info]   12.133 ±(99.9%) 0.171 us/op [Average]
[info]   (min, avg, max) = (11.908, 12.133, 12.782), stdev = 0.197
[info]   CI (99.9%): [11.963, 12.304] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Set
[info] # Run progress: 11.11% complete, ETA 00:17:14
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2992269.784 us/op
[info] # Warmup Iteration   2: 50.534 us/op
[info] # Warmup Iteration   3: 47.244 us/op
[info] # Warmup Iteration   4: 48.847 us/op
[info] # Warmup Iteration   5: 48.359 us/op
[info] # Warmup Iteration   6: 48.621 us/op
[info] # Warmup Iteration   7: 47.900 us/op
[info] # Warmup Iteration   8: 47.495 us/op
[info] # Warmup Iteration   9: 48.085 us/op
[info] # Warmup Iteration  10: 47.153 us/op
[info] Iteration   1: 51.488 us/op
[info] Iteration   2: 48.054 us/op
[info] Iteration   3: 47.939 us/op
[info] Iteration   4: 48.545 us/op
[info] Iteration   5: 47.867 us/op
[info] Iteration   6: 47.767 us/op
[info] Iteration   7: 47.504 us/op
[info] Iteration   8: 47.914 us/op
[info] Iteration   9: 48.170 us/op
[info] Iteration  10: 47.303 us/op
[info] Iteration  11: 47.186 us/op
[info] Iteration  12: 47.345 us/op
[info] Iteration  13: 47.729 us/op
[info] Iteration  14: 48.732 us/op
[info] Iteration  15: 47.637 us/op
[info] Iteration  16: 47.687 us/op
[info] Iteration  17: 48.188 us/op
[info] Iteration  18: 47.428 us/op
[info] Iteration  19: 48.151 us/op
[info] Iteration  20: 47.622 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Set":
[info]   48.013 ±(99.9%) 0.791 us/op [Average]
[info]   (min, avg, max) = (47.186, 48.013, 51.488), stdev = 0.911
[info]   CI (99.9%): [47.222, 48.804] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet
[info] # Run progress: 13.89% complete, ETA 00:16:44
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 4580319.647 us/op
[info] # Warmup Iteration   2: 660.498 us/op
[info] # Warmup Iteration   3: 628.275 us/op
[info] # Warmup Iteration   4: 627.929 us/op
[info] # Warmup Iteration   5: 664.226 us/op
[info] # Warmup Iteration   6: 661.201 us/op
[info] # Warmup Iteration   7: 665.895 us/op
[info] # Warmup Iteration   8: 662.622 us/op
[info] # Warmup Iteration   9: 669.976 us/op
[info] # Warmup Iteration  10: 676.708 us/op
[info] Iteration   1: 671.058 us/op
[info] Iteration   2: 661.562 us/op
[info] Iteration   3: 664.773 us/op
[info] Iteration   4: 664.072 us/op
[info] Iteration   5: 670.435 us/op
[info] Iteration   6: 661.324 us/op
[info] Iteration   7: 660.779 us/op
[info] Iteration   8: 659.543 us/op
[info] Iteration   9: 663.203 us/op
[info] Iteration  10: 673.219 us/op
[info] Iteration  11: 661.489 us/op
[info] Iteration  12: 659.501 us/op
[info] Iteration  13: 659.132 us/op
[info] Iteration  14: 657.716 us/op
[info] Iteration  15: 671.782 us/op
[info] Iteration  16: 658.227 us/op
[info] Iteration  17: 657.098 us/op
[info] Iteration  18: 655.668 us/op
[info] Iteration  19: 670.284 us/op
[info] Iteration  20: 667.132 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet":
[info]   663.400 ±(99.9%) 4.729 us/op [Average]
[info]   (min, avg, max) = (655.668, 663.400, 673.219), stdev = 5.446
[info]   CI (99.9%): [658.671, 668.129] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Array
[info] # Run progress: 16.67% complete, ETA 00:16:22
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1144584.880 us/op
[info] # Warmup Iteration   2: 83.039 us/op
[info] # Warmup Iteration   3: 97.956 us/op
[info] # Warmup Iteration   4: 79.454 us/op
[info] # Warmup Iteration   5: 111.756 us/op
[info] # Warmup Iteration   6: 106.589 us/op
[info] # Warmup Iteration   7: 74.057 us/op
[info] # Warmup Iteration   8: 73.200 us/op
[info] # Warmup Iteration   9: 73.154 us/op
[info] # Warmup Iteration  10: 76.924 us/op
[info] Iteration   1: 75.612 us/op
[info] Iteration   2: 77.730 us/op
[info] Iteration   3: 74.468 us/op
[info] Iteration   4: 77.453 us/op
[info] Iteration   5: 76.446 us/op
[info] Iteration   6: 74.584 us/op
[info] Iteration   7: 72.944 us/op
[info] Iteration   8: 73.326 us/op
[info] Iteration   9: 73.694 us/op
[info] Iteration  10: 73.862 us/op
[info] Iteration  11: 72.887 us/op
[info] Iteration  12: 72.718 us/op
[info] Iteration  13: 72.254 us/op
[info] Iteration  14: 76.645 us/op
[info] Iteration  15: 72.520 us/op
[info] Iteration  16: 72.733 us/op
[info] Iteration  17: 72.711 us/op
[info] Iteration  18: 72.295 us/op
[info] Iteration  19: 73.261 us/op
[info] Iteration  20: 72.186 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Array":
[info]   74.017 ±(99.9%) 1.566 us/op [Average]
[info]   (min, avg, max) = (72.186, 74.017, 77.730), stdev = 1.803
[info]   CI (99.9%): [72.451, 75.582] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet
[info] # Run progress: 19.44% complete, ETA 00:15:42
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1065008.491 us/op
[info] # Warmup Iteration   2: 1.141 us/op
[info] # Warmup Iteration   3: 1.158 us/op
[info] # Warmup Iteration   4: 0.880 us/op
[info] # Warmup Iteration   5: 0.864 us/op
[info] # Warmup Iteration   6: 0.865 us/op
[info] # Warmup Iteration   7: 0.867 us/op
[info] # Warmup Iteration   8: 0.891 us/op
[info] # Warmup Iteration   9: 0.868 us/op
[info] # Warmup Iteration  10: 0.865 us/op
[info] Iteration   1: 0.865 us/op
[info] Iteration   2: 0.871 us/op
[info] Iteration   3: 0.897 us/op
[info] Iteration   4: 0.888 us/op
[info] Iteration   5: 0.883 us/op
[info] Iteration   6: 0.889 us/op
[info] Iteration   7: 0.889 us/op
[info] Iteration   8: 0.892 us/op
[info] Iteration   9: 0.880 us/op
[info] Iteration  10: 0.882 us/op
[info] Iteration  11: 0.874 us/op
[info] Iteration  12: 0.868 us/op
[info] Iteration  13: 0.895 us/op
[info] Iteration  14: 0.879 us/op
[info] Iteration  15: 0.873 us/op
[info] Iteration  16: 0.869 us/op
[info] Iteration  17: 0.892 us/op
[info] Iteration  18: 0.894 us/op
[info] Iteration  19: 0.894 us/op
[info] Iteration  20: 0.876 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet":
[info]   0.883 ±(99.9%) 0.009 us/op [Average]
[info]   (min, avg, max) = (0.865, 0.883, 0.897), stdev = 0.010
[info]   CI (99.9%): [0.874, 0.891] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet
[info] # Run progress: 22.22% complete, ETA 00:15:04
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1101234.118 us/op
[info] # Warmup Iteration   2: 2.855 us/op
[info] # Warmup Iteration   3: 2.724 us/op
[info] # Warmup Iteration   4: 3.123 us/op
[info] # Warmup Iteration   5: 3.133 us/op
[info] # Warmup Iteration   6: 3.127 us/op
[info] # Warmup Iteration   7: 3.152 us/op
[info] # Warmup Iteration   8: 3.128 us/op
[info] # Warmup Iteration   9: 3.176 us/op
[info] # Warmup Iteration  10: 3.137 us/op
[info] Iteration   1: 3.125 us/op
[info] Iteration   2: 3.197 us/op
[info] Iteration   3: 3.157 us/op
[info] Iteration   4: 3.150 us/op
[info] Iteration   5: 3.110 us/op
[info] Iteration   6: 3.135 us/op
[info] Iteration   7: 3.187 us/op
[info] Iteration   8: 3.196 us/op
[info] Iteration   9: 3.120 us/op
[info] Iteration  10: 3.119 us/op
[info] Iteration  11: 3.165 us/op
[info] Iteration  12: 3.171 us/op
[info] Iteration  13: 3.130 us/op
[info] Iteration  14: 3.133 us/op
[info] Iteration  15: 3.133 us/op
[info] Iteration  16: 3.089 us/op
[info] Iteration  17: 3.164 us/op
[info] Iteration  18: 3.086 us/op
[info] Iteration  19: 3.147 us/op
[info] Iteration  20: 3.081 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet":
[info]   3.140 ±(99.9%) 0.030 us/op [Average]
[info]   (min, avg, max) = (3.081, 3.140, 3.197), stdev = 0.034
[info]   CI (99.9%): [3.110, 3.170] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet
[info] # Run progress: 25.00% complete, ETA 00:14:27
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 169.819 us/op
[info] # Warmup Iteration   2: 6.740 us/op
[info] # Warmup Iteration   3: 6.646 us/op
[info] # Warmup Iteration   4: 6.609 us/op
[info] # Warmup Iteration   5: 6.604 us/op
[info] # Warmup Iteration   6: 6.782 us/op
[info] # Warmup Iteration   7: 6.634 us/op
[info] # Warmup Iteration   8: 6.637 us/op
[info] # Warmup Iteration   9: 6.570 us/op
[info] # Warmup Iteration  10: 6.635 us/op
[info] Iteration   1: 6.659 us/op
[info] Iteration   2: 6.631 us/op
[info] Iteration   3: 6.604 us/op
[info] Iteration   4: 6.630 us/op
[info] Iteration   5: 6.618 us/op
[info] Iteration   6: 6.695 us/op
[info] Iteration   7: 6.584 us/op
[info] Iteration   8: 6.682 us/op
[info] Iteration   9: 6.559 us/op
[info] Iteration  10: 6.591 us/op
[info] Iteration  11: 6.717 us/op
[info] Iteration  12: 6.709 us/op
[info] Iteration  13: 6.351 us/op
[info] Iteration  14: 6.449 us/op
[info] Iteration  15: 6.356 us/op
[info] Iteration  16: 6.506 us/op
[info] Iteration  17: 6.372 us/op
[info] Iteration  18: 6.407 us/op
[info] Iteration  19: 6.364 us/op
[info] Iteration  20: 6.363 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet":
[info]   6.542 ±(99.9%) 0.116 us/op [Average]
[info]   (min, avg, max) = (6.351, 6.542, 6.717), stdev = 0.133
[info]   CI (99.9%): [6.427, 6.658] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Set
[info] # Run progress: 27.78% complete, ETA 00:13:52
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1076911.211 us/op
[info] # Warmup Iteration   2: 9.961 us/op
[info] # Warmup Iteration   3: 9.133 us/op
[info] # Warmup Iteration   4: 9.159 us/op
[info] # Warmup Iteration   5: 9.389 us/op
[info] # Warmup Iteration   6: 9.100 us/op
[info] # Warmup Iteration   7: 9.063 us/op
[info] # Warmup Iteration   8: 9.133 us/op
[info] # Warmup Iteration   9: 9.122 us/op
[info] # Warmup Iteration  10: 9.221 us/op
[info] Iteration   1: 9.305 us/op
[info] Iteration   2: 9.200 us/op
[info] Iteration   3: 9.162 us/op
[info] Iteration   4: 9.070 us/op
[info] Iteration   5: 9.220 us/op
[info] Iteration   6: 9.188 us/op
[info] Iteration   7: 9.083 us/op
[info] Iteration   8: 9.123 us/op
[info] Iteration   9: 9.157 us/op
[info] Iteration  10: 9.252 us/op
[info] Iteration  11: 9.080 us/op
[info] Iteration  12: 9.078 us/op
[info] Iteration  13: 9.080 us/op
[info] Iteration  14: 9.105 us/op
[info] Iteration  15: 9.324 us/op
[info] Iteration  16: 9.088 us/op
[info] Iteration  17: 9.083 us/op
[info] Iteration  18: 9.194 us/op
[info] Iteration  19: 9.058 us/op
[info] Iteration  20: 9.198 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Set":
[info]   9.152 ±(99.9%) 0.070 us/op [Average]
[info]   (min, avg, max) = (9.058, 9.152, 9.324), stdev = 0.081
[info]   CI (99.9%): [9.082, 9.222] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet
[info] # Run progress: 30.56% complete, ETA 00:13:17
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1085878.865 us/op
[info] # Warmup Iteration   2: 18.815 us/op
[info] # Warmup Iteration   3: 18.974 us/op
[info] # Warmup Iteration   4: 18.690 us/op
[info] # Warmup Iteration   5: 18.855 us/op
[info] # Warmup Iteration   6: 18.794 us/op
[info] # Warmup Iteration   7: 18.794 us/op
[info] # Warmup Iteration   8: 19.211 us/op
[info] # Warmup Iteration   9: 18.972 us/op
[info] # Warmup Iteration  10: 18.560 us/op
[info] Iteration   1: 18.636 us/op
[info] Iteration   2: 18.614 us/op
[info] Iteration   3: 18.768 us/op
[info] Iteration   4: 19.031 us/op
[info] Iteration   5: 18.465 us/op
[info] Iteration   6: 18.617 us/op
[info] Iteration   7: 18.604 us/op
[info] Iteration   8: 18.596 us/op
[info] Iteration   9: 18.944 us/op
[info] Iteration  10: 18.766 us/op
[info] Iteration  11: 18.660 us/op
[info] Iteration  12: 18.939 us/op
[info] Iteration  13: 18.648 us/op
[info] Iteration  14: 18.824 us/op
[info] Iteration  15: 19.134 us/op
[info] Iteration  16: 18.720 us/op
[info] Iteration  17: 18.748 us/op
[info] Iteration  18: 18.796 us/op
[info] Iteration  19: 18.955 us/op
[info] Iteration  20: 18.805 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet":
[info]   18.764 ±(99.9%) 0.147 us/op [Average]
[info]   (min, avg, max) = (18.465, 18.764, 19.134), stdev = 0.169
[info]   CI (99.9%): [18.617, 18.910] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array
[info] # Run progress: 33.33% complete, ETA 00:12:43
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1073951.816 us/op
[info] # Warmup Iteration   2: 5.010 us/op
[info] # Warmup Iteration   3: 4.808 us/op
[info] # Warmup Iteration   4: 4.700 us/op
[info] # Warmup Iteration   5: 4.677 us/op
[info] # Warmup Iteration   6: 4.691 us/op
[info] # Warmup Iteration   7: 4.663 us/op
[info] # Warmup Iteration   8: 4.733 us/op
[info] # Warmup Iteration   9: 4.791 us/op
[info] # Warmup Iteration  10: 4.732 us/op
[info] Iteration   1: 4.685 us/op
[info] Iteration   2: 4.685 us/op
[info] Iteration   3: 4.735 us/op
[info] Iteration   4: 4.725 us/op
[info] Iteration   5: 4.607 us/op
[info] Iteration   6: 4.638 us/op
[info] Iteration   7: 4.622 us/op
[info] Iteration   8: 4.705 us/op
[info] Iteration   9: 4.647 us/op
[info] Iteration  10: 4.630 us/op
[info] Iteration  11: 4.612 us/op
[info] Iteration  12: 4.648 us/op
[info] Iteration  13: 4.750 us/op
[info] Iteration  14: 4.645 us/op
[info] Iteration  15: 4.639 us/op
[info] Iteration  16: 4.623 us/op
[info] Iteration  17: 4.762 us/op
[info] Iteration  18: 4.695 us/op
[info] Iteration  19: 4.637 us/op
[info] Iteration  20: 4.628 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array":
[info]   4.666 ±(99.9%) 0.042 us/op [Average]
[info]   (min, avg, max) = (4.607, 4.666, 4.762), stdev = 0.048
[info]   CI (99.9%): [4.624, 4.708] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet
[info] # Run progress: 36.11% complete, ETA 00:12:10
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1087067.215 us/op
[info] # Warmup Iteration   2: 1.132 us/op
[info] # Warmup Iteration   3: 1.096 us/op
[info] # Warmup Iteration   4: 0.834 us/op
[info] # Warmup Iteration   5: 0.826 us/op
[info] # Warmup Iteration   6: 0.823 us/op
[info] # Warmup Iteration   7: 0.823 us/op
[info] # Warmup Iteration   8: 0.852 us/op
[info] # Warmup Iteration   9: 0.837 us/op
[info] # Warmup Iteration  10: 0.838 us/op
[info] Iteration   1: 0.837 us/op
[info] Iteration   2: 0.828 us/op
[info] Iteration   3: 0.842 us/op
[info] Iteration   4: 0.821 us/op
[info] Iteration   5: 0.830 us/op
[info] Iteration   6: 0.836 us/op
[info] Iteration   7: 0.835 us/op
[info] Iteration   8: 0.851 us/op
[info] Iteration   9: 0.836 us/op
[info] Iteration  10: 0.838 us/op
[info] Iteration  11: 0.821 us/op
[info] Iteration  12: 0.836 us/op
[info] Iteration  13: 0.847 us/op
[info] Iteration  14: 0.836 us/op
[info] Iteration  15: 0.833 us/op
[info] Iteration  16: 0.833 us/op
[info] Iteration  17: 0.842 us/op
[info] Iteration  18: 0.837 us/op
[info] Iteration  19: 0.836 us/op
[info] Iteration  20: 0.814 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet":
[info]   0.834 ±(99.9%) 0.007 us/op [Average]
[info]   (min, avg, max) = (0.814, 0.834, 0.851), stdev = 0.009
[info]   CI (99.9%): [0.827, 0.842] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet
[info] # Run progress: 38.89% complete, ETA 00:11:37
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 70.272 us/op
[info] # Warmup Iteration   2: 1.974 us/op
[info] # Warmup Iteration   3: 2.180 us/op
[info] # Warmup Iteration   4: 2.534 us/op
[info] # Warmup Iteration   5: 2.543 us/op
[info] # Warmup Iteration   6: 2.514 us/op
[info] # Warmup Iteration   7: 2.556 us/op
[info] # Warmup Iteration   8: 2.565 us/op
[info] # Warmup Iteration   9: 2.622 us/op
[info] # Warmup Iteration  10: 2.521 us/op
[info] Iteration   1: 2.563 us/op
[info] Iteration   2: 2.557 us/op
[info] Iteration   3: 2.562 us/op
[info] Iteration   4: 2.538 us/op
[info] Iteration   5: 2.521 us/op
[info] Iteration   6: 2.552 us/op
[info] Iteration   7: 2.594 us/op
[info] Iteration   8: 2.526 us/op
[info] Iteration   9: 2.532 us/op
[info] Iteration  10: 2.533 us/op
[info] Iteration  11: 2.549 us/op
[info] Iteration  12: 2.571 us/op
[info] Iteration  13: 2.543 us/op
[info] Iteration  14: 2.527 us/op
[info] Iteration  15: 2.538 us/op
[info] Iteration  16: 2.552 us/op
[info] Iteration  17: 2.561 us/op
[info] Iteration  18: 2.540 us/op
[info] Iteration  19: 2.544 us/op
[info] Iteration  20: 2.526 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet":
[info]   2.546 ±(99.9%) 0.016 us/op [Average]
[info]   (min, avg, max) = (2.521, 2.546, 2.594), stdev = 0.018
[info]   CI (99.9%): [2.531, 2.562] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet
[info] # Run progress: 41.67% complete, ETA 00:11:04
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1070656.673 us/op
[info] # Warmup Iteration   2: 7.222 us/op
[info] # Warmup Iteration   3: 6.934 us/op
[info] # Warmup Iteration   4: 6.830 us/op
[info] # Warmup Iteration   5: 6.843 us/op
[info] # Warmup Iteration   6: 6.962 us/op
[info] # Warmup Iteration   7: 6.919 us/op
[info] # Warmup Iteration   8: 6.879 us/op
[info] # Warmup Iteration   9: 6.866 us/op
[info] # Warmup Iteration  10: 6.925 us/op
[info] Iteration   1: 7.020 us/op
[info] Iteration   2: 6.894 us/op
[info] Iteration   3: 6.920 us/op
[info] Iteration   4: 6.873 us/op
[info] Iteration   5: 6.897 us/op
[info] Iteration   6: 7.183 us/op
[info] Iteration   7: 6.863 us/op
[info] Iteration   8: 6.875 us/op
[info] Iteration   9: 6.918 us/op
[info] Iteration  10: 6.883 us/op
[info] Iteration  11: 7.015 us/op
[info] Iteration  12: 6.877 us/op
[info] Iteration  13: 6.934 us/op
[info] Iteration  14: 6.524 us/op
[info] Iteration  15: 6.517 us/op
[info] Iteration  16: 6.646 us/op
[info] Iteration  17: 6.561 us/op
[info] Iteration  18: 6.519 us/op
[info] Iteration  19: 6.505 us/op
[info] Iteration  20: 6.528 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet":
[info]   6.798 ±(99.9%) 0.179 us/op [Average]
[info]   (min, avg, max) = (6.505, 6.798, 7.183), stdev = 0.207
[info]   CI (99.9%): [6.618, 6.977] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set
[info] # Run progress: 44.44% complete, ETA 00:10:31
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 117.119 us/op
[info] # Warmup Iteration   2: 6.617 us/op
[info] # Warmup Iteration   3: 6.490 us/op
[info] # Warmup Iteration   4: 6.469 us/op
[info] # Warmup Iteration   5: 6.525 us/op
[info] # Warmup Iteration   6: 6.465 us/op
[info] # Warmup Iteration   7: 6.490 us/op
[info] # Warmup Iteration   8: 6.478 us/op
[info] # Warmup Iteration   9: 6.473 us/op
[info] # Warmup Iteration  10: 6.582 us/op
[info] Iteration   1: 6.480 us/op
[info] Iteration   2: 6.487 us/op
[info] Iteration   3: 6.430 us/op
[info] Iteration   4: 6.446 us/op
[info] Iteration   5: 6.550 us/op
[info] Iteration   6: 6.473 us/op
[info] Iteration   7: 6.430 us/op
[info] Iteration   8: 6.428 us/op
[info] Iteration   9: 6.473 us/op
[info] Iteration  10: 6.564 us/op
[info] Iteration  11: 6.462 us/op
[info] Iteration  12: 6.384 us/op
[info] Iteration  13: 6.142 us/op
[info] Iteration  14: 6.225 us/op
[info] Iteration  15: 6.201 us/op
[info] Iteration  16: 6.206 us/op
[info] Iteration  17: 6.130 us/op
[info] Iteration  18: 6.188 us/op
[info] Iteration  19: 6.177 us/op
[info] Iteration  20: 6.243 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set":
[info]   6.356 ±(99.9%) 0.128 us/op [Average]
[info]   (min, avg, max) = (6.130, 6.356, 6.564), stdev = 0.147
[info]   CI (99.9%): [6.228, 6.484] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet
[info] # Run progress: 47.22% complete, ETA 00:09:59
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1080595.431 us/op
[info] # Warmup Iteration   2: 8.716 us/op
[info] # Warmup Iteration   3: 7.604 us/op
[info] # Warmup Iteration   4: 8.376 us/op
[info] # Warmup Iteration   5: 8.267 us/op
[info] # Warmup Iteration   6: 8.261 us/op
[info] # Warmup Iteration   7: 8.484 us/op
[info] # Warmup Iteration   8: 8.227 us/op
[info] # Warmup Iteration   9: 8.389 us/op
[info] # Warmup Iteration  10: 8.305 us/op
[info] Iteration   1: 8.289 us/op
[info] Iteration   2: 8.107 us/op
[info] Iteration   3: 8.105 us/op
[info] Iteration   4: 8.587 us/op
[info] Iteration   5: 8.517 us/op
[info] Iteration   6: 8.405 us/op
[info] Iteration   7: 8.216 us/op
[info] Iteration   8: 8.202 us/op
[info] Iteration   9: 8.435 us/op
[info] Iteration  10: 8.203 us/op
[info] Iteration  11: 8.273 us/op
[info] Iteration  12: 8.242 us/op
[info] Iteration  13: 8.263 us/op
[info] Iteration  14: 8.284 us/op
[info] Iteration  15: 8.303 us/op
[info] Iteration  16: 8.212 us/op
[info] Iteration  17: 8.276 us/op
[info] Iteration  18: 8.348 us/op
[info] Iteration  19: 8.255 us/op
[info] Iteration  20: 8.087 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet":
[info]   8.280 ±(99.9%) 0.112 us/op [Average]
[info]   (min, avg, max) = (8.087, 8.280, 8.587), stdev = 0.129
[info]   CI (99.9%): [8.168, 8.392] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Array
[info] # Run progress: 50.00% complete, ETA 00:09:27
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: ≈ 10⁻³ us/op
[info] # Warmup Iteration   2: ≈ 10⁻³ us/op
[info] # Warmup Iteration   3: ≈ 10⁻³ us/op
[info] # Warmup Iteration   4: ≈ 10⁻³ us/op
[info] # Warmup Iteration   5: ≈ 10⁻³ us/op
[info] # Warmup Iteration   6: ≈ 10⁻³ us/op
[info] # Warmup Iteration   7: ≈ 10⁻³ us/op
[info] # Warmup Iteration   8: ≈ 10⁻³ us/op
[info] # Warmup Iteration   9: ≈ 10⁻³ us/op
[info] # Warmup Iteration  10: ≈ 10⁻³ us/op
[info] Iteration   1: ≈ 10⁻³ us/op
[info] Iteration   2: ≈ 10⁻³ us/op
[info] Iteration   3: ≈ 10⁻³ us/op
[info] Iteration   4: ≈ 10⁻³ us/op
[info] Iteration   5: ≈ 10⁻³ us/op
[info] Iteration   6: ≈ 10⁻³ us/op
[info] Iteration   7: ≈ 10⁻³ us/op
[info] Iteration   8: ≈ 10⁻³ us/op
[info] Iteration   9: ≈ 10⁻³ us/op
[info] Iteration  10: ≈ 10⁻³ us/op
[info] Iteration  11: ≈ 10⁻³ us/op
[info] Iteration  12: ≈ 10⁻³ us/op
[info] Iteration  13: ≈ 10⁻³ us/op
[info] Iteration  14: ≈ 10⁻³ us/op
[info] Iteration  15: ≈ 10⁻³ us/op
[info] Iteration  16: ≈ 10⁻³ us/op
[info] Iteration  17: ≈ 10⁻³ us/op
[info] Iteration  18: ≈ 10⁻³ us/op
[info] Iteration  19: ≈ 10⁻³ us/op
[info] Iteration  20: ≈ 10⁻³ us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Array":
[info]   ≈ 10⁻³ us/op
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet
[info] # Run progress: 52.78% complete, ETA 00:08:55
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3048523.628 us/op
[info] # Warmup Iteration   2: 2.997 us/op
[info] # Warmup Iteration   3: 2.834 us/op
[info] # Warmup Iteration   4: 2.846 us/op
[info] # Warmup Iteration   5: 2.840 us/op
[info] # Warmup Iteration   6: 2.898 us/op
[info] # Warmup Iteration   7: 2.831 us/op
[info] # Warmup Iteration   8: 2.833 us/op
[info] # Warmup Iteration   9: 2.842 us/op
[info] # Warmup Iteration  10: 2.854 us/op
[info] Iteration   1: 2.878 us/op
[info] Iteration   2: 2.860 us/op
[info] Iteration   3: 2.858 us/op
[info] Iteration   4: 2.871 us/op
[info] Iteration   5: 2.884 us/op
[info] Iteration   6: 2.881 us/op
[info] Iteration   7: 2.815 us/op
[info] Iteration   8: 2.870 us/op
[info] Iteration   9: 2.826 us/op
[info] Iteration  10: 2.851 us/op
[info] Iteration  11: 2.836 us/op
[info] Iteration  12: 2.930 us/op
[info] Iteration  13: 2.830 us/op
[info] Iteration  14: 2.844 us/op
[info] Iteration  15: 2.840 us/op
[info] Iteration  16: 2.904 us/op
[info] Iteration  17: 2.878 us/op
[info] Iteration  18: 2.863 us/op
[info] Iteration  19: 2.851 us/op
[info] Iteration  20: 2.867 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet":
[info]   2.862 ±(99.9%) 0.024 us/op [Average]
[info]   (min, avg, max) = (2.815, 2.862, 2.930), stdev = 0.027
[info]   CI (99.9%): [2.838, 2.886] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_BitSet
[info] # Run progress: 55.56% complete, ETA 00:08:24
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2986585.816 us/op
[info] # Warmup Iteration   2: 3.213 us/op
[info] # Warmup Iteration   3: 2.834 us/op
[info] # Warmup Iteration   4: 3.421 us/op
[info] # Warmup Iteration   5: 3.417 us/op
[info] # Warmup Iteration   6: 3.455 us/op
[info] # Warmup Iteration   7: 3.422 us/op
[info] # Warmup Iteration   8: 3.478 us/op
[info] # Warmup Iteration   9: 3.433 us/op
[info] # Warmup Iteration  10: 3.439 us/op
[info] Iteration   1: 3.432 us/op
[info] Iteration   2: 3.434 us/op
[info] Iteration   3: 3.469 us/op
[info] Iteration   4: 3.455 us/op
[info] Iteration   5: 3.445 us/op
[info] Iteration   6: 3.419 us/op
[info] Iteration   7: 3.421 us/op
[info] Iteration   8: 3.510 us/op
[info] Iteration   9: 3.450 us/op
[info] Iteration  10: 3.435 us/op
[info] Iteration  11: 3.415 us/op
[info] Iteration  12: 3.446 us/op
[info] Iteration  13: 3.466 us/op
[info] Iteration  14: 3.426 us/op
[info] Iteration  15: 3.414 us/op
[info] Iteration  16: 3.442 us/op
[info] Iteration  17: 3.417 us/op
[info] Iteration  18: 3.461 us/op
[info] Iteration  19: 3.424 us/op
[info] Iteration  20: 3.462 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_BitSet":
[info]   3.442 ±(99.9%) 0.021 us/op [Average]
[info]   (min, avg, max) = (3.414, 3.442, 3.510), stdev = 0.024
[info]   CI (99.9%): [3.421, 3.463] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet
[info] # Run progress: 58.33% complete, ETA 00:07:54
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3090417.093 us/op
[info] # Warmup Iteration   2: 11.605 us/op
[info] # Warmup Iteration   3: 11.262 us/op
[info] # Warmup Iteration   4: 11.388 us/op
[info] # Warmup Iteration   5: 11.570 us/op
[info] # Warmup Iteration   6: 11.450 us/op
[info] # Warmup Iteration   7: 11.286 us/op
[info] # Warmup Iteration   8: 11.300 us/op
[info] # Warmup Iteration   9: 11.373 us/op
[info] # Warmup Iteration  10: 11.307 us/op
[info] Iteration   1: 11.293 us/op
[info] Iteration   2: 11.368 us/op
[info] Iteration   3: 11.323 us/op
[info] Iteration   4: 11.311 us/op
[info] Iteration   5: 11.450 us/op
[info] Iteration   6: 11.394 us/op
[info] Iteration   7: 11.362 us/op
[info] Iteration   8: 11.392 us/op
[info] Iteration   9: 11.433 us/op
[info] Iteration  10: 11.575 us/op
[info] Iteration  11: 11.330 us/op
[info] Iteration  12: 11.375 us/op
[info] Iteration  13: 11.386 us/op
[info] Iteration  14: 11.340 us/op
[info] Iteration  15: 11.427 us/op
[info] Iteration  16: 11.426 us/op
[info] Iteration  17: 11.353 us/op
[info] Iteration  18: 11.400 us/op
[info] Iteration  19: 11.479 us/op
[info] Iteration  20: 11.496 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet":
[info]   11.396 ±(99.9%) 0.060 us/op [Average]
[info]   (min, avg, max) = (11.293, 11.396, 11.575), stdev = 0.069
[info]   CI (99.9%): [11.336, 11.455] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Set
[info] # Run progress: 61.11% complete, ETA 00:07:23
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2812344.705 us/op
[info] # Warmup Iteration   2: 63.478 us/op
[info] # Warmup Iteration   3: 61.218 us/op
[info] # Warmup Iteration   4: 62.153 us/op
[info] # Warmup Iteration   5: 60.056 us/op
[info] # Warmup Iteration   6: 61.883 us/op
[info] # Warmup Iteration   7: 62.622 us/op
[info] # Warmup Iteration   8: 61.747 us/op
[info] # Warmup Iteration   9: 59.347 us/op
[info] # Warmup Iteration  10: 59.197 us/op
[info] Iteration   1: 58.379 us/op
[info] Iteration   2: 59.734 us/op
[info] Iteration   3: 59.727 us/op
[info] Iteration   4: 59.096 us/op
[info] Iteration   5: 59.860 us/op
[info] Iteration   6: 59.866 us/op
[info] Iteration   7: 60.570 us/op
[info] Iteration   8: 59.538 us/op
[info] Iteration   9: 59.929 us/op
[info] Iteration  10: 60.069 us/op
[info] Iteration  11: 60.553 us/op
[info] Iteration  12: 60.378 us/op
[info] Iteration  13: 59.184 us/op
[info] Iteration  14: 59.933 us/op
[info] Iteration  15: 60.480 us/op
[info] Iteration  16: 59.903 us/op
[info] Iteration  17: 60.018 us/op
[info] Iteration  18: 59.761 us/op
[info] Iteration  19: 60.377 us/op
[info] Iteration  20: 59.492 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Set":
[info]   59.842 ±(99.9%) 0.467 us/op [Average]
[info]   (min, avg, max) = (58.379, 59.842, 60.570), stdev = 0.538
[info]   CI (99.9%): [59.375, 60.309] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet
[info] # Run progress: 63.89% complete, ETA 00:06:52
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 4382736.101 us/op
[info] # Warmup Iteration   2: 666.558 us/op
[info] # Warmup Iteration   3: 641.096 us/op
[info] # Warmup Iteration   4: 629.494 us/op
[info] # Warmup Iteration   5: 646.404 us/op
[info] # Warmup Iteration   6: 657.850 us/op
[info] # Warmup Iteration   7: 658.865 us/op
[info] # Warmup Iteration   8: 665.717 us/op
[info] # Warmup Iteration   9: 660.920 us/op
[info] # Warmup Iteration  10: 658.825 us/op
[info] Iteration   1: 657.839 us/op
[info] Iteration   2: 662.534 us/op
[info] Iteration   3: 669.505 us/op
[info] Iteration   4: 657.863 us/op
[info] Iteration   5: 662.076 us/op
[info] Iteration   6: 659.075 us/op
[info] Iteration   7: 658.491 us/op
[info] Iteration   8: 673.793 us/op
[info] Iteration   9: 670.039 us/op
[info] Iteration  10: 656.408 us/op
[info] Iteration  11: 660.959 us/op
[info] Iteration  12: 663.488 us/op
[info] Iteration  13: 671.090 us/op
[info] Iteration  14: 660.044 us/op
[info] Iteration  15: 665.656 us/op
[info] Iteration  16: 657.970 us/op
[info] Iteration  17: 667.767 us/op
[info] Iteration  18: 668.214 us/op
[info] Iteration  19: 659.991 us/op
[info] Iteration  20: 659.667 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet":
[info]   663.123 ±(99.9%) 4.553 us/op [Average]
[info]   (min, avg, max) = (656.408, 663.123, 673.793), stdev = 5.243
[info]   CI (99.9%): [658.570, 667.677] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Array
[info] # Run progress: 66.67% complete, ETA 00:06:21
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1099251.386 us/op
[info] # Warmup Iteration   2: 77.082 us/op
[info] # Warmup Iteration   3: 72.946 us/op
[info] # Warmup Iteration   4: 72.843 us/op
[info] # Warmup Iteration   5: 72.645 us/op
[info] # Warmup Iteration   6: 72.679 us/op
[info] # Warmup Iteration   7: 73.489 us/op
[info] # Warmup Iteration   8: 73.288 us/op
[info] # Warmup Iteration   9: 72.693 us/op
[info] # Warmup Iteration  10: 72.996 us/op
[info] Iteration   1: 72.430 us/op
[info] Iteration   2: 73.639 us/op
[info] Iteration   3: 72.591 us/op
[info] Iteration   4: 72.689 us/op
[info] Iteration   5: 72.060 us/op
[info] Iteration   6: 72.688 us/op
[info] Iteration   7: 73.528 us/op
[info] Iteration   8: 72.119 us/op
[info] Iteration   9: 72.361 us/op
[info] Iteration  10: 72.406 us/op
[info] Iteration  11: 73.170 us/op
[info] Iteration  12: 73.219 us/op
[info] Iteration  13: 73.013 us/op
[info] Iteration  14: 72.401 us/op
[info] Iteration  15: 72.708 us/op
[info] Iteration  16: 72.468 us/op
[info] Iteration  17: 72.972 us/op
[info] Iteration  18: 73.107 us/op
[info] Iteration  19: 72.798 us/op
[info] Iteration  20: 72.576 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Array":
[info]   72.747 ±(99.9%) 0.375 us/op [Average]
[info]   (min, avg, max) = (72.060, 72.747, 73.639), stdev = 0.432
[info]   CI (99.9%): [72.372, 73.123] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet
[info] # Run progress: 69.44% complete, ETA 00:05:49
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1070122.233 us/op
[info] # Warmup Iteration   2: 1.159 us/op
[info] # Warmup Iteration   3: 1.128 us/op
[info] # Warmup Iteration   4: 0.863 us/op
[info] # Warmup Iteration   5: 0.868 us/op
[info] # Warmup Iteration   6: 0.858 us/op
[info] # Warmup Iteration   7: 0.848 us/op
[info] # Warmup Iteration   8: 0.854 us/op
[info] # Warmup Iteration   9: 0.875 us/op
[info] # Warmup Iteration  10: 0.870 us/op
[info] Iteration   1: 0.860 us/op
[info] Iteration   2: 0.858 us/op
[info] Iteration   3: 0.855 us/op
[info] Iteration   4: 0.867 us/op
[info] Iteration   5: 0.852 us/op
[info] Iteration   6: 0.874 us/op
[info] Iteration   7: 0.865 us/op
[info] Iteration   8: 1.021 us/op
[info] Iteration   9: 0.964 us/op
[info] Iteration  10: 0.946 us/op
[info] Iteration  11: 0.961 us/op
[info] Iteration  12: 0.921 us/op
[info] Iteration  13: 0.948 us/op
[info] Iteration  14: 0.927 us/op
[info] Iteration  15: 0.869 us/op
[info] Iteration  16: 0.874 us/op
[info] Iteration  17: 0.859 us/op
[info] Iteration  18: 0.870 us/op
[info] Iteration  19: 0.869 us/op
[info] Iteration  20: 0.865 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet":
[info]   0.896 ±(99.9%) 0.042 us/op [Average]
[info]   (min, avg, max) = (0.852, 0.896, 1.021), stdev = 0.049
[info]   CI (99.9%): [0.854, 0.938] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_BitSet
[info] # Run progress: 72.22% complete, ETA 00:05:17
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1095400.768 us/op
[info] # Warmup Iteration   2: 2.791 us/op
[info] # Warmup Iteration   3: 2.208 us/op
[info] # Warmup Iteration   4: 2.973 us/op
[info] # Warmup Iteration   5: 3.026 us/op
[info] # Warmup Iteration   6: 2.974 us/op
[info] # Warmup Iteration   7: 2.994 us/op
[info] # Warmup Iteration   8: 2.974 us/op
[info] # Warmup Iteration   9: 3.030 us/op
[info] # Warmup Iteration  10: 3.027 us/op
[info] Iteration   1: 3.005 us/op
[info] Iteration   2: 2.968 us/op
[info] Iteration   3: 2.964 us/op
[info] Iteration   4: 2.995 us/op
[info] Iteration   5: 3.039 us/op
[info] Iteration   6: 2.869 us/op
[info] Iteration   7: 2.985 us/op
[info] Iteration   8: 3.004 us/op
[info] Iteration   9: 3.018 us/op
[info] Iteration  10: 2.917 us/op
[info] Iteration  11: 2.975 us/op
[info] Iteration  12: 3.012 us/op
[info] Iteration  13: 2.995 us/op
[info] Iteration  14: 2.878 us/op
[info] Iteration  15: 2.986 us/op
[info] Iteration  16: 3.004 us/op
[info] Iteration  17: 2.988 us/op
[info] Iteration  18: 2.866 us/op
[info] Iteration  19: 3.010 us/op
[info] Iteration  20: 3.025 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_BitSet":
[info]   2.975 ±(99.9%) 0.045 us/op [Average]
[info]   (min, avg, max) = (2.866, 2.975, 3.039), stdev = 0.052
[info]   CI (99.9%): [2.930, 3.020] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet
[info] # Run progress: 75.00% complete, ETA 00:04:45
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1003.701 us/op
[info] # Warmup Iteration   2: 6.281 us/op
[info] # Warmup Iteration   3: 6.001 us/op
[info] # Warmup Iteration   4: 6.030 us/op
[info] # Warmup Iteration   5: 6.332 us/op
[info] # Warmup Iteration   6: 5.979 us/op
[info] # Warmup Iteration   7: 6.001 us/op
[info] # Warmup Iteration   8: 6.009 us/op
[info] # Warmup Iteration   9: 5.982 us/op
[info] # Warmup Iteration  10: 6.099 us/op
[info] Iteration   1: 7.219 us/op
[info] Iteration   2: 6.074 us/op
[info] Iteration   3: 6.008 us/op
[info] Iteration   4: 6.001 us/op
[info] Iteration   5: 6.051 us/op
[info] Iteration   6: 6.012 us/op
[info] Iteration   7: 5.946 us/op
[info] Iteration   8: 5.949 us/op
[info] Iteration   9: 5.921 us/op
[info] Iteration  10: 6.019 us/op
[info] Iteration  11: 5.912 us/op
[info] Iteration  12: 5.913 us/op
[info] Iteration  13: 5.919 us/op
[info] Iteration  14: 5.939 us/op
[info] Iteration  15: 5.987 us/op
[info] Iteration  16: 6.459 us/op
[info] Iteration  17: 6.343 us/op
[info] Iteration  18: 5.966 us/op
[info] Iteration  19: 5.931 us/op
[info] Iteration  20: 6.006 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet":
[info]   6.079 ±(99.9%) 0.263 us/op [Average]
[info]   (min, avg, max) = (5.912, 6.079, 7.219), stdev = 0.303
[info]   CI (99.9%): [5.816, 6.342] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Set
[info] # Run progress: 77.78% complete, ETA 00:04:13
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 175.719 us/op
[info] # Warmup Iteration   2: 7.780 us/op
[info] # Warmup Iteration   3: 7.626 us/op
[info] # Warmup Iteration   4: 7.679 us/op
[info] # Warmup Iteration   5: 7.632 us/op
[info] # Warmup Iteration   6: 7.636 us/op
[info] # Warmup Iteration   7: 7.555 us/op
[info] # Warmup Iteration   8: 7.599 us/op
[info] # Warmup Iteration   9: 7.668 us/op
[info] # Warmup Iteration  10: 7.636 us/op
[info] Iteration   1: 7.625 us/op
[info] Iteration   2: 7.598 us/op
[info] Iteration   3: 7.583 us/op
[info] Iteration   4: 7.720 us/op
[info] Iteration   5: 7.597 us/op
[info] Iteration   6: 7.537 us/op
[info] Iteration   7: 7.620 us/op
[info] Iteration   8: 7.653 us/op
[info] Iteration   9: 7.694 us/op
[info] Iteration  10: 7.613 us/op
[info] Iteration  11: 7.580 us/op
[info] Iteration  12: 7.595 us/op
[info] Iteration  13: 7.482 us/op
[info] Iteration  14: 7.571 us/op
[info] Iteration  15: 7.474 us/op
[info] Iteration  16: 8.188 us/op
[info] Iteration  17: 7.518 us/op
[info] Iteration  18: 7.466 us/op
[info] Iteration  19: 7.578 us/op
[info] Iteration  20: 7.524 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Set":
[info]   7.611 ±(99.9%) 0.132 us/op [Average]
[info]   (min, avg, max) = (7.466, 7.611, 8.188), stdev = 0.152
[info]   CI (99.9%): [7.479, 7.743] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet
[info] # Run progress: 80.56% complete, ETA 00:03:41
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 441.240 us/op
[info] # Warmup Iteration   2: 23.535 us/op
[info] # Warmup Iteration   3: 18.911 us/op
[info] # Warmup Iteration   4: 17.189 us/op
[info] # Warmup Iteration   5: 21.218 us/op
[info] # Warmup Iteration   6: 21.240 us/op
[info] # Warmup Iteration   7: 21.462 us/op
[info] # Warmup Iteration   8: 21.596 us/op
[info] # Warmup Iteration   9: 21.298 us/op
[info] # Warmup Iteration  10: 21.150 us/op
[info] Iteration   1: 21.264 us/op
[info] Iteration   2: 21.235 us/op
[info] Iteration   3: 21.504 us/op
[info] Iteration   4: 21.348 us/op
[info] Iteration   5: 21.490 us/op
[info] Iteration   6: 21.264 us/op
[info] Iteration   7: 21.402 us/op
[info] Iteration   8: 21.530 us/op
[info] Iteration   9: 21.329 us/op
[info] Iteration  10: 21.166 us/op
[info] Iteration  11: 21.225 us/op
[info] Iteration  12: 21.174 us/op
[info] Iteration  13: 21.557 us/op
[info] Iteration  14: 21.176 us/op
[info] Iteration  15: 21.313 us/op
[info] Iteration  16: 21.286 us/op
[info] Iteration  17: 21.342 us/op
[info] Iteration  18: 21.544 us/op
[info] Iteration  19: 21.355 us/op
[info] Iteration  20: 21.433 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet":
[info]   21.347 ±(99.9%) 0.111 us/op [Average]
[info]   (min, avg, max) = (21.166, 21.347, 21.557), stdev = 0.128
[info]   CI (99.9%): [21.236, 21.458] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array
[info] # Run progress: 83.33% complete, ETA 00:03:09
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1079146.897 us/op
[info] # Warmup Iteration   2: 5.112 us/op
[info] # Warmup Iteration   3: 4.721 us/op
[info] # Warmup Iteration   4: 4.725 us/op
[info] # Warmup Iteration   5: 4.690 us/op
[info] # Warmup Iteration   6: 4.710 us/op
[info] # Warmup Iteration   7: 4.786 us/op
[info] # Warmup Iteration   8: 4.766 us/op
[info] # Warmup Iteration   9: 4.682 us/op
[info] # Warmup Iteration  10: 4.710 us/op
[info] Iteration   1: 4.658 us/op
[info] Iteration   2: 4.788 us/op
[info] Iteration   3: 4.662 us/op
[info] Iteration   4: 4.670 us/op
[info] Iteration   5: 4.668 us/op
[info] Iteration   6: 4.705 us/op
[info] Iteration   7: 4.674 us/op
[info] Iteration   8: 4.671 us/op
[info] Iteration   9: 4.633 us/op
[info] Iteration  10: 4.643 us/op
[info] Iteration  11: 4.641 us/op
[info] Iteration  12: 4.662 us/op
[info] Iteration  13: 4.649 us/op
[info] Iteration  14: 4.633 us/op
[info] Iteration  15: 4.645 us/op
[info] Iteration  16: 4.631 us/op
[info] Iteration  17: 4.669 us/op
[info] Iteration  18: 4.668 us/op
[info] Iteration  19: 4.636 us/op
[info] Iteration  20: 4.618 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array":
[info]   4.661 ±(99.9%) 0.031 us/op [Average]
[info]   (min, avg, max) = (4.618, 4.661, 4.788), stdev = 0.036
[info]   CI (99.9%): [4.630, 4.692] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet
[info] # Run progress: 86.11% complete, ETA 00:02:37
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1108896.747 us/op
[info] # Warmup Iteration   2: 1.114 us/op
[info] # Warmup Iteration   3: 1.081 us/op
[info] # Warmup Iteration   4: 0.857 us/op
[info] # Warmup Iteration   5: 0.835 us/op
[info] # Warmup Iteration   6: 0.870 us/op
[info] # Warmup Iteration   7: 0.851 us/op
[info] # Warmup Iteration   8: 0.856 us/op
[info] # Warmup Iteration   9: 0.865 us/op
[info] # Warmup Iteration  10: 0.864 us/op
[info] Iteration   1: 0.869 us/op
[info] Iteration   2: 0.861 us/op
[info] Iteration   3: 0.863 us/op
[info] Iteration   4: 0.856 us/op
[info] Iteration   5: 0.855 us/op
[info] Iteration   6: 0.866 us/op
[info] Iteration   7: 0.856 us/op
[info] Iteration   8: 0.859 us/op
[info] Iteration   9: 0.855 us/op
[info] Iteration  10: 0.855 us/op
[info] Iteration  11: 0.863 us/op
[info] Iteration  12: 0.864 us/op
[info] Iteration  13: 0.862 us/op
[info] Iteration  14: 0.858 us/op
[info] Iteration  15: 0.860 us/op
[info] Iteration  16: 0.869 us/op
[info] Iteration  17: 0.859 us/op
[info] Iteration  18: 0.858 us/op
[info] Iteration  19: 0.859 us/op
[info] Iteration  20: 0.863 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet":
[info]   0.860 ±(99.9%) 0.004 us/op [Average]
[info]   (min, avg, max) = (0.855, 0.860, 0.869), stdev = 0.004
[info]   CI (99.9%): [0.857, 0.864] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet
[info] # Run progress: 88.89% complete, ETA 00:02:06
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1097953.218 us/op
[info] # Warmup Iteration   2: 2.297 us/op
[info] # Warmup Iteration   3: 2.218 us/op
[info] # Warmup Iteration   4: 2.555 us/op
[info] # Warmup Iteration   5: 2.570 us/op
[info] # Warmup Iteration   6: 2.565 us/op
[info] # Warmup Iteration   7: 2.552 us/op
[info] # Warmup Iteration   8: 2.546 us/op
[info] # Warmup Iteration   9: 2.549 us/op
[info] # Warmup Iteration  10: 2.587 us/op
[info] Iteration   1: 2.569 us/op
[info] Iteration   2: 2.543 us/op
[info] Iteration   3: 2.544 us/op
[info] Iteration   4: 2.558 us/op
[info] Iteration   5: 2.590 us/op
[info] Iteration   6: 2.546 us/op
[info] Iteration   7: 2.539 us/op
[info] Iteration   8: 2.543 us/op
[info] Iteration   9: 2.549 us/op
[info] Iteration  10: 2.563 us/op
[info] Iteration  11: 2.537 us/op
[info] Iteration  12: 2.534 us/op
[info] Iteration  13: 2.560 us/op
[info] Iteration  14: 2.576 us/op
[info] Iteration  15: 2.570 us/op
[info] Iteration  16: 2.543 us/op
[info] Iteration  17: 2.556 us/op
[info] Iteration  18: 2.550 us/op
[info] Iteration  19: 2.542 us/op
[info] Iteration  20: 2.576 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet":
[info]   2.554 ±(99.9%) 0.013 us/op [Average]
[info]   (min, avg, max) = (2.534, 2.554, 2.590), stdev = 0.015
[info]   CI (99.9%): [2.541, 2.568] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet
[info] # Run progress: 91.67% complete, ETA 00:01:34
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1071865.398 us/op
[info] # Warmup Iteration   2: 6.224 us/op
[info] # Warmup Iteration   3: 5.776 us/op
[info] # Warmup Iteration   4: 5.760 us/op
[info] # Warmup Iteration   5: 5.759 us/op
[info] # Warmup Iteration   6: 5.743 us/op
[info] # Warmup Iteration   7: 5.736 us/op
[info] # Warmup Iteration   8: 5.727 us/op
[info] # Warmup Iteration   9: 5.721 us/op
[info] # Warmup Iteration  10: 5.733 us/op
[info] Iteration   1: 5.697 us/op
[info] Iteration   2: 5.725 us/op
[info] Iteration   3: 5.724 us/op
[info] Iteration   4: 5.657 us/op
[info] Iteration   5: 5.759 us/op
[info] Iteration   6: 5.749 us/op
[info] Iteration   7: 5.692 us/op
[info] Iteration   8: 5.856 us/op
[info] Iteration   9: 5.884 us/op
[info] Iteration  10: 5.780 us/op
[info] Iteration  11: 5.663 us/op
[info] Iteration  12: 5.627 us/op
[info] Iteration  13: 5.682 us/op
[info] Iteration  14: 5.664 us/op
[info] Iteration  15: 5.709 us/op
[info] Iteration  16: 5.650 us/op
[info] Iteration  17: 5.640 us/op
[info] Iteration  18: 5.679 us/op
[info] Iteration  19: 5.686 us/op
[info] Iteration  20: 5.907 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet":
[info]   5.721 ±(99.9%) 0.070 us/op [Average]
[info]   (min, avg, max) = (5.627, 5.721, 5.907), stdev = 0.080
[info]   CI (99.9%): [5.652, 5.791] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set
[info] # Run progress: 94.44% complete, ETA 00:01:03
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1075704.816 us/op
[info] # Warmup Iteration   2: 5.971 us/op
[info] # Warmup Iteration   3: 5.644 us/op
[info] # Warmup Iteration   4: 5.713 us/op
[info] # Warmup Iteration   5: 5.642 us/op
[info] # Warmup Iteration   6: 5.638 us/op
[info] # Warmup Iteration   7: 5.603 us/op
[info] # Warmup Iteration   8: 5.572 us/op
[info] # Warmup Iteration   9: 5.688 us/op
[info] # Warmup Iteration  10: 5.656 us/op
[info] Iteration   1: 5.639 us/op
[info] Iteration   2: 5.621 us/op
[info] Iteration   3: 5.524 us/op
[info] Iteration   4: 5.718 us/op
[info] Iteration   5: 5.881 us/op
[info] Iteration   6: 5.626 us/op
[info] Iteration   7: 5.587 us/op
[info] Iteration   8: 5.648 us/op
[info] Iteration   9: 5.672 us/op
[info] Iteration  10: 5.572 us/op
[info] Iteration  11: 5.502 us/op
[info] Iteration  12: 5.563 us/op
[info] Iteration  13: 5.541 us/op
[info] Iteration  14: 5.623 us/op
[info] Iteration  15: 5.548 us/op
[info] Iteration  16: 5.545 us/op
[info] Iteration  17: 5.527 us/op
[info] Iteration  18: 5.520 us/op
[info] Iteration  19: 5.586 us/op
[info] Iteration  20: 5.577 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set":
[info]   5.601 ±(99.9%) 0.075 us/op [Average]
[info]   (min, avg, max) = (5.502, 5.601, 5.881), stdev = 0.087
[info]   CI (99.9%): [5.526, 5.676] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet
[info] # Run progress: 97.22% complete, ETA 00:00:31
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1094909.832 us/op
[info] # Warmup Iteration   2: 8.708 us/op
[info] # Warmup Iteration   3: 7.712 us/op
[info] # Warmup Iteration   4: 8.221 us/op
[info] # Warmup Iteration   5: 8.735 us/op
[info] # Warmup Iteration   6: 8.191 us/op
[info] # Warmup Iteration   7: 8.438 us/op
[info] # Warmup Iteration   8: 8.499 us/op
[info] # Warmup Iteration   9: 8.033 us/op
[info] # Warmup Iteration  10: 8.284 us/op
[info] Iteration   1: 8.262 us/op
[info] Iteration   2: 8.257 us/op
[info] Iteration   3: 8.299 us/op
[info] Iteration   4: 8.289 us/op
[info] Iteration   5: 8.310 us/op
[info] Iteration   6: 8.300 us/op
[info] Iteration   7: 8.165 us/op
[info] Iteration   8: 8.437 us/op
[info] Iteration   9: 8.220 us/op
[info] Iteration  10: 8.047 us/op
[info] Iteration  11: 8.417 us/op
[info] Iteration  12: 8.253 us/op
[info] Iteration  13: 8.188 us/op
[info] Iteration  14: 8.175 us/op
[info] Iteration  15: 8.103 us/op
[info] Iteration  16: 8.068 us/op
[info] Iteration  17: 8.106 us/op
[info] Iteration  18: 8.299 us/op
[info] Iteration  19: 8.054 us/op
[info] Iteration  20: 8.215 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet":
[info]   8.223 ±(99.9%) 0.097 us/op [Average]
[info]   (min, avg, max) = (8.047, 8.223, 8.437), stdev = 0.111
[info]   CI (99.9%): [8.127, 8.320] (assumes normal distribution)
[info] # Run complete. Total time: 00:18:54
[info] REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on
[info] why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial
[info] experiments, perform baseline and negative tests that provide experimental control, make sure
[info] the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts.
[info] Do not assume the numbers tell you what you want them to tell.
[info] NOTE: Current JVM experimentally supports Compiler Blackholes, and they are in use. Please exercise
[info] extra caution when trusting the results, look into the generated code to check the benchmark still
[info] works, and factor in a small probability of new VM bugs. Additionally, while comparisons between
[info] different JVMs are already problematic, the performance difference caused by different Blackhole
[info] modes can be very significant. Please make sure you use the consistent Blackhole mode for comparisons.
[info] Benchmark                                                       Mode  Cnt    Score    Error  Units
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_Array            avgt   20   ≈ 10⁻³           us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet         avgt   20    2.835 ±  0.033  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet           avgt   20    3.478 ±  0.054  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet      avgt   20   12.133 ±  0.171  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_Set              avgt   20   48.013 ±  0.791  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet        avgt   20  663.400 ±  4.729  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_Array            avgt   20   74.017 ±  1.566  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet         avgt   20    0.883 ±  0.009  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet           avgt   20    3.140 ±  0.030  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet      avgt   20    6.542 ±  0.116  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_Set              avgt   20    9.152 ±  0.070  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet        avgt   20   18.764 ±  0.147  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array        avgt   20    4.666 ±  0.042  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet     avgt   20    0.834 ±  0.007  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet       avgt   20    2.546 ±  0.016  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet  avgt   20    6.798 ±  0.179  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set          avgt   20    6.356 ±  0.128  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet    avgt   20    8.280 ±  0.112  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_Array               avgt   20   ≈ 10⁻³           us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet            avgt   20    2.862 ±  0.024  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_BitSet              avgt   20    3.442 ±  0.021  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet         avgt   20   11.396 ±  0.060  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_Set                 avgt   20   59.842 ±  0.467  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet           avgt   20  663.123 ±  4.553  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_Array               avgt   20   72.747 ±  0.375  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet            avgt   20    0.896 ±  0.042  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_BitSet              avgt   20    2.975 ±  0.045  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet         avgt   20    6.079 ±  0.263  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_Set                 avgt   20    7.611 ±  0.132  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet           avgt   20   21.347 ±  0.111  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array           avgt   20    4.661 ±  0.031  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet        avgt   20    0.860 ±  0.004  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet          avgt   20    2.554 ±  0.013  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet     avgt   20    5.721 ±  0.070  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set             avgt   20    5.601 ±  0.075  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet       avgt   20    8.223 ±  0.097  us/op
[success] Total time: 1139 s (18:59), completed Nov 6, 2024, 11:55:57 AM
[info] welcome to sbt 1.10.1 (Eclipse Adoptium Java 21.0.4)
[info] loading settings for project global-plugins from metals.sbt,plugins.sbt ...
[info] loading global plugins from /home/gaelrenoux/.sbt/1.0/plugins
[info] loading settings for project public-scalaio2024-benchmarks-build from plugins.sbt ...
[info] loading project definition from /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/project
[success] Generated .bloop/public-scalaio2024-benchmarks-build.json
[success] Total time: 0 s, completed Nov 6, 2024, 11:56:04 AM
[info] loading settings for project public-scalaio2024-benchmarks from build.sbt ...
[info] set current project to scalaio2024-benchmarks (in build file:/home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/)
[info] running (fork) org.openjdk.jmh.Main -i 20 -wi 10 -f1 -t1 .*chapter3.SetBenchmark_.*Invoice_HalfHit_(VerySmall|Small|Large).*
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Array
[info] # Run progress: 0.00% complete, ETA 00:18:00
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: ≈ 10⁻³ us/op
[info] # Warmup Iteration   2: ≈ 10⁻³ us/op
[info] # Warmup Iteration   3: ≈ 10⁻³ us/op
[info] # Warmup Iteration   4: ≈ 10⁻³ us/op
[info] # Warmup Iteration   5: ≈ 10⁻³ us/op
[info] # Warmup Iteration   6: ≈ 10⁻³ us/op
[info] # Warmup Iteration   7: ≈ 10⁻³ us/op
[info] # Warmup Iteration   8: ≈ 10⁻³ us/op
[info] # Warmup Iteration   9: ≈ 10⁻³ us/op
[info] # Warmup Iteration  10: ≈ 10⁻³ us/op
[info] Iteration   1: ≈ 10⁻³ us/op
[info] Iteration   2: ≈ 10⁻³ us/op
[info] Iteration   3: ≈ 10⁻³ us/op
[info] Iteration   4: ≈ 10⁻³ us/op
[info] Iteration   5: ≈ 10⁻³ us/op
[info] Iteration   6: ≈ 10⁻³ us/op
[info] Iteration   7: ≈ 10⁻³ us/op
[info] Iteration   8: ≈ 10⁻³ us/op
[info] Iteration   9: ≈ 10⁻³ us/op
[info] Iteration  10: ≈ 10⁻³ us/op
[info] Iteration  11: ≈ 10⁻³ us/op
[info] Iteration  12: ≈ 10⁻³ us/op
[info] Iteration  13: ≈ 10⁻³ us/op
[info] Iteration  14: ≈ 10⁻³ us/op
[info] Iteration  15: ≈ 10⁻³ us/op
[info] Iteration  16: ≈ 10⁻³ us/op
[info] Iteration  17: ≈ 10⁻³ us/op
[info] Iteration  18: ≈ 10⁻³ us/op
[info] Iteration  19: ≈ 10⁻³ us/op
[info] Iteration  20: ≈ 10⁻³ us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Array":
[info]   ≈ 10⁻³ us/op
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet
[info] # Run progress: 2.78% complete, ETA 00:18:00
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3077289.347 us/op
[info] # Warmup Iteration   2: 3.001 us/op
[info] # Warmup Iteration   3: 2.889 us/op
[info] # Warmup Iteration   4: 2.884 us/op
[info] # Warmup Iteration   5: 2.861 us/op
[info] # Warmup Iteration   6: 2.841 us/op
[info] # Warmup Iteration   7: 2.868 us/op
[info] # Warmup Iteration   8: 2.889 us/op
[info] # Warmup Iteration   9: 2.881 us/op
[info] # Warmup Iteration  10: 2.859 us/op
[info] Iteration   1: 2.844 us/op
[info] Iteration   2: 2.852 us/op
[info] Iteration   3: 2.901 us/op
[info] Iteration   4: 2.862 us/op
[info] Iteration   5: 2.845 us/op
[info] Iteration   6: 2.847 us/op
[info] Iteration   7: 2.856 us/op
[info] Iteration   8: 2.895 us/op
[info] Iteration   9: 2.878 us/op
[info] Iteration  10: 2.864 us/op
[info] Iteration  11: 2.870 us/op
[info] Iteration  12: 2.846 us/op
[info] Iteration  13: 2.886 us/op
[info] Iteration  14: 2.847 us/op
[info] Iteration  15: 2.875 us/op
[info] Iteration  16: 2.845 us/op
[info] Iteration  17: 2.860 us/op
[info] Iteration  18: 2.894 us/op
[info] Iteration  19: 2.868 us/op
[info] Iteration  20: 2.844 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet":
[info]   2.864 ±(99.9%) 0.016 us/op [Average]
[info]   (min, avg, max) = (2.844, 2.864, 2.901), stdev = 0.019
[info]   CI (99.9%): [2.848, 2.880] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet
[info] # Run progress: 5.56% complete, ETA 00:18:04
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3050600.292 us/op
[info] # Warmup Iteration   2: 3.195 us/op
[info] # Warmup Iteration   3: 2.769 us/op
[info] # Warmup Iteration   4: 3.474 us/op
[info] # Warmup Iteration   5: 3.460 us/op
[info] # Warmup Iteration   6: 3.511 us/op
[info] # Warmup Iteration   7: 3.440 us/op
[info] # Warmup Iteration   8: 3.444 us/op
[info] # Warmup Iteration   9: 3.457 us/op
[info] # Warmup Iteration  10: 3.474 us/op
[info] Iteration   1: 3.484 us/op
[info] Iteration   2: 3.522 us/op
[info] Iteration   3: 3.454 us/op
[info] Iteration   4: 3.452 us/op
[info] Iteration   5: 3.433 us/op
[info] Iteration   6: 3.487 us/op
[info] Iteration   7: 3.477 us/op
[info] Iteration   8: 3.467 us/op
[info] Iteration   9: 3.426 us/op
[info] Iteration  10: 3.431 us/op
[info] Iteration  11: 3.496 us/op
[info] Iteration  12: 3.475 us/op
[info] Iteration  13: 3.446 us/op
[info] Iteration  14: 3.478 us/op
[info] Iteration  15: 3.469 us/op
[info] Iteration  16: 3.502 us/op
[info] Iteration  17: 3.443 us/op
[info] Iteration  18: 3.456 us/op
[info] Iteration  19: 3.444 us/op
[info] Iteration  20: 3.463 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet":
[info]   3.465 ±(99.9%) 0.022 us/op [Average]
[info]   (min, avg, max) = (3.426, 3.465, 3.522), stdev = 0.025
[info]   CI (99.9%): [3.443, 3.487] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet
[info] # Run progress: 8.33% complete, ETA 00:17:43
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2915648.526 us/op
[info] # Warmup Iteration   2: 12.537 us/op
[info] # Warmup Iteration   3: 12.275 us/op
[info] # Warmup Iteration   4: 12.145 us/op
[info] # Warmup Iteration   5: 12.186 us/op
[info] # Warmup Iteration   6: 12.166 us/op
[info] # Warmup Iteration   7: 11.931 us/op
[info] # Warmup Iteration   8: 12.448 us/op
[info] # Warmup Iteration   9: 12.245 us/op
[info] # Warmup Iteration  10: 12.148 us/op
[info] Iteration   1: 12.319 us/op
[info] Iteration   2: 12.344 us/op
[info] Iteration   3: 12.411 us/op
[info] Iteration   4: 12.249 us/op
[info] Iteration   5: 11.892 us/op
[info] Iteration   6: 12.251 us/op
[info] Iteration   7: 12.226 us/op
[info] Iteration   8: 12.321 us/op
[info] Iteration   9: 12.263 us/op
[info] Iteration  10: 12.354 us/op
[info] Iteration  11: 12.149 us/op
[info] Iteration  12: 12.161 us/op
[info] Iteration  13: 12.396 us/op
[info] Iteration  14: 12.186 us/op
[info] Iteration  15: 12.096 us/op
[info] Iteration  16: 12.214 us/op
[info] Iteration  17: 12.193 us/op
[info] Iteration  18: 12.423 us/op
[info] Iteration  19: 12.123 us/op
[info] Iteration  20: 12.134 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet":
[info]   12.235 ±(99.9%) 0.111 us/op [Average]
[info]   (min, avg, max) = (11.892, 12.235, 12.423), stdev = 0.128
[info]   CI (99.9%): [12.124, 12.346] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Set
[info] # Run progress: 11.11% complete, ETA 00:17:15
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2999102.987 us/op
[info] # Warmup Iteration   2: 50.387 us/op
[info] # Warmup Iteration   3: 47.255 us/op
[info] # Warmup Iteration   4: 47.694 us/op
[info] # Warmup Iteration   5: 49.077 us/op
[info] # Warmup Iteration   6: 48.280 us/op
[info] # Warmup Iteration   7: 48.046 us/op
[info] # Warmup Iteration   8: 47.618 us/op
[info] # Warmup Iteration   9: 48.023 us/op
[info] # Warmup Iteration  10: 48.237 us/op
[info] Iteration   1: 47.633 us/op
[info] Iteration   2: 47.896 us/op
[info] Iteration   3: 46.748 us/op
[info] Iteration   4: 47.623 us/op
[info] Iteration   5: 48.117 us/op
[info] Iteration   6: 47.240 us/op
[info] Iteration   7: 47.503 us/op
[info] Iteration   8: 47.822 us/op
[info] Iteration   9: 47.326 us/op
[info] Iteration  10: 48.079 us/op
[info] Iteration  11: 47.960 us/op
[info] Iteration  12: 47.655 us/op
[info] Iteration  13: 47.120 us/op
[info] Iteration  14: 47.259 us/op
[info] Iteration  15: 48.073 us/op
[info] Iteration  16: 47.734 us/op
[info] Iteration  17: 47.684 us/op
[info] Iteration  18: 47.828 us/op
[info] Iteration  19: 47.508 us/op
[info] Iteration  20: 48.593 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Set":
[info]   47.670 ±(99.9%) 0.359 us/op [Average]
[info]   (min, avg, max) = (46.748, 47.670, 48.593), stdev = 0.414
[info]   CI (99.9%): [47.311, 48.029] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet
[info] # Run progress: 13.89% complete, ETA 00:16:46
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 4617420.560 us/op
[info] # Warmup Iteration   2: 682.981 us/op
[info] # Warmup Iteration   3: 643.824 us/op
[info] # Warmup Iteration   4: 644.043 us/op
[info] # Warmup Iteration   5: 662.888 us/op
[info] # Warmup Iteration   6: 680.324 us/op
[info] # Warmup Iteration   7: 682.620 us/op
[info] # Warmup Iteration   8: 669.568 us/op
[info] # Warmup Iteration   9: 671.738 us/op
[info] # Warmup Iteration  10: 682.692 us/op
[info] Iteration   1: 685.531 us/op
[info] Iteration   2: 681.456 us/op
[info] Iteration   3: 674.150 us/op
[info] Iteration   4: 680.480 us/op
[info] Iteration   5: 671.285 us/op
[info] Iteration   6: 685.473 us/op
[info] Iteration   7: 665.594 us/op
[info] Iteration   8: 682.140 us/op
[info] Iteration   9: 671.717 us/op
[info] Iteration  10: 678.801 us/op
[info] Iteration  11: 684.004 us/op
[info] Iteration  12: 677.455 us/op
[info] Iteration  13: 671.562 us/op
[info] Iteration  14: 679.167 us/op
[info] Iteration  15: 669.884 us/op
[info] Iteration  16: 687.368 us/op
[info] Iteration  17: 670.643 us/op
[info] Iteration  18: 674.681 us/op
[info] Iteration  19: 668.844 us/op
[info] Iteration  20: 669.440 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet":
[info]   676.484 ±(99.9%) 5.673 us/op [Average]
[info]   (min, avg, max) = (665.594, 676.484, 687.368), stdev = 6.533
[info]   CI (99.9%): [670.811, 682.156] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Array
[info] # Run progress: 16.67% complete, ETA 00:16:23
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1071357.854 us/op
[info] # Warmup Iteration   2: 74.877 us/op
[info] # Warmup Iteration   3: 72.180 us/op
[info] # Warmup Iteration   4: 71.279 us/op
[info] # Warmup Iteration   5: 72.762 us/op
[info] # Warmup Iteration   6: 71.575 us/op
[info] # Warmup Iteration   7: 72.089 us/op
[info] # Warmup Iteration   8: 71.181 us/op
[info] # Warmup Iteration   9: 71.333 us/op
[info] # Warmup Iteration  10: 72.337 us/op
[info] Iteration   1: 72.370 us/op
[info] Iteration   2: 71.291 us/op
[info] Iteration   3: 71.776 us/op
[info] Iteration   4: 71.397 us/op
[info] Iteration   5: 72.965 us/op
[info] Iteration   6: 71.316 us/op
[info] Iteration   7: 71.069 us/op
[info] Iteration   8: 71.223 us/op
[info] Iteration   9: 71.401 us/op
[info] Iteration  10: 72.782 us/op
[info] Iteration  11: 72.349 us/op
[info] Iteration  12: 71.560 us/op
[info] Iteration  13: 72.517 us/op
[info] Iteration  14: 71.344 us/op
[info] Iteration  15: 72.370 us/op
[info] Iteration  16: 71.306 us/op
[info] Iteration  17: 72.082 us/op
[info] Iteration  18: 71.157 us/op
[info] Iteration  19: 71.305 us/op
[info] Iteration  20: 72.384 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Array":
[info]   71.798 ±(99.9%) 0.529 us/op [Average]
[info]   (min, avg, max) = (71.069, 71.798, 72.965), stdev = 0.610
[info]   CI (99.9%): [71.269, 72.327] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet
[info] # Run progress: 19.44% complete, ETA 00:15:42
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 34.894 us/op
[info] # Warmup Iteration   2: 1.131 us/op
[info] # Warmup Iteration   3: 1.149 us/op
[info] # Warmup Iteration   4: 0.915 us/op
[info] # Warmup Iteration   5: 0.897 us/op
[info] # Warmup Iteration   6: 0.886 us/op
[info] # Warmup Iteration   7: 0.888 us/op
[info] # Warmup Iteration   8: 0.900 us/op
[info] # Warmup Iteration   9: 0.913 us/op
[info] # Warmup Iteration  10: 0.893 us/op
[info] Iteration   1: 0.894 us/op
[info] Iteration   2: 0.876 us/op
[info] Iteration   3: 0.875 us/op
[info] Iteration   4: 0.879 us/op
[info] Iteration   5: 0.888 us/op
[info] Iteration   6: 0.877 us/op
[info] Iteration   7: 0.872 us/op
[info] Iteration   8: 0.871 us/op
[info] Iteration   9: 0.897 us/op
[info] Iteration  10: 0.877 us/op
[info] Iteration  11: 0.893 us/op
[info] Iteration  12: 0.869 us/op
[info] Iteration  13: 0.890 us/op
[info] Iteration  14: 0.885 us/op
[info] Iteration  15: 0.863 us/op
[info] Iteration  16: 0.867 us/op
[info] Iteration  17: 0.893 us/op
[info] Iteration  18: 0.873 us/op
[info] Iteration  19: 0.886 us/op
[info] Iteration  20: 0.868 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet":
[info]   0.880 ±(99.9%) 0.009 us/op [Average]
[info]   (min, avg, max) = (0.863, 0.880, 0.897), stdev = 0.010
[info]   CI (99.9%): [0.871, 0.889] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet
[info] # Run progress: 22.22% complete, ETA 00:15:04
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1095736.160 us/op
[info] # Warmup Iteration   2: 2.743 us/op
[info] # Warmup Iteration   3: 2.265 us/op
[info] # Warmup Iteration   4: 2.972 us/op
[info] # Warmup Iteration   5: 2.905 us/op
[info] # Warmup Iteration   6: 2.917 us/op
[info] # Warmup Iteration   7: 2.903 us/op
[info] # Warmup Iteration   8: 3.004 us/op
[info] # Warmup Iteration   9: 2.918 us/op
[info] # Warmup Iteration  10: 2.956 us/op
[info] Iteration   1: 2.963 us/op
[info] Iteration   2: 3.012 us/op
[info] Iteration   3: 3.033 us/op
[info] Iteration   4: 2.993 us/op
[info] Iteration   5: 3.494 us/op
[info] Iteration   6: 3.287 us/op
[info] Iteration   7: 3.254 us/op
[info] Iteration   8: 3.270 us/op
[info] Iteration   9: 3.201 us/op
[info] Iteration  10: 3.134 us/op
[info] Iteration  11: 3.065 us/op
[info] Iteration  12: 3.078 us/op
[info] Iteration  13: 3.054 us/op
[info] Iteration  14: 3.025 us/op
[info] Iteration  15: 3.250 us/op
[info] Iteration  16: 3.562 us/op
[info] Iteration  17: 3.289 us/op
[info] Iteration  18: 3.001 us/op
[info] Iteration  19: 2.978 us/op
[info] Iteration  20: 3.008 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet":
[info]   3.148 ±(99.9%) 0.150 us/op [Average]
[info]   (min, avg, max) = (2.963, 3.148, 3.562), stdev = 0.172
[info]   CI (99.9%): [2.998, 3.297] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet
[info] # Run progress: 25.00% complete, ETA 00:14:27
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2477.030 us/op
[info] # Warmup Iteration   2: 6.905 us/op
[info] # Warmup Iteration   3: 6.715 us/op
[info] # Warmup Iteration   4: 6.606 us/op
[info] # Warmup Iteration   5: 6.603 us/op
[info] # Warmup Iteration   6: 6.700 us/op
[info] # Warmup Iteration   7: 6.663 us/op
[info] # Warmup Iteration   8: 6.631 us/op
[info] # Warmup Iteration   9: 6.598 us/op
[info] # Warmup Iteration  10: 6.571 us/op
[info] Iteration   1: 6.664 us/op
[info] Iteration   2: 6.686 us/op
[info] Iteration   3: 6.627 us/op
[info] Iteration   4: 6.575 us/op
[info] Iteration   5: 6.620 us/op
[info] Iteration   6: 6.696 us/op
[info] Iteration   7: 6.964 us/op
[info] Iteration   8: 6.583 us/op
[info] Iteration   9: 6.611 us/op
[info] Iteration  10: 6.714 us/op
[info] Iteration  11: 6.646 us/op
[info] Iteration  12: 6.665 us/op
[info] Iteration  13: 6.607 us/op
[info] Iteration  14: 6.635 us/op
[info] Iteration  15: 6.682 us/op
[info] Iteration  16: 6.511 us/op
[info] Iteration  17: 6.549 us/op
[info] Iteration  18: 6.926 us/op
[info] Iteration  19: 6.372 us/op
[info] Iteration  20: 6.432 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet":
[info]   6.638 ±(99.9%) 0.118 us/op [Average]
[info]   (min, avg, max) = (6.372, 6.638, 6.964), stdev = 0.136
[info]   CI (99.9%): [6.520, 6.756] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Set
[info] # Run progress: 27.78% complete, ETA 00:13:52
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1066361.025 us/op
[info] # Warmup Iteration   2: 9.674 us/op
[info] # Warmup Iteration   3: 8.959 us/op
[info] # Warmup Iteration   4: 9.026 us/op
[info] # Warmup Iteration   5: 8.932 us/op
[info] # Warmup Iteration   6: 9.038 us/op
[info] # Warmup Iteration   7: 9.124 us/op
[info] # Warmup Iteration   8: 9.011 us/op
[info] # Warmup Iteration   9: 8.947 us/op
[info] # Warmup Iteration  10: 8.963 us/op
[info] Iteration   1: 9.056 us/op
[info] Iteration   2: 9.013 us/op
[info] Iteration   3: 8.963 us/op
[info] Iteration   4: 8.928 us/op
[info] Iteration   5: 8.931 us/op
[info] Iteration   6: 9.075 us/op
[info] Iteration   7: 9.016 us/op
[info] Iteration   8: 8.935 us/op
[info] Iteration   9: 8.940 us/op
[info] Iteration  10: 8.964 us/op
[info] Iteration  11: 9.107 us/op
[info] Iteration  12: 9.380 us/op
[info] Iteration  13: 8.943 us/op
[info] Iteration  14: 8.910 us/op
[info] Iteration  15: 8.980 us/op
[info] Iteration  16: 9.012 us/op
[info] Iteration  17: 8.928 us/op
[info] Iteration  18: 8.959 us/op
[info] Iteration  19: 8.972 us/op
[info] Iteration  20: 8.842 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Set":
[info]   8.993 ±(99.9%) 0.095 us/op [Average]
[info]   (min, avg, max) = (8.842, 8.993, 9.380), stdev = 0.110
[info]   CI (99.9%): [8.897, 9.088] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet
[info] # Run progress: 30.56% complete, ETA 00:13:17
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1081572.804 us/op
[info] # Warmup Iteration   2: 26.450 us/op
[info] # Warmup Iteration   3: 22.548 us/op
[info] # Warmup Iteration   4: 18.085 us/op
[info] # Warmup Iteration   5: 18.986 us/op
[info] # Warmup Iteration   6: 19.298 us/op
[info] # Warmup Iteration   7: 18.969 us/op
[info] # Warmup Iteration   8: 18.978 us/op
[info] # Warmup Iteration   9: 19.049 us/op
[info] # Warmup Iteration  10: 19.089 us/op
[info] Iteration   1: 19.146 us/op
[info] Iteration   2: 18.984 us/op
[info] Iteration   3: 19.083 us/op
[info] Iteration   4: 19.035 us/op
[info] Iteration   5: 18.907 us/op
[info] Iteration   6: 19.248 us/op
[info] Iteration   7: 18.892 us/op
[info] Iteration   8: 19.024 us/op
[info] Iteration   9: 18.880 us/op
[info] Iteration  10: 18.825 us/op
[info] Iteration  11: 20.764 us/op
[info] Iteration  12: 19.068 us/op
[info] Iteration  13: 21.165 us/op
[info] Iteration  14: 21.075 us/op
[info] Iteration  15: 18.821 us/op
[info] Iteration  16: 19.565 us/op
[info] Iteration  17: 19.275 us/op
[info] Iteration  18: 18.945 us/op
[info] Iteration  19: 20.606 us/op
[info] Iteration  20: 19.062 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet":
[info]   19.419 ±(99.9%) 0.684 us/op [Average]
[info]   (min, avg, max) = (18.821, 19.419, 21.165), stdev = 0.787
[info]   CI (99.9%): [18.735, 20.102] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array
[info] # Run progress: 33.33% complete, ETA 00:12:43
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1071438.073 us/op
[info] # Warmup Iteration   2: 4.940 us/op
[info] # Warmup Iteration   3: 4.673 us/op
[info] # Warmup Iteration   4: 4.638 us/op
[info] # Warmup Iteration   5: 4.684 us/op
[info] # Warmup Iteration   6: 4.648 us/op
[info] # Warmup Iteration   7: 4.647 us/op
[info] # Warmup Iteration   8: 4.651 us/op
[info] # Warmup Iteration   9: 4.739 us/op
[info] # Warmup Iteration  10: 4.695 us/op
[info] Iteration   1: 4.651 us/op
[info] Iteration   2: 4.608 us/op
[info] Iteration   3: 4.576 us/op
[info] Iteration   4: 4.591 us/op
[info] Iteration   5: 4.641 us/op
[info] Iteration   6: 4.569 us/op
[info] Iteration   7: 4.568 us/op
[info] Iteration   8: 4.590 us/op
[info] Iteration   9: 4.588 us/op
[info] Iteration  10: 4.627 us/op
[info] Iteration  11: 4.561 us/op
[info] Iteration  12: 4.609 us/op
[info] Iteration  13: 4.592 us/op
[info] Iteration  14: 4.974 us/op
[info] Iteration  15: 4.643 us/op
[info] Iteration  16: 4.586 us/op
[info] Iteration  17: 4.603 us/op
[info] Iteration  18: 4.592 us/op
[info] Iteration  19: 4.578 us/op
[info] Iteration  20: 4.655 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array":
[info]   4.620 ±(99.9%) 0.076 us/op [Average]
[info]   (min, avg, max) = (4.561, 4.620, 4.974), stdev = 0.088
[info]   CI (99.9%): [4.544, 4.696] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet
[info] # Run progress: 36.11% complete, ETA 00:12:10
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1100033.693 us/op
[info] # Warmup Iteration   2: 0.872 us/op
[info] # Warmup Iteration   3: 0.870 us/op
[info] # Warmup Iteration   4: 1.082 us/op
[info] # Warmup Iteration   5: 1.070 us/op
[info] # Warmup Iteration   6: 1.046 us/op
[info] # Warmup Iteration   7: 1.071 us/op
[info] # Warmup Iteration   8: 1.068 us/op
[info] # Warmup Iteration   9: 1.086 us/op
[info] # Warmup Iteration  10: 1.065 us/op
[info] Iteration   1: 1.063 us/op
[info] Iteration   2: 1.065 us/op
[info] Iteration   3: 1.068 us/op
[info] Iteration   4: 1.078 us/op
[info] Iteration   5: 1.062 us/op
[info] Iteration   6: 1.064 us/op
[info] Iteration   7: 1.083 us/op
[info] Iteration   8: 1.061 us/op
[info] Iteration   9: 1.076 us/op
[info] Iteration  10: 1.205 us/op
[info] Iteration  11: 1.068 us/op
[info] Iteration  12: 1.057 us/op
[info] Iteration  13: 1.058 us/op
[info] Iteration  14: 1.075 us/op
[info] Iteration  15: 1.063 us/op
[info] Iteration  16: 1.066 us/op
[info] Iteration  17: 1.064 us/op
[info] Iteration  18: 1.061 us/op
[info] Iteration  19: 1.080 us/op
[info] Iteration  20: 1.138 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet":
[info]   1.078 ±(99.9%) 0.030 us/op [Average]
[info]   (min, avg, max) = (1.057, 1.078, 1.205), stdev = 0.035
[info]   CI (99.9%): [1.048, 1.108] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet
[info] # Run progress: 38.89% complete, ETA 00:11:37
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 51.731 us/op
[info] # Warmup Iteration   2: 1.925 us/op
[info] # Warmup Iteration   3: 2.156 us/op
[info] # Warmup Iteration   4: 2.514 us/op
[info] # Warmup Iteration   5: 2.486 us/op
[info] # Warmup Iteration   6: 2.524 us/op
[info] # Warmup Iteration   7: 2.515 us/op
[info] # Warmup Iteration   8: 2.544 us/op
[info] # Warmup Iteration   9: 2.463 us/op
[info] # Warmup Iteration  10: 2.536 us/op
[info] Iteration   1: 2.533 us/op
[info] Iteration   2: 2.513 us/op
[info] Iteration   3: 2.491 us/op
[info] Iteration   4: 2.521 us/op
[info] Iteration   5: 2.462 us/op
[info] Iteration   6: 2.527 us/op
[info] Iteration   7: 2.513 us/op
[info] Iteration   8: 2.574 us/op
[info] Iteration   9: 2.513 us/op
[info] Iteration  10: 2.518 us/op
[info] Iteration  11: 2.514 us/op
[info] Iteration  12: 2.527 us/op
[info] Iteration  13: 2.568 us/op
[info] Iteration  14: 2.517 us/op
[info] Iteration  15: 2.514 us/op
[info] Iteration  16: 2.567 us/op
[info] Iteration  17: 2.663 us/op
[info] Iteration  18: 2.565 us/op
[info] Iteration  19: 2.513 us/op
[info] Iteration  20: 2.527 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet":
[info]   2.532 ±(99.9%) 0.036 us/op [Average]
[info]   (min, avg, max) = (2.462, 2.532, 2.663), stdev = 0.041
[info]   CI (99.9%): [2.496, 2.567] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet
[info] # Run progress: 41.67% complete, ETA 00:11:04
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1062933.545 us/op
[info] # Warmup Iteration   2: 7.131 us/op
[info] # Warmup Iteration   3: 6.898 us/op
[info] # Warmup Iteration   4: 6.858 us/op
[info] # Warmup Iteration   5: 6.883 us/op
[info] # Warmup Iteration   6: 6.878 us/op
[info] # Warmup Iteration   7: 6.991 us/op
[info] # Warmup Iteration   8: 6.884 us/op
[info] # Warmup Iteration   9: 6.864 us/op
[info] # Warmup Iteration  10: 6.869 us/op
[info] Iteration   1: 6.890 us/op
[info] Iteration   2: 6.926 us/op
[info] Iteration   3: 6.856 us/op
[info] Iteration   4: 6.932 us/op
[info] Iteration   5: 7.186 us/op
[info] Iteration   6: 6.895 us/op
[info] Iteration   7: 6.658 us/op
[info] Iteration   8: 6.614 us/op
[info] Iteration   9: 6.589 us/op
[info] Iteration  10: 6.539 us/op
[info] Iteration  11: 6.579 us/op
[info] Iteration  12: 6.651 us/op
[info] Iteration  13: 6.565 us/op
[info] Iteration  14: 6.863 us/op
[info] Iteration  15: 6.825 us/op
[info] Iteration  16: 6.595 us/op
[info] Iteration  17: 6.656 us/op
[info] Iteration  18: 6.518 us/op
[info] Iteration  19: 6.537 us/op
[info] Iteration  20: 6.569 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet":
[info]   6.722 ±(99.9%) 0.160 us/op [Average]
[info]   (min, avg, max) = (6.518, 6.722, 7.186), stdev = 0.184
[info]   CI (99.9%): [6.562, 6.882] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set
[info] # Run progress: 44.44% complete, ETA 00:10:31
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 158.387 us/op
[info] # Warmup Iteration   2: 6.497 us/op
[info] # Warmup Iteration   3: 6.396 us/op
[info] # Warmup Iteration   4: 6.354 us/op
[info] # Warmup Iteration   5: 6.413 us/op
[info] # Warmup Iteration   6: 6.452 us/op
[info] # Warmup Iteration   7: 6.359 us/op
[info] # Warmup Iteration   8: 6.364 us/op
[info] # Warmup Iteration   9: 6.383 us/op
[info] # Warmup Iteration  10: 6.354 us/op
[info] Iteration   1: 6.765 us/op
[info] Iteration   2: 6.367 us/op
[info] Iteration   3: 6.382 us/op
[info] Iteration   4: 6.354 us/op
[info] Iteration   5: 6.385 us/op
[info] Iteration   6: 6.702 us/op
[info] Iteration   7: 6.634 us/op
[info] Iteration   8: 6.432 us/op
[info] Iteration   9: 6.153 us/op
[info] Iteration  10: 6.047 us/op
[info] Iteration  11: 6.184 us/op
[info] Iteration  12: 6.039 us/op
[info] Iteration  13: 6.057 us/op
[info] Iteration  14: 6.055 us/op
[info] Iteration  15: 6.094 us/op
[info] Iteration  16: 6.143 us/op
[info] Iteration  17: 6.054 us/op
[info] Iteration  18: 6.038 us/op
[info] Iteration  19: 6.100 us/op
[info] Iteration  20: 6.061 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set":
[info]   6.252 ±(99.9%) 0.205 us/op [Average]
[info]   (min, avg, max) = (6.038, 6.252, 6.765), stdev = 0.237
[info]   CI (99.9%): [6.047, 6.458] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet
[info] # Run progress: 47.22% complete, ETA 00:09:59
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1040151.358 us/op
[info] # Warmup Iteration   2: 8.679 us/op
[info] # Warmup Iteration   3: 8.711 us/op
[info] # Warmup Iteration   4: 8.233 us/op
[info] # Warmup Iteration   5: 8.027 us/op
[info] # Warmup Iteration   6: 8.436 us/op
[info] # Warmup Iteration   7: 7.981 us/op
[info] # Warmup Iteration   8: 8.030 us/op
[info] # Warmup Iteration   9: 8.260 us/op
[info] # Warmup Iteration  10: 8.111 us/op
[info] Iteration   1: 8.192 us/op
[info] Iteration   2: 8.138 us/op
[info] Iteration   3: 7.972 us/op
[info] Iteration   4: 8.081 us/op
[info] Iteration   5: 8.211 us/op
[info] Iteration   6: 8.180 us/op
[info] Iteration   7: 8.225 us/op
[info] Iteration   8: 8.142 us/op
[info] Iteration   9: 8.014 us/op
[info] Iteration  10: 8.245 us/op
[info] Iteration  11: 8.067 us/op
[info] Iteration  12: 8.600 us/op
[info] Iteration  13: 8.219 us/op
[info] Iteration  14: 8.175 us/op
[info] Iteration  15: 8.198 us/op
[info] Iteration  16: 8.187 us/op
[info] Iteration  17: 8.131 us/op
[info] Iteration  18: 8.074 us/op
[info] Iteration  19: 8.239 us/op
[info] Iteration  20: 8.214 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet":
[info]   8.175 ±(99.9%) 0.109 us/op [Average]
[info]   (min, avg, max) = (7.972, 8.175, 8.600), stdev = 0.126
[info]   CI (99.9%): [8.066, 8.284] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Array
[info] # Run progress: 50.00% complete, ETA 00:09:27
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: ≈ 10⁻³ us/op
[info] # Warmup Iteration   2: ≈ 10⁻³ us/op
[info] # Warmup Iteration   3: ≈ 10⁻³ us/op
[info] # Warmup Iteration   4: ≈ 10⁻³ us/op
[info] # Warmup Iteration   5: ≈ 10⁻³ us/op
[info] # Warmup Iteration   6: ≈ 10⁻³ us/op
[info] # Warmup Iteration   7: ≈ 10⁻³ us/op
[info] # Warmup Iteration   8: ≈ 10⁻³ us/op
[info] # Warmup Iteration   9: ≈ 10⁻³ us/op
[info] # Warmup Iteration  10: ≈ 10⁻³ us/op
[info] Iteration   1: ≈ 10⁻³ us/op
[info] Iteration   2: ≈ 10⁻³ us/op
[info] Iteration   3: ≈ 10⁻³ us/op
[info] Iteration   4: ≈ 10⁻³ us/op
[info] Iteration   5: ≈ 10⁻³ us/op
[info] Iteration   6: ≈ 10⁻³ us/op
[info] Iteration   7: ≈ 10⁻³ us/op
[info] Iteration   8: ≈ 10⁻³ us/op
[info] Iteration   9: ≈ 10⁻³ us/op
[info] Iteration  10: ≈ 10⁻³ us/op
[info] Iteration  11: 0.001 us/op
[info] Iteration  12: ≈ 10⁻³ us/op
[info] Iteration  13: ≈ 10⁻³ us/op
[info] Iteration  14: ≈ 10⁻³ us/op
[info] Iteration  15: ≈ 10⁻³ us/op
[info] Iteration  16: ≈ 10⁻³ us/op
[info] Iteration  17: ≈ 10⁻³ us/op
[info] Iteration  18: ≈ 10⁻³ us/op
[info] Iteration  19: ≈ 10⁻³ us/op
[info] Iteration  20: ≈ 10⁻³ us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Array":
[info]   ≈ 10⁻³ us/op
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet
[info] # Run progress: 52.78% complete, ETA 00:08:55
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2842871.786 us/op
[info] # Warmup Iteration   2: 2.992 us/op
[info] # Warmup Iteration   3: 2.835 us/op
[info] # Warmup Iteration   4: 2.807 us/op
[info] # Warmup Iteration   5: 2.805 us/op
[info] # Warmup Iteration   6: 2.809 us/op
[info] # Warmup Iteration   7: 2.855 us/op
[info] # Warmup Iteration   8: 2.806 us/op
[info] # Warmup Iteration   9: 2.809 us/op
[info] # Warmup Iteration  10: 2.822 us/op
[info] Iteration   1: 2.818 us/op
[info] Iteration   2: 2.843 us/op
[info] Iteration   3: 2.806 us/op
[info] Iteration   4: 2.819 us/op
[info] Iteration   5: 3.055 us/op
[info] Iteration   6: 2.808 us/op
[info] Iteration   7: 2.840 us/op
[info] Iteration   8: 2.865 us/op
[info] Iteration   9: 2.818 us/op
[info] Iteration  10: 2.832 us/op
[info] Iteration  11: 2.786 us/op
[info] Iteration  12: 2.842 us/op
[info] Iteration  13: 2.817 us/op
[info] Iteration  14: 2.794 us/op
[info] Iteration  15: 2.802 us/op
[info] Iteration  16: 2.811 us/op
[info] Iteration  17: 2.851 us/op
[info] Iteration  18: 2.827 us/op
[info] Iteration  19: 2.844 us/op
[info] Iteration  20: 2.896 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet":
[info]   2.839 ±(99.9%) 0.049 us/op [Average]
[info]   (min, avg, max) = (2.786, 2.839, 3.055), stdev = 0.057
[info]   CI (99.9%): [2.789, 2.888] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_BitSet
[info] # Run progress: 55.56% complete, ETA 00:08:24
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3037811.738 us/op
[info] # Warmup Iteration   2: 3.166 us/op
[info] # Warmup Iteration   3: 2.776 us/op
[info] # Warmup Iteration   4: 3.442 us/op
[info] # Warmup Iteration   5: 3.410 us/op
[info] # Warmup Iteration   6: 3.431 us/op
[info] # Warmup Iteration   7: 3.423 us/op
[info] # Warmup Iteration   8: 3.417 us/op
[info] # Warmup Iteration   9: 3.458 us/op
[info] # Warmup Iteration  10: 3.409 us/op
[info] Iteration   1: 3.430 us/op
[info] Iteration   2: 3.409 us/op
[info] Iteration   3: 3.407 us/op
[info] Iteration   4: 3.460 us/op
[info] Iteration   5: 3.426 us/op
[info] Iteration   6: 3.403 us/op
[info] Iteration   7: 3.416 us/op
[info] Iteration   8: 3.413 us/op
[info] Iteration   9: 3.647 us/op
[info] Iteration  10: 3.409 us/op
[info] Iteration  11: 3.407 us/op
[info] Iteration  12: 3.406 us/op
[info] Iteration  13: 3.422 us/op
[info] Iteration  14: 3.450 us/op
[info] Iteration  15: 3.422 us/op
[info] Iteration  16: 3.404 us/op
[info] Iteration  17: 3.435 us/op
[info] Iteration  18: 3.408 us/op
[info] Iteration  19: 3.451 us/op
[info] Iteration  20: 3.428 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_BitSet":
[info]   3.433 ±(99.9%) 0.046 us/op [Average]
[info]   (min, avg, max) = (3.403, 3.433, 3.647), stdev = 0.053
[info]   CI (99.9%): [3.386, 3.479] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet
[info] # Run progress: 58.33% complete, ETA 00:07:53
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2990104.021 us/op
[info] # Warmup Iteration   2: 11.295 us/op
[info] # Warmup Iteration   3: 10.819 us/op
[info] # Warmup Iteration   4: 11.144 us/op
[info] # Warmup Iteration   5: 11.109 us/op
[info] # Warmup Iteration   6: 11.416 us/op
[info] # Warmup Iteration   7: 11.139 us/op
[info] # Warmup Iteration   8: 11.084 us/op
[info] # Warmup Iteration   9: 11.153 us/op
[info] # Warmup Iteration  10: 11.195 us/op
[info] Iteration   1: 11.163 us/op
[info] Iteration   2: 10.942 us/op
[info] Iteration   3: 11.120 us/op
[info] Iteration   4: 11.243 us/op
[info] Iteration   5: 11.100 us/op
[info] Iteration   6: 10.937 us/op
[info] Iteration   7: 10.857 us/op
[info] Iteration   8: 11.246 us/op
[info] Iteration   9: 10.820 us/op
[info] Iteration  10: 11.107 us/op
[info] Iteration  11: 11.226 us/op
[info] Iteration  12: 11.190 us/op
[info] Iteration  13: 11.213 us/op
[info] Iteration  14: 11.158 us/op
[info] Iteration  15: 10.887 us/op
[info] Iteration  16: 11.455 us/op
[info] Iteration  17: 11.404 us/op
[info] Iteration  18: 11.082 us/op
[info] Iteration  19: 11.091 us/op
[info] Iteration  20: 11.181 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet":
[info]   11.121 ±(99.9%) 0.146 us/op [Average]
[info]   (min, avg, max) = (10.820, 11.121, 11.455), stdev = 0.168
[info]   CI (99.9%): [10.975, 11.267] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Set
[info] # Run progress: 61.11% complete, ETA 00:07:23
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2939736.911 us/op
[info] # Warmup Iteration   2: 64.924 us/op
[info] # Warmup Iteration   3: 61.165 us/op
[info] # Warmup Iteration   4: 61.426 us/op
[info] # Warmup Iteration   5: 61.702 us/op
[info] # Warmup Iteration   6: 64.228 us/op
[info] # Warmup Iteration   7: 62.838 us/op
[info] # Warmup Iteration   8: 63.833 us/op
[info] # Warmup Iteration   9: 60.898 us/op
[info] # Warmup Iteration  10: 59.903 us/op
[info] Iteration   1: 59.885 us/op
[info] Iteration   2: 59.961 us/op
[info] Iteration   3: 59.937 us/op
[info] Iteration   4: 66.622 us/op
[info] Iteration   5: 59.456 us/op
[info] Iteration   6: 59.652 us/op
[info] Iteration   7: 59.136 us/op
[info] Iteration   8: 59.625 us/op
[info] Iteration   9: 60.139 us/op
[info] Iteration  10: 59.672 us/op
[info] Iteration  11: 59.701 us/op
[info] Iteration  12: 60.805 us/op
[info] Iteration  13: 60.364 us/op
[info] Iteration  14: 61.479 us/op
[info] Iteration  15: 60.322 us/op
[info] Iteration  16: 59.834 us/op
[info] Iteration  17: 60.227 us/op
[info] Iteration  18: 60.508 us/op
[info] Iteration  19: 61.540 us/op
[info] Iteration  20: 60.408 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Set":
[info]   60.464 ±(99.9%) 1.366 us/op [Average]
[info]   (min, avg, max) = (59.136, 60.464, 66.622), stdev = 1.573
[info]   CI (99.9%): [59.097, 61.830] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet
[info] # Run progress: 63.89% complete, ETA 00:06:52
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 4558838.422 us/op
[info] # Warmup Iteration   2: 662.297 us/op
[info] # Warmup Iteration   3: 634.109 us/op
[info] # Warmup Iteration   4: 633.707 us/op
[info] # Warmup Iteration   5: 645.084 us/op
[info] # Warmup Iteration   6: 654.642 us/op
[info] # Warmup Iteration   7: 720.700 us/op
[info] # Warmup Iteration   8: 721.981 us/op
[info] # Warmup Iteration   9: 670.114 us/op
[info] # Warmup Iteration  10: 763.550 us/op
[info] Iteration   1: 714.007 us/op
[info] Iteration   2: 810.304 us/op
[info] Iteration   3: 654.089 us/op
[info] Iteration   4: 662.912 us/op
[info] Iteration   5: 656.350 us/op
[info] Iteration   6: 654.557 us/op
[info] Iteration   7: 652.046 us/op
[info] Iteration   8: 658.710 us/op
[info] Iteration   9: 671.543 us/op
[info] Iteration  10: 658.736 us/op
[info] Iteration  11: 651.740 us/op
[info] Iteration  12: 654.704 us/op
[info] Iteration  13: 657.653 us/op
[info] Iteration  14: 673.229 us/op
[info] Iteration  15: 650.751 us/op
[info] Iteration  16: 658.291 us/op
[info] Iteration  17: 663.837 us/op
[info] Iteration  18: 667.495 us/op
[info] Iteration  19: 669.522 us/op
[info] Iteration  20: 661.488 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet":
[info]   670.098 ±(99.9%) 31.044 us/op [Average]
[info]   (min, avg, max) = (650.751, 670.098, 810.304), stdev = 35.750
[info]   CI (99.9%): [639.054, 701.142] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Array
[info] # Run progress: 66.67% complete, ETA 00:06:21
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1079926.983 us/op
[info] # Warmup Iteration   2: 74.985 us/op
[info] # Warmup Iteration   3: 71.179 us/op
[info] # Warmup Iteration   4: 71.948 us/op
[info] # Warmup Iteration   5: 71.332 us/op
[info] # Warmup Iteration   6: 75.795 us/op
[info] # Warmup Iteration   7: 71.724 us/op
[info] # Warmup Iteration   8: 71.404 us/op
[info] # Warmup Iteration   9: 72.900 us/op
[info] # Warmup Iteration  10: 70.955 us/op
[info] Iteration   1: 71.496 us/op
[info] Iteration   2: 71.288 us/op
[info] Iteration   3: 71.421 us/op
[info] Iteration   4: 72.207 us/op
[info] Iteration   5: 71.336 us/op
[info] Iteration   6: 71.806 us/op
[info] Iteration   7: 71.828 us/op
[info] Iteration   8: 71.123 us/op
[info] Iteration   9: 72.214 us/op
[info] Iteration  10: 72.042 us/op
[info] Iteration  11: 71.521 us/op
[info] Iteration  12: 71.119 us/op
[info] Iteration  13: 71.244 us/op
[info] Iteration  14: 72.071 us/op
[info] Iteration  15: 71.612 us/op
[info] Iteration  16: 70.956 us/op
[info] Iteration  17: 71.343 us/op
[info] Iteration  18: 71.418 us/op
[info] Iteration  19: 72.664 us/op
[info] Iteration  20: 70.956 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Array":
[info]   71.583 ±(99.9%) 0.404 us/op [Average]
[info]   (min, avg, max) = (70.956, 71.583, 72.664), stdev = 0.465
[info]   CI (99.9%): [71.179, 71.987] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet
[info] # Run progress: 69.44% complete, ETA 00:05:49
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1087263.395 us/op
[info] # Warmup Iteration   2: 1.142 us/op
[info] # Warmup Iteration   3: 1.076 us/op
[info] # Warmup Iteration   4: 0.871 us/op
[info] # Warmup Iteration   5: 0.915 us/op
[info] # Warmup Iteration   6: 0.875 us/op
[info] # Warmup Iteration   7: 0.826 us/op
[info] # Warmup Iteration   8: 0.876 us/op
[info] # Warmup Iteration   9: 0.882 us/op
[info] # Warmup Iteration  10: 0.882 us/op
[info] Iteration   1: 0.847 us/op
[info] Iteration   2: 0.877 us/op
[info] Iteration   3: 0.844 us/op
[info] Iteration   4: 0.878 us/op
[info] Iteration   5: 0.831 us/op
[info] Iteration   6: 0.877 us/op
[info] Iteration   7: 0.833 us/op
[info] Iteration   8: 0.887 us/op
[info] Iteration   9: 0.841 us/op
[info] Iteration  10: 0.876 us/op
[info] Iteration  11: 0.819 us/op
[info] Iteration  12: 0.869 us/op
[info] Iteration  13: 0.845 us/op
[info] Iteration  14: 0.861 us/op
[info] Iteration  15: 0.831 us/op
[info] Iteration  16: 0.887 us/op
[info] Iteration  17: 0.874 us/op
[info] Iteration  18: 0.885 us/op
[info] Iteration  19: 0.829 us/op
[info] Iteration  20: 0.876 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet":
[info]   0.858 ±(99.9%) 0.020 us/op [Average]
[info]   (min, avg, max) = (0.819, 0.858, 0.887), stdev = 0.023
[info]   CI (99.9%): [0.839, 0.878] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_BitSet
[info] # Run progress: 72.22% complete, ETA 00:05:17
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 129.529 us/op
[info] # Warmup Iteration   2: 2.734 us/op
[info] # Warmup Iteration   3: 2.300 us/op
[info] # Warmup Iteration   4: 2.949 us/op
[info] # Warmup Iteration   5: 2.980 us/op
[info] # Warmup Iteration   6: 2.978 us/op
[info] # Warmup Iteration   7: 3.124 us/op
[info] # Warmup Iteration   8: 2.981 us/op
[info] # Warmup Iteration   9: 2.982 us/op
[info] # Warmup Iteration  10: 2.972 us/op
[info] Iteration   1: 2.974 us/op
[info] Iteration   2: 3.022 us/op
[info] Iteration   3: 3.021 us/op
[info] Iteration   4: 2.968 us/op
[info] Iteration   5: 3.000 us/op
[info] Iteration   6: 2.997 us/op
[info] Iteration   7: 3.011 us/op
[info] Iteration   8: 2.961 us/op
[info] Iteration   9: 2.954 us/op
[info] Iteration  10: 2.971 us/op
[info] Iteration  11: 2.938 us/op
[info] Iteration  12: 2.984 us/op
[info] Iteration  13: 2.954 us/op
[info] Iteration  14: 2.894 us/op
[info] Iteration  15: 2.962 us/op
[info] Iteration  16: 2.860 us/op
[info] Iteration  17: 2.995 us/op
[info] Iteration  18: 2.880 us/op
[info] Iteration  19: 2.944 us/op
[info] Iteration  20: 2.868 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_BitSet":
[info]   2.958 ±(99.9%) 0.042 us/op [Average]
[info]   (min, avg, max) = (2.860, 2.958, 3.022), stdev = 0.049
[info]   CI (99.9%): [2.916, 3.000] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet
[info] # Run progress: 75.00% complete, ETA 00:04:45
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 7358.530 us/op
[info] # Warmup Iteration   2: 6.095 us/op
[info] # Warmup Iteration   3: 6.271 us/op
[info] # Warmup Iteration   4: 6.030 us/op
[info] # Warmup Iteration   5: 6.031 us/op
[info] # Warmup Iteration   6: 6.065 us/op
[info] # Warmup Iteration   7: 5.994 us/op
[info] # Warmup Iteration   8: 6.008 us/op
[info] # Warmup Iteration   9: 6.056 us/op
[info] # Warmup Iteration  10: 6.483 us/op
[info] Iteration   1: 6.053 us/op
[info] Iteration   2: 6.097 us/op
[info] Iteration   3: 6.016 us/op
[info] Iteration   4: 6.003 us/op
[info] Iteration   5: 5.979 us/op
[info] Iteration   6: 6.296 us/op
[info] Iteration   7: 6.045 us/op
[info] Iteration   8: 6.060 us/op
[info] Iteration   9: 5.920 us/op
[info] Iteration  10: 6.102 us/op
[info] Iteration  11: 6.021 us/op
[info] Iteration  12: 6.086 us/op
[info] Iteration  13: 5.915 us/op
[info] Iteration  14: 5.949 us/op
[info] Iteration  15: 5.943 us/op
[info] Iteration  16: 6.014 us/op
[info] Iteration  17: 5.898 us/op
[info] Iteration  18: 5.926 us/op
[info] Iteration  19: 5.951 us/op
[info] Iteration  20: 5.965 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet":
[info]   6.012 ±(99.9%) 0.080 us/op [Average]
[info]   (min, avg, max) = (5.898, 6.012, 6.296), stdev = 0.092
[info]   CI (99.9%): [5.932, 6.092] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Set
[info] # Run progress: 77.78% complete, ETA 00:04:13
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1065004.340 us/op
[info] # Warmup Iteration   2: 8.033 us/op
[info] # Warmup Iteration   3: 7.646 us/op
[info] # Warmup Iteration   4: 7.551 us/op
[info] # Warmup Iteration   5: 8.071 us/op
[info] # Warmup Iteration   6: 7.607 us/op
[info] # Warmup Iteration   7: 7.586 us/op
[info] # Warmup Iteration   8: 7.568 us/op
[info] # Warmup Iteration   9: 7.534 us/op
[info] # Warmup Iteration  10: 7.676 us/op
[info] Iteration   1: 7.543 us/op
[info] Iteration   2: 7.551 us/op
[info] Iteration   3: 7.595 us/op
[info] Iteration   4: 7.601 us/op
[info] Iteration   5: 7.801 us/op
[info] Iteration   6: 7.573 us/op
[info] Iteration   7: 7.602 us/op
[info] Iteration   8: 7.601 us/op
[info] Iteration   9: 7.623 us/op
[info] Iteration  10: 7.654 us/op
[info] Iteration  11: 7.558 us/op
[info] Iteration  12: 7.564 us/op
[info] Iteration  13: 7.708 us/op
[info] Iteration  14: 7.529 us/op
[info] Iteration  15: 7.705 us/op
[info] Iteration  16: 7.577 us/op
[info] Iteration  17: 7.527 us/op
[info] Iteration  18: 7.502 us/op
[info] Iteration  19: 7.515 us/op
[info] Iteration  20: 7.616 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Set":
[info]   7.597 ±(99.9%) 0.064 us/op [Average]
[info]   (min, avg, max) = (7.502, 7.597, 7.801), stdev = 0.074
[info]   CI (99.9%): [7.533, 7.661] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet
[info] # Run progress: 80.56% complete, ETA 00:03:41
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1072207.882 us/op
[info] # Warmup Iteration   2: 18.655 us/op
[info] # Warmup Iteration   3: 18.743 us/op
[info] # Warmup Iteration   4: 18.389 us/op
[info] # Warmup Iteration   5: 18.256 us/op
[info] # Warmup Iteration   6: 18.334 us/op
[info] # Warmup Iteration   7: 18.301 us/op
[info] # Warmup Iteration   8: 18.468 us/op
[info] # Warmup Iteration   9: 18.565 us/op
[info] # Warmup Iteration  10: 18.418 us/op
[info] Iteration   1: 18.164 us/op
[info] Iteration   2: 18.415 us/op
[info] Iteration   3: 18.295 us/op
[info] Iteration   4: 18.531 us/op
[info] Iteration   5: 18.152 us/op
[info] Iteration   6: 18.497 us/op
[info] Iteration   7: 18.251 us/op
[info] Iteration   8: 18.416 us/op
[info] Iteration   9: 19.373 us/op
[info] Iteration  10: 18.505 us/op
[info] Iteration  11: 18.307 us/op
[info] Iteration  12: 18.328 us/op
[info] Iteration  13: 18.305 us/op
[info] Iteration  14: 18.720 us/op
[info] Iteration  15: 18.227 us/op
[info] Iteration  16: 18.289 us/op
[info] Iteration  17: 18.549 us/op
[info] Iteration  18: 18.483 us/op
[info] Iteration  19: 18.467 us/op
[info] Iteration  20: 18.589 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet":
[info]   18.443 ±(99.9%) 0.230 us/op [Average]
[info]   (min, avg, max) = (18.152, 18.443, 19.373), stdev = 0.265
[info]   CI (99.9%): [18.213, 18.673] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array
[info] # Run progress: 83.33% complete, ETA 00:03:09
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1068060.668 us/op
[info] # Warmup Iteration   2: 4.896 us/op
[info] # Warmup Iteration   3: 4.661 us/op
[info] # Warmup Iteration   4: 4.692 us/op
[info] # Warmup Iteration   5: 4.639 us/op
[info] # Warmup Iteration   6: 4.622 us/op
[info] # Warmup Iteration   7: 4.617 us/op
[info] # Warmup Iteration   8: 4.617 us/op
[info] # Warmup Iteration   9: 4.745 us/op
[info] # Warmup Iteration  10: 4.673 us/op
[info] Iteration   1: 4.616 us/op
[info] Iteration   2: 4.625 us/op
[info] Iteration   3: 4.645 us/op
[info] Iteration   4: 4.687 us/op
[info] Iteration   5: 4.601 us/op
[info] Iteration   6: 4.623 us/op
[info] Iteration   7: 4.619 us/op
[info] Iteration   8: 4.630 us/op
[info] Iteration   9: 4.657 us/op
[info] Iteration  10: 4.880 us/op
[info] Iteration  11: 4.643 us/op
[info] Iteration  12: 4.591 us/op
[info] Iteration  13: 4.613 us/op
[info] Iteration  14: 4.868 us/op
[info] Iteration  15: 4.629 us/op
[info] Iteration  16: 4.594 us/op
[info] Iteration  17: 4.591 us/op
[info] Iteration  18: 4.609 us/op
[info] Iteration  19: 4.777 us/op
[info] Iteration  20: 4.620 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array":
[info]   4.656 ±(99.9%) 0.074 us/op [Average]
[info]   (min, avg, max) = (4.591, 4.656, 4.880), stdev = 0.085
[info]   CI (99.9%): [4.582, 4.730] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet
[info] # Run progress: 86.11% complete, ETA 00:02:37
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 57.001 us/op
[info] # Warmup Iteration   2: 1.078 us/op
[info] # Warmup Iteration   3: 1.105 us/op
[info] # Warmup Iteration   4: 0.833 us/op
[info] # Warmup Iteration   5: 0.839 us/op
[info] # Warmup Iteration   6: 0.805 us/op
[info] # Warmup Iteration   7: 0.821 us/op
[info] # Warmup Iteration   8: 0.840 us/op
[info] # Warmup Iteration   9: 0.821 us/op
[info] # Warmup Iteration  10: 0.845 us/op
[info] Iteration   1: 0.836 us/op
[info] Iteration   2: 0.834 us/op
[info] Iteration   3: 0.836 us/op
[info] Iteration   4: 0.800 us/op
[info] Iteration   5: 0.838 us/op
[info] Iteration   6: 0.831 us/op
[info] Iteration   7: 0.827 us/op
[info] Iteration   8: 0.843 us/op
[info] Iteration   9: 0.832 us/op
[info] Iteration  10: 0.820 us/op
[info] Iteration  11: 0.817 us/op
[info] Iteration  12: 0.824 us/op
[info] Iteration  13: 0.852 us/op
[info] Iteration  14: 0.832 us/op
[info] Iteration  15: 0.823 us/op
[info] Iteration  16: 0.786 us/op
[info] Iteration  17: 0.834 us/op
[info] Iteration  18: 0.840 us/op
[info] Iteration  19: 0.833 us/op
[info] Iteration  20: 0.891 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet":
[info]   0.831 ±(99.9%) 0.018 us/op [Average]
[info]   (min, avg, max) = (0.786, 0.831, 0.891), stdev = 0.020
[info]   CI (99.9%): [0.814, 0.849] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet
[info] # Run progress: 88.89% complete, ETA 00:02:06
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 70.201 us/op
[info] # Warmup Iteration   2: 2.249 us/op
[info] # Warmup Iteration   3: 2.210 us/op
[info] # Warmup Iteration   4: 2.530 us/op
[info] # Warmup Iteration   5: 2.519 us/op
[info] # Warmup Iteration   6: 2.522 us/op
[info] # Warmup Iteration   7: 2.504 us/op
[info] # Warmup Iteration   8: 2.528 us/op
[info] # Warmup Iteration   9: 2.506 us/op
[info] # Warmup Iteration  10: 2.536 us/op
[info] Iteration   1: 2.519 us/op
[info] Iteration   2: 2.597 us/op
[info] Iteration   3: 2.510 us/op
[info] Iteration   4: 2.513 us/op
[info] Iteration   5: 2.510 us/op
[info] Iteration   6: 2.534 us/op
[info] Iteration   7: 2.549 us/op
[info] Iteration   8: 2.512 us/op
[info] Iteration   9: 2.516 us/op
[info] Iteration  10: 2.526 us/op
[info] Iteration  11: 2.467 us/op
[info] Iteration  12: 2.538 us/op
[info] Iteration  13: 2.469 us/op
[info] Iteration  14: 2.515 us/op
[info] Iteration  15: 2.469 us/op
[info] Iteration  16: 2.515 us/op
[info] Iteration  17: 2.513 us/op
[info] Iteration  18: 2.519 us/op
[info] Iteration  19: 2.465 us/op
[info] Iteration  20: 2.514 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet":
[info]   2.514 ±(99.9%) 0.027 us/op [Average]
[info]   (min, avg, max) = (2.465, 2.514, 2.597), stdev = 0.031
[info]   CI (99.9%): [2.487, 2.540] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet
[info] # Run progress: 91.67% complete, ETA 00:01:34
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1081264.718 us/op
[info] # Warmup Iteration   2: 5.870 us/op
[info] # Warmup Iteration   3: 5.694 us/op
[info] # Warmup Iteration   4: 5.638 us/op
[info] # Warmup Iteration   5: 5.714 us/op
[info] # Warmup Iteration   6: 5.706 us/op
[info] # Warmup Iteration   7: 5.696 us/op
[info] # Warmup Iteration   8: 6.286 us/op
[info] # Warmup Iteration   9: 5.702 us/op
[info] # Warmup Iteration  10: 5.623 us/op
[info] Iteration   1: 5.730 us/op
[info] Iteration   2: 5.642 us/op
[info] Iteration   3: 5.664 us/op
[info] Iteration   4: 5.648 us/op
[info] Iteration   5: 5.650 us/op
[info] Iteration   6: 5.732 us/op
[info] Iteration   7: 5.683 us/op
[info] Iteration   8: 5.682 us/op
[info] Iteration   9: 5.685 us/op
[info] Iteration  10: 5.566 us/op
[info] Iteration  11: 5.649 us/op
[info] Iteration  12: 5.531 us/op
[info] Iteration  13: 5.551 us/op
[info] Iteration  14: 5.532 us/op
[info] Iteration  15: 5.593 us/op
[info] Iteration  16: 5.599 us/op
[info] Iteration  17: 5.523 us/op
[info] Iteration  18: 5.527 us/op
[info] Iteration  19: 5.620 us/op
[info] Iteration  20: 5.547 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet":
[info]   5.618 ±(99.9%) 0.060 us/op [Average]
[info]   (min, avg, max) = (5.523, 5.618, 5.732), stdev = 0.069
[info]   CI (99.9%): [5.558, 5.677] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set
[info] # Run progress: 94.44% complete, ETA 00:01:03
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1029668.051 us/op
[info] # Warmup Iteration   2: 5.848 us/op
[info] # Warmup Iteration   3: 5.621 us/op
[info] # Warmup Iteration   4: 5.543 us/op
[info] # Warmup Iteration   5: 5.612 us/op
[info] # Warmup Iteration   6: 5.556 us/op
[info] # Warmup Iteration   7: 5.586 us/op
[info] # Warmup Iteration   8: 5.578 us/op
[info] # Warmup Iteration   9: 5.557 us/op
[info] # Warmup Iteration  10: 5.651 us/op
[info] Iteration   1: 5.573 us/op
[info] Iteration   2: 5.589 us/op
[info] Iteration   3: 5.545 us/op
[info] Iteration   4: 5.554 us/op
[info] Iteration   5: 5.943 us/op
[info] Iteration   6: 5.548 us/op
[info] Iteration   7: 5.535 us/op
[info] Iteration   8: 5.554 us/op
[info] Iteration   9: 5.602 us/op
[info] Iteration  10: 5.522 us/op
[info] Iteration  11: 5.460 us/op
[info] Iteration  12: 5.458 us/op
[info] Iteration  13: 5.470 us/op
[info] Iteration  14: 5.445 us/op
[info] Iteration  15: 5.516 us/op
[info] Iteration  16: 5.894 us/op
[info] Iteration  17: 5.465 us/op
[info] Iteration  18: 5.499 us/op
[info] Iteration  19: 5.454 us/op
[info] Iteration  20: 5.532 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set":
[info]   5.558 ±(99.9%) 0.115 us/op [Average]
[info]   (min, avg, max) = (5.445, 5.558, 5.943), stdev = 0.132
[info]   CI (99.9%): [5.443, 5.673] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet
[info] # Run progress: 97.22% complete, ETA 00:00:31
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 288.136 us/op
[info] # Warmup Iteration   2: 8.655 us/op
[info] # Warmup Iteration   3: 8.245 us/op
[info] # Warmup Iteration   4: 7.933 us/op
[info] # Warmup Iteration   5: 7.876 us/op
[info] # Warmup Iteration   6: 7.801 us/op
[info] # Warmup Iteration   7: 7.844 us/op
[info] # Warmup Iteration   8: 7.843 us/op
[info] # Warmup Iteration   9: 7.881 us/op
[info] # Warmup Iteration  10: 7.835 us/op
[info] Iteration   1: 7.786 us/op
[info] Iteration   2: 7.830 us/op
[info] Iteration   3: 7.936 us/op
[info] Iteration   4: 8.210 us/op
[info] Iteration   5: 7.827 us/op
[info] Iteration   6: 7.818 us/op
[info] Iteration   7: 7.947 us/op
[info] Iteration   8: 7.838 us/op
[info] Iteration   9: 7.914 us/op
[info] Iteration  10: 7.879 us/op
[info] Iteration  11: 7.815 us/op
[info] Iteration  12: 7.840 us/op
[info] Iteration  13: 7.815 us/op
[info] Iteration  14: 7.947 us/op
[info] Iteration  15: 7.876 us/op
[info] Iteration  16: 7.784 us/op
[info] Iteration  17: 7.837 us/op
[info] Iteration  18: 7.867 us/op
[info] Iteration  19: 7.996 us/op
[info] Iteration  20: 7.821 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet":
[info]   7.879 ±(99.9%) 0.085 us/op [Average]
[info]   (min, avg, max) = (7.784, 7.879, 8.210), stdev = 0.097
[info]   CI (99.9%): [7.795, 7.964] (assumes normal distribution)
[info] # Run complete. Total time: 00:18:53
[info] REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on
[info] why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial
[info] experiments, perform baseline and negative tests that provide experimental control, make sure
[info] the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts.
[info] Do not assume the numbers tell you what you want them to tell.
[info] NOTE: Current JVM experimentally supports Compiler Blackholes, and they are in use. Please exercise
[info] extra caution when trusting the results, look into the generated code to check the benchmark still
[info] works, and factor in a small probability of new VM bugs. Additionally, while comparisons between
[info] different JVMs are already problematic, the performance difference caused by different Blackhole
[info] modes can be very significant. Please make sure you use the consistent Blackhole mode for comparisons.
[info] Benchmark                                                       Mode  Cnt    Score    Error  Units
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_Array            avgt   20   ≈ 10⁻³           us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet         avgt   20    2.864 ±  0.016  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet           avgt   20    3.465 ±  0.022  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet      avgt   20   12.235 ±  0.111  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_Set              avgt   20   47.670 ±  0.359  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet        avgt   20  676.484 ±  5.673  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_Array            avgt   20   71.798 ±  0.529  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet         avgt   20    0.880 ±  0.009  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet           avgt   20    3.148 ±  0.150  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet      avgt   20    6.638 ±  0.118  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_Set              avgt   20    8.993 ±  0.095  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet        avgt   20   19.419 ±  0.684  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array        avgt   20    4.620 ±  0.076  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet     avgt   20    1.078 ±  0.030  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet       avgt   20    2.532 ±  0.036  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet  avgt   20    6.722 ±  0.160  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set          avgt   20    6.252 ±  0.205  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet    avgt   20    8.175 ±  0.109  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_Array               avgt   20   ≈ 10⁻³           us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet            avgt   20    2.839 ±  0.049  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_BitSet              avgt   20    3.433 ±  0.046  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet         avgt   20   11.121 ±  0.146  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_Set                 avgt   20   60.464 ±  1.366  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet           avgt   20  670.098 ± 31.044  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_Array               avgt   20   71.583 ±  0.404  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet            avgt   20    0.858 ±  0.020  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_BitSet              avgt   20    2.958 ±  0.042  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet         avgt   20    6.012 ±  0.080  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_Set                 avgt   20    7.597 ±  0.064  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet           avgt   20   18.443 ±  0.230  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array           avgt   20    4.656 ±  0.074  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet        avgt   20    0.831 ±  0.018  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet          avgt   20    2.514 ±  0.027  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet     avgt   20    5.618 ±  0.060  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set             avgt   20    5.558 ±  0.115  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet       avgt   20    7.879 ±  0.085  us/op
[success] Total time: 1137 s (18:57), completed Nov 6, 2024, 12:15:02 PM
[info] welcome to sbt 1.10.1 (Eclipse Adoptium Java 21.0.4)
[info] loading settings for project global-plugins from metals.sbt,plugins.sbt ...
[info] loading global plugins from /home/gaelrenoux/.sbt/1.0/plugins
[info] loading settings for project public-scalaio2024-benchmarks-build from plugins.sbt ...
[info] loading project definition from /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/project
[success] Generated .bloop/public-scalaio2024-benchmarks-build.json
[success] Total time: 0 s, completed Nov 6, 2024, 12:15:08 PM
[info] loading settings for project public-scalaio2024-benchmarks from build.sbt ...
[info] set current project to scalaio2024-benchmarks (in build file:/home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/)
[info] running (fork) org.openjdk.jmh.Main -i 20 -wi 10 -f1 -t1 .*chapter3.SetBenchmark_.*Invoice_HalfHit_(VerySmall|Small|Large).*
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Array
[info] # Run progress: 0.00% complete, ETA 00:18:00
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: ≈ 10⁻³ us/op
[info] # Warmup Iteration   2: ≈ 10⁻³ us/op
[info] # Warmup Iteration   3: ≈ 10⁻³ us/op
[info] # Warmup Iteration   4: ≈ 10⁻³ us/op
[info] # Warmup Iteration   5: ≈ 10⁻³ us/op
[info] # Warmup Iteration   6: ≈ 10⁻³ us/op
[info] # Warmup Iteration   7: ≈ 10⁻³ us/op
[info] # Warmup Iteration   8: ≈ 10⁻³ us/op
[info] # Warmup Iteration   9: ≈ 10⁻³ us/op
[info] # Warmup Iteration  10: ≈ 10⁻³ us/op
[info] Iteration   1: ≈ 10⁻³ us/op
[info] Iteration   2: ≈ 10⁻³ us/op
[info] Iteration   3: ≈ 10⁻³ us/op
[info] Iteration   4: ≈ 10⁻³ us/op
[info] Iteration   5: ≈ 10⁻³ us/op
[info] Iteration   6: ≈ 10⁻³ us/op
[info] Iteration   7: ≈ 10⁻³ us/op
[info] Iteration   8: ≈ 10⁻³ us/op
[info] Iteration   9: ≈ 10⁻³ us/op
[info] Iteration  10: ≈ 10⁻³ us/op
[info] Iteration  11: ≈ 10⁻³ us/op
[info] Iteration  12: ≈ 10⁻³ us/op
[info] Iteration  13: ≈ 10⁻³ us/op
[info] Iteration  14: ≈ 10⁻³ us/op
[info] Iteration  15: ≈ 10⁻³ us/op
[info] Iteration  16: ≈ 10⁻³ us/op
[info] Iteration  17: ≈ 10⁻³ us/op
[info] Iteration  18: ≈ 10⁻³ us/op
[info] Iteration  19: ≈ 10⁻³ us/op
[info] Iteration  20: ≈ 10⁻³ us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Array":
[info]   ≈ 10⁻³ us/op
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet
[info] # Run progress: 2.78% complete, ETA 00:18:00
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2962781.801 us/op
[info] # Warmup Iteration   2: 2.706 us/op
[info] # Warmup Iteration   3: 2.450 us/op
[info] # Warmup Iteration   4: 2.443 us/op
[info] # Warmup Iteration   5: 2.482 us/op
[info] # Warmup Iteration   6: 2.528 us/op
[info] # Warmup Iteration   7: 2.614 us/op
[info] # Warmup Iteration   8: 2.460 us/op
[info] # Warmup Iteration   9: 2.417 us/op
[info] # Warmup Iteration  10: 2.476 us/op
[info] Iteration   1: 2.484 us/op
[info] Iteration   2: 2.502 us/op
[info] Iteration   3: 2.466 us/op
[info] Iteration   4: 2.470 us/op
[info] Iteration   5: 2.486 us/op
[info] Iteration   6: 2.502 us/op
[info] Iteration   7: 2.454 us/op
[info] Iteration   8: 2.467 us/op
[info] Iteration   9: 2.492 us/op
[info] Iteration  10: 2.454 us/op
[info] Iteration  11: 2.508 us/op
[info] Iteration  12: 2.481 us/op
[info] Iteration  13: 2.486 us/op
[info] Iteration  14: 2.415 us/op
[info] Iteration  15: 2.435 us/op
[info] Iteration  16: 2.488 us/op
[info] Iteration  17: 2.458 us/op
[info] Iteration  18: 2.452 us/op
[info] Iteration  19: 2.471 us/op
[info] Iteration  20: 2.453 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet":
[info]   2.471 ±(99.9%) 0.021 us/op [Average]
[info]   (min, avg, max) = (2.415, 2.471, 2.508), stdev = 0.024
[info]   CI (99.9%): [2.451, 2.492] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet
[info] # Run progress: 5.56% complete, ETA 00:18:01
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3107667.363 us/op
[info] # Warmup Iteration   2: 3.164 us/op
[info] # Warmup Iteration   3: 2.779 us/op
[info] # Warmup Iteration   4: 3.413 us/op
[info] # Warmup Iteration   5: 3.413 us/op
[info] # Warmup Iteration   6: 3.431 us/op
[info] # Warmup Iteration   7: 3.410 us/op
[info] # Warmup Iteration   8: 3.464 us/op
[info] # Warmup Iteration   9: 3.414 us/op
[info] # Warmup Iteration  10: 3.691 us/op
[info] Iteration   1: 3.421 us/op
[info] Iteration   2: 3.421 us/op
[info] Iteration   3: 3.458 us/op
[info] Iteration   4: 3.461 us/op
[info] Iteration   5: 3.421 us/op
[info] Iteration   6: 3.411 us/op
[info] Iteration   7: 3.423 us/op
[info] Iteration   8: 3.476 us/op
[info] Iteration   9: 3.405 us/op
[info] Iteration  10: 3.419 us/op
[info] Iteration  11: 3.410 us/op
[info] Iteration  12: 3.426 us/op
[info] Iteration  13: 3.450 us/op
[info] Iteration  14: 3.414 us/op
[info] Iteration  15: 3.437 us/op
[info] Iteration  16: 3.458 us/op
[info] Iteration  17: 3.410 us/op
[info] Iteration  18: 3.457 us/op
[info] Iteration  19: 3.412 us/op
[info] Iteration  20: 3.469 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet":
[info]   3.433 ±(99.9%) 0.020 us/op [Average]
[info]   (min, avg, max) = (3.405, 3.433, 3.476), stdev = 0.023
[info]   CI (99.9%): [3.413, 3.453] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet
[info] # Run progress: 8.33% complete, ETA 00:17:42
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3168204.184 us/op
[info] # Warmup Iteration   2: 12.295 us/op
[info] # Warmup Iteration   3: 11.879 us/op
[info] # Warmup Iteration   4: 11.959 us/op
[info] # Warmup Iteration   5: 12.017 us/op
[info] # Warmup Iteration   6: 11.760 us/op
[info] # Warmup Iteration   7: 11.838 us/op
[info] # Warmup Iteration   8: 11.837 us/op
[info] # Warmup Iteration   9: 12.509 us/op
[info] # Warmup Iteration  10: 12.209 us/op
[info] Iteration   1: 11.753 us/op
[info] Iteration   2: 12.692 us/op
[info] Iteration   3: 12.001 us/op
[info] Iteration   4: 12.160 us/op
[info] Iteration   5: 12.177 us/op
[info] Iteration   6: 12.089 us/op
[info] Iteration   7: 12.181 us/op
[info] Iteration   8: 12.162 us/op
[info] Iteration   9: 12.182 us/op
[info] Iteration  10: 12.050 us/op
[info] Iteration  11: 11.985 us/op
[info] Iteration  12: 11.870 us/op
[info] Iteration  13: 12.125 us/op
[info] Iteration  14: 11.867 us/op
[info] Iteration  15: 12.158 us/op
[info] Iteration  16: 11.908 us/op
[info] Iteration  17: 12.096 us/op
[info] Iteration  18: 12.051 us/op
[info] Iteration  19: 12.043 us/op
[info] Iteration  20: 12.285 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet":
[info]   12.092 ±(99.9%) 0.168 us/op [Average]
[info]   (min, avg, max) = (11.753, 12.092, 12.692), stdev = 0.193
[info]   CI (99.9%): [11.924, 12.259] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Set
[info] # Run progress: 11.11% complete, ETA 00:17:16
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2773388.967 us/op
[info] # Warmup Iteration   2: 52.636 us/op
[info] # Warmup Iteration   3: 48.103 us/op
[info] # Warmup Iteration   4: 48.089 us/op
[info] # Warmup Iteration   5: 49.370 us/op
[info] # Warmup Iteration   6: 47.733 us/op
[info] # Warmup Iteration   7: 48.447 us/op
[info] # Warmup Iteration   8: 48.531 us/op
[info] # Warmup Iteration   9: 50.269 us/op
[info] # Warmup Iteration  10: 47.933 us/op
[info] Iteration   1: 47.821 us/op
[info] Iteration   2: 48.201 us/op
[info] Iteration   3: 47.872 us/op
[info] Iteration   4: 47.624 us/op
[info] Iteration   5: 47.859 us/op
[info] Iteration   6: 47.460 us/op
[info] Iteration   7: 48.158 us/op
[info] Iteration   8: 47.654 us/op
[info] Iteration   9: 47.577 us/op
[info] Iteration  10: 47.613 us/op
[info] Iteration  11: 47.853 us/op
[info] Iteration  12: 48.209 us/op
[info] Iteration  13: 47.653 us/op
[info] Iteration  14: 47.682 us/op
[info] Iteration  15: 48.356 us/op
[info] Iteration  16: 47.491 us/op
[info] Iteration  17: 48.758 us/op
[info] Iteration  18: 48.382 us/op
[info] Iteration  19: 47.970 us/op
[info] Iteration  20: 47.310 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Set":
[info]   47.875 ±(99.9%) 0.320 us/op [Average]
[info]   (min, avg, max) = (47.310, 47.875, 48.758), stdev = 0.368
[info]   CI (99.9%): [47.556, 48.195] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet
[info] # Run progress: 13.89% complete, ETA 00:16:45
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 4645341.281 us/op
[info] # Warmup Iteration   2: 677.958 us/op
[info] # Warmup Iteration   3: 649.113 us/op
[info] # Warmup Iteration   4: 628.815 us/op
[info] # Warmup Iteration   5: 646.100 us/op
[info] # Warmup Iteration   6: 656.236 us/op
[info] # Warmup Iteration   7: 661.683 us/op
[info] # Warmup Iteration   8: 670.875 us/op
[info] # Warmup Iteration   9: 659.623 us/op
[info] # Warmup Iteration  10: 661.920 us/op
[info] Iteration   1: 663.008 us/op
[info] Iteration   2: 657.545 us/op
[info] Iteration   3: 670.225 us/op
[info] Iteration   4: 658.980 us/op
[info] Iteration   5: 663.845 us/op
[info] Iteration   6: 658.750 us/op
[info] Iteration   7: 660.163 us/op
[info] Iteration   8: 670.346 us/op
[info] Iteration   9: 662.131 us/op
[info] Iteration  10: 704.409 us/op
[info] Iteration  11: 657.859 us/op
[info] Iteration  12: 661.657 us/op
[info] Iteration  13: 673.605 us/op
[info] Iteration  14: 653.936 us/op
[info] Iteration  15: 654.731 us/op
[info] Iteration  16: 653.688 us/op
[info] Iteration  17: 657.973 us/op
[info] Iteration  18: 666.022 us/op
[info] Iteration  19: 656.030 us/op
[info] Iteration  20: 658.848 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet":
[info]   663.188 ±(99.9%) 9.702 us/op [Average]
[info]   (min, avg, max) = (653.688, 663.188, 704.409), stdev = 11.173
[info]   CI (99.9%): [653.486, 672.890] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Array
[info] # Run progress: 16.67% complete, ETA 00:16:23
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1088672.654 us/op
[info] # Warmup Iteration   2: 75.460 us/op
[info] # Warmup Iteration   3: 71.632 us/op
[info] # Warmup Iteration   4: 71.695 us/op
[info] # Warmup Iteration   5: 71.087 us/op
[info] # Warmup Iteration   6: 71.126 us/op
[info] # Warmup Iteration   7: 71.916 us/op
[info] # Warmup Iteration   8: 71.625 us/op
[info] # Warmup Iteration   9: 71.607 us/op
[info] # Warmup Iteration  10: 71.588 us/op
[info] Iteration   1: 71.047 us/op
[info] Iteration   2: 72.518 us/op
[info] Iteration   3: 71.085 us/op
[info] Iteration   4: 71.735 us/op
[info] Iteration   5: 70.920 us/op
[info] Iteration   6: 71.420 us/op
[info] Iteration   7: 77.208 us/op
[info] Iteration   8: 71.084 us/op
[info] Iteration   9: 71.055 us/op
[info] Iteration  10: 71.310 us/op
[info] Iteration  11: 71.721 us/op
[info] Iteration  12: 71.775 us/op
[info] Iteration  13: 71.742 us/op
[info] Iteration  14: 71.528 us/op
[info] Iteration  15: 70.957 us/op
[info] Iteration  16: 71.581 us/op
[info] Iteration  17: 72.286 us/op
[info] Iteration  18: 71.636 us/op
[info] Iteration  19: 71.152 us/op
[info] Iteration  20: 71.138 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Array":
[info]   71.745 ±(99.9%) 1.178 us/op [Average]
[info]   (min, avg, max) = (70.920, 71.745, 77.208), stdev = 1.357
[info]   CI (99.9%): [70.567, 72.923] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet
[info] # Run progress: 19.44% complete, ETA 00:15:42
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 92.029 us/op
[info] # Warmup Iteration   2: 1.130 us/op
[info] # Warmup Iteration   3: 1.130 us/op
[info] # Warmup Iteration   4: 0.885 us/op
[info] # Warmup Iteration   5: 0.888 us/op
[info] # Warmup Iteration   6: 0.901 us/op
[info] # Warmup Iteration   7: 0.892 us/op
[info] # Warmup Iteration   8: 0.886 us/op
[info] # Warmup Iteration   9: 0.893 us/op
[info] # Warmup Iteration  10: 0.891 us/op
[info] Iteration   1: 0.900 us/op
[info] Iteration   2: 0.885 us/op
[info] Iteration   3: 0.885 us/op
[info] Iteration   4: 0.891 us/op
[info] Iteration   5: 0.892 us/op
[info] Iteration   6: 0.899 us/op
[info] Iteration   7: 0.887 us/op
[info] Iteration   8: 0.893 us/op
[info] Iteration   9: 0.889 us/op
[info] Iteration  10: 0.886 us/op
[info] Iteration  11: 0.899 us/op
[info] Iteration  12: 0.888 us/op
[info] Iteration  13: 0.886 us/op
[info] Iteration  14: 0.885 us/op
[info] Iteration  15: 0.889 us/op
[info] Iteration  16: 0.959 us/op
[info] Iteration  17: 0.895 us/op
[info] Iteration  18: 0.887 us/op
[info] Iteration  19: 0.888 us/op
[info] Iteration  20: 0.895 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet":
[info]   0.894 ±(99.9%) 0.014 us/op [Average]
[info]   (min, avg, max) = (0.885, 0.894, 0.959), stdev = 0.016
[info]   CI (99.9%): [0.880, 0.908] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet
[info] # Run progress: 22.22% complete, ETA 00:15:04
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1082776.868 us/op
[info] # Warmup Iteration   2: 2.924 us/op
[info] # Warmup Iteration   3: 2.815 us/op
[info] # Warmup Iteration   4: 3.076 us/op
[info] # Warmup Iteration   5: 3.116 us/op
[info] # Warmup Iteration   6: 3.081 us/op
[info] # Warmup Iteration   7: 3.092 us/op
[info] # Warmup Iteration   8: 3.102 us/op
[info] # Warmup Iteration   9: 3.078 us/op
[info] # Warmup Iteration  10: 3.130 us/op
[info] Iteration   1: 3.095 us/op
[info] Iteration   2: 3.100 us/op
[info] Iteration   3: 3.068 us/op
[info] Iteration   4: 3.080 us/op
[info] Iteration   5: 3.126 us/op
[info] Iteration   6: 3.085 us/op
[info] Iteration   7: 3.069 us/op
[info] Iteration   8: 3.101 us/op
[info] Iteration   9: 3.053 us/op
[info] Iteration  10: 3.119 us/op
[info] Iteration  11: 3.044 us/op
[info] Iteration  12: 3.079 us/op
[info] Iteration  13: 3.087 us/op
[info] Iteration  14: 3.128 us/op
[info] Iteration  15: 3.098 us/op
[info] Iteration  16: 3.086 us/op
[info] Iteration  17: 3.085 us/op
[info] Iteration  18: 3.331 us/op
[info] Iteration  19: 3.078 us/op
[info] Iteration  20: 3.123 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet":
[info]   3.102 ±(99.9%) 0.051 us/op [Average]
[info]   (min, avg, max) = (3.044, 3.102, 3.331), stdev = 0.059
[info]   CI (99.9%): [3.051, 3.153] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet
[info] # Run progress: 25.00% complete, ETA 00:14:27
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1097814.229 us/op
[info] # Warmup Iteration   2: 6.802 us/op
[info] # Warmup Iteration   3: 6.650 us/op
[info] # Warmup Iteration   4: 6.828 us/op
[info] # Warmup Iteration   5: 6.763 us/op
[info] # Warmup Iteration   6: 6.582 us/op
[info] # Warmup Iteration   7: 6.748 us/op
[info] # Warmup Iteration   8: 6.609 us/op
[info] # Warmup Iteration   9: 6.690 us/op
[info] # Warmup Iteration  10: 6.603 us/op
[info] Iteration   1: 6.593 us/op
[info] Iteration   2: 6.628 us/op
[info] Iteration   3: 6.644 us/op
[info] Iteration   4: 6.649 us/op
[info] Iteration   5: 6.582 us/op
[info] Iteration   6: 6.596 us/op
[info] Iteration   7: 6.709 us/op
[info] Iteration   8: 6.597 us/op
[info] Iteration   9: 6.813 us/op
[info] Iteration  10: 6.607 us/op
[info] Iteration  11: 6.678 us/op
[info] Iteration  12: 6.575 us/op
[info] Iteration  13: 6.376 us/op
[info] Iteration  14: 6.437 us/op
[info] Iteration  15: 6.459 us/op
[info] Iteration  16: 6.354 us/op
[info] Iteration  17: 6.388 us/op
[info] Iteration  18: 6.342 us/op
[info] Iteration  19: 6.538 us/op
[info] Iteration  20: 6.366 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet":
[info]   6.547 ±(99.9%) 0.116 us/op [Average]
[info]   (min, avg, max) = (6.342, 6.547, 6.813), stdev = 0.134
[info]   CI (99.9%): [6.431, 6.663] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Set
[info] # Run progress: 27.78% complete, ETA 00:13:52
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1077366.433 us/op
[info] # Warmup Iteration   2: 9.861 us/op
[info] # Warmup Iteration   3: 9.723 us/op
[info] # Warmup Iteration   4: 10.461 us/op
[info] # Warmup Iteration   5: 9.936 us/op
[info] # Warmup Iteration   6: 12.138 us/op
[info] # Warmup Iteration   7: 11.773 us/op
[info] # Warmup Iteration   8: 11.867 us/op
[info] # Warmup Iteration   9: 11.927 us/op
[info] # Warmup Iteration  10: 11.904 us/op
[info] Iteration   1: 9.270 us/op
[info] Iteration   2: 10.640 us/op
[info] Iteration   3: 9.063 us/op
[info] Iteration   4: 10.440 us/op
[info] Iteration   5: 9.378 us/op
[info] Iteration   6: 9.164 us/op
[info] Iteration   7: 9.090 us/op
[info] Iteration   8: 9.246 us/op
[info] Iteration   9: 9.192 us/op
[info] Iteration  10: 9.143 us/op
[info] Iteration  11: 9.134 us/op
[info] Iteration  12: 9.146 us/op
[info] Iteration  13: 9.076 us/op
[info] Iteration  14: 9.208 us/op
[info] Iteration  15: 9.078 us/op
[info] Iteration  16: 9.156 us/op
[info] Iteration  17: 9.096 us/op
[info] Iteration  18: 9.197 us/op
[info] Iteration  19: 9.178 us/op
[info] Iteration  20: 9.143 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Set":
[info]   9.302 ±(99.9%) 0.374 us/op [Average]
[info]   (min, avg, max) = (9.063, 9.302, 10.640), stdev = 0.431
[info]   CI (99.9%): [8.928, 9.676] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet
[info] # Run progress: 30.56% complete, ETA 00:13:17
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1079435.888 us/op
[info] # Warmup Iteration   2: 26.991 us/op
[info] # Warmup Iteration   3: 23.888 us/op
[info] # Warmup Iteration   4: 18.345 us/op
[info] # Warmup Iteration   5: 18.798 us/op
[info] # Warmup Iteration   6: 18.579 us/op
[info] # Warmup Iteration   7: 18.704 us/op
[info] # Warmup Iteration   8: 18.797 us/op
[info] # Warmup Iteration   9: 18.970 us/op
[info] # Warmup Iteration  10: 18.690 us/op
[info] Iteration   1: 19.162 us/op
[info] Iteration   2: 18.703 us/op
[info] Iteration   3: 19.087 us/op
[info] Iteration   4: 20.299 us/op
[info] Iteration   5: 18.864 us/op
[info] Iteration   6: 18.660 us/op
[info] Iteration   7: 18.720 us/op
[info] Iteration   8: 18.977 us/op
[info] Iteration   9: 19.016 us/op
[info] Iteration  10: 18.529 us/op
[info] Iteration  11: 18.913 us/op
[info] Iteration  12: 18.650 us/op
[info] Iteration  13: 19.121 us/op
[info] Iteration  14: 18.778 us/op
[info] Iteration  15: 18.793 us/op
[info] Iteration  16: 18.677 us/op
[info] Iteration  17: 18.792 us/op
[info] Iteration  18: 18.805 us/op
[info] Iteration  19: 18.940 us/op
[info] Iteration  20: 18.649 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet":
[info]   18.907 ±(99.9%) 0.322 us/op [Average]
[info]   (min, avg, max) = (18.529, 18.907, 20.299), stdev = 0.371
[info]   CI (99.9%): [18.584, 19.229] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array
[info] # Run progress: 33.33% complete, ETA 00:12:43
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 165.053 us/op
[info] # Warmup Iteration   2: 4.736 us/op
[info] # Warmup Iteration   3: 4.663 us/op
[info] # Warmup Iteration   4: 4.671 us/op
[info] # Warmup Iteration   5: 4.659 us/op
[info] # Warmup Iteration   6: 4.618 us/op
[info] # Warmup Iteration   7: 4.681 us/op
[info] # Warmup Iteration   8: 4.646 us/op
[info] # Warmup Iteration   9: 4.768 us/op
[info] # Warmup Iteration  10: 4.656 us/op
[info] Iteration   1: 4.632 us/op
[info] Iteration   2: 4.673 us/op
[info] Iteration   3: 4.676 us/op
[info] Iteration   4: 4.641 us/op
[info] Iteration   5: 4.619 us/op
[info] Iteration   6: 4.638 us/op
[info] Iteration   7: 4.675 us/op
[info] Iteration   8: 4.593 us/op
[info] Iteration   9: 4.584 us/op
[info] Iteration  10: 4.631 us/op
[info] Iteration  11: 4.623 us/op
[info] Iteration  12: 4.674 us/op
[info] Iteration  13: 4.606 us/op
[info] Iteration  14: 4.605 us/op
[info] Iteration  15: 4.637 us/op
[info] Iteration  16: 4.615 us/op
[info] Iteration  17: 4.646 us/op
[info] Iteration  18: 4.588 us/op
[info] Iteration  19: 4.614 us/op
[info] Iteration  20: 4.579 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array":
[info]   4.627 ±(99.9%) 0.027 us/op [Average]
[info]   (min, avg, max) = (4.579, 4.627, 4.676), stdev = 0.031
[info]   CI (99.9%): [4.601, 4.654] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet
[info] # Run progress: 36.11% complete, ETA 00:12:10
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1102503.646 us/op
[info] # Warmup Iteration   2: 1.109 us/op
[info] # Warmup Iteration   3: 1.078 us/op
[info] # Warmup Iteration   4: 0.825 us/op
[info] # Warmup Iteration   5: 0.825 us/op
[info] # Warmup Iteration   6: 0.843 us/op
[info] # Warmup Iteration   7: 0.825 us/op
[info] # Warmup Iteration   8: 0.825 us/op
[info] # Warmup Iteration   9: 0.827 us/op
[info] # Warmup Iteration  10: 0.831 us/op
[info] Iteration   1: 0.827 us/op
[info] Iteration   2: 0.817 us/op
[info] Iteration   3: 0.804 us/op
[info] Iteration   4: 0.822 us/op
[info] Iteration   5: 0.819 us/op
[info] Iteration   6: 0.835 us/op
[info] Iteration   7: 0.825 us/op
[info] Iteration   8: 0.838 us/op
[info] Iteration   9: 0.830 us/op
[info] Iteration  10: 0.833 us/op
[info] Iteration  11: 0.855 us/op
[info] Iteration  12: 0.820 us/op
[info] Iteration  13: 0.830 us/op
[info] Iteration  14: 0.822 us/op
[info] Iteration  15: 0.813 us/op
[info] Iteration  16: 0.837 us/op
[info] Iteration  17: 0.825 us/op
[info] Iteration  18: 0.823 us/op
[info] Iteration  19: 0.814 us/op
[info] Iteration  20: 0.830 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet":
[info]   0.826 ±(99.9%) 0.010 us/op [Average]
[info]   (min, avg, max) = (0.804, 0.826, 0.855), stdev = 0.011
[info]   CI (99.9%): [0.816, 0.835] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet
[info] # Run progress: 38.89% complete, ETA 00:11:37
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 62.105 us/op
[info] # Warmup Iteration   2: 1.927 us/op
[info] # Warmup Iteration   3: 2.296 us/op
[info] # Warmup Iteration   4: 2.520 us/op
[info] # Warmup Iteration   5: 2.561 us/op
[info] # Warmup Iteration   6: 2.509 us/op
[info] # Warmup Iteration   7: 2.528 us/op
[info] # Warmup Iteration   8: 2.510 us/op
[info] # Warmup Iteration   9: 2.539 us/op
[info] # Warmup Iteration  10: 2.544 us/op
[info] Iteration   1: 2.526 us/op
[info] Iteration   2: 2.485 us/op
[info] Iteration   3: 2.474 us/op
[info] Iteration   4: 2.512 us/op
[info] Iteration   5: 2.552 us/op
[info] Iteration   6: 2.524 us/op
[info] Iteration   7: 2.514 us/op
[info] Iteration   8: 2.505 us/op
[info] Iteration   9: 2.537 us/op
[info] Iteration  10: 2.538 us/op
[info] Iteration  11: 2.496 us/op
[info] Iteration  12: 2.511 us/op
[info] Iteration  13: 2.537 us/op
[info] Iteration  14: 2.525 us/op
[info] Iteration  15: 2.531 us/op
[info] Iteration  16: 2.514 us/op
[info] Iteration  17: 2.541 us/op
[info] Iteration  18: 2.520 us/op
[info] Iteration  19: 2.519 us/op
[info] Iteration  20: 2.543 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet":
[info]   2.520 ±(99.9%) 0.017 us/op [Average]
[info]   (min, avg, max) = (2.474, 2.520, 2.552), stdev = 0.020
[info]   CI (99.9%): [2.503, 2.537] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet
[info] # Run progress: 41.67% complete, ETA 00:11:04
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1062889.203 us/op
[info] # Warmup Iteration   2: 7.150 us/op
[info] # Warmup Iteration   3: 6.866 us/op
[info] # Warmup Iteration   4: 6.837 us/op
[info] # Warmup Iteration   5: 6.804 us/op
[info] # Warmup Iteration   6: 6.767 us/op
[info] # Warmup Iteration   7: 6.772 us/op
[info] # Warmup Iteration   8: 6.809 us/op
[info] # Warmup Iteration   9: 6.924 us/op
[info] # Warmup Iteration  10: 6.826 us/op
[info] Iteration   1: 6.782 us/op
[info] Iteration   2: 7.326 us/op
[info] Iteration   3: 7.276 us/op
[info] Iteration   4: 7.321 us/op
[info] Iteration   5: 7.203 us/op
[info] Iteration   6: 7.275 us/op
[info] Iteration   7: 6.812 us/op
[info] Iteration   8: 6.814 us/op
[info] Iteration   9: 6.871 us/op
[info] Iteration  10: 6.799 us/op
[info] Iteration  11: 6.827 us/op
[info] Iteration  12: 6.831 us/op
[info] Iteration  13: 6.770 us/op
[info] Iteration  14: 6.546 us/op
[info] Iteration  15: 6.492 us/op
[info] Iteration  16: 6.777 us/op
[info] Iteration  17: 6.451 us/op
[info] Iteration  18: 6.568 us/op
[info] Iteration  19: 6.558 us/op
[info] Iteration  20: 6.446 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet":
[info]   6.837 ±(99.9%) 0.257 us/op [Average]
[info]   (min, avg, max) = (6.446, 6.837, 7.326), stdev = 0.296
[info]   CI (99.9%): [6.580, 7.094] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set
[info] # Run progress: 44.44% complete, ETA 00:10:31
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1059710.664 us/op
[info] # Warmup Iteration   2: 6.854 us/op
[info] # Warmup Iteration   3: 6.511 us/op
[info] # Warmup Iteration   4: 6.354 us/op
[info] # Warmup Iteration   5: 6.416 us/op
[info] # Warmup Iteration   6: 6.421 us/op
[info] # Warmup Iteration   7: 6.370 us/op
[info] # Warmup Iteration   8: 6.438 us/op
[info] # Warmup Iteration   9: 6.392 us/op
[info] # Warmup Iteration  10: 6.396 us/op
[info] Iteration   1: 6.424 us/op
[info] Iteration   2: 6.351 us/op
[info] Iteration   3: 6.505 us/op
[info] Iteration   4: 6.402 us/op
[info] Iteration   5: 6.363 us/op
[info] Iteration   6: 6.377 us/op
[info] Iteration   7: 6.514 us/op
[info] Iteration   8: 6.482 us/op
[info] Iteration   9: 6.222 us/op
[info] Iteration  10: 6.138 us/op
[info] Iteration  11: 6.132 us/op
[info] Iteration  12: 6.158 us/op
[info] Iteration  13: 6.197 us/op
[info] Iteration  14: 6.100 us/op
[info] Iteration  15: 6.105 us/op
[info] Iteration  16: 6.127 us/op
[info] Iteration  17: 6.134 us/op
[info] Iteration  18: 6.189 us/op
[info] Iteration  19: 6.098 us/op
[info] Iteration  20: 6.102 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set":
[info]   6.256 ±(99.9%) 0.132 us/op [Average]
[info]   (min, avg, max) = (6.098, 6.256, 6.514), stdev = 0.152
[info]   CI (99.9%): [6.124, 6.388] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet
[info] # Run progress: 47.22% complete, ETA 00:09:59
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 237.356 us/op
[info] # Warmup Iteration   2: 8.680 us/op
[info] # Warmup Iteration   3: 8.530 us/op
[info] # Warmup Iteration   4: 7.936 us/op
[info] # Warmup Iteration   5: 7.770 us/op
[info] # Warmup Iteration   6: 7.791 us/op
[info] # Warmup Iteration   7: 7.831 us/op
[info] # Warmup Iteration   8: 7.928 us/op
[info] # Warmup Iteration   9: 7.768 us/op
[info] # Warmup Iteration  10: 7.813 us/op
[info] Iteration   1: 7.773 us/op
[info] Iteration   2: 7.873 us/op
[info] Iteration   3: 7.911 us/op
[info] Iteration   4: 7.868 us/op
[info] Iteration   5: 7.830 us/op
[info] Iteration   6: 7.826 us/op
[info] Iteration   7: 7.803 us/op
[info] Iteration   8: 7.901 us/op
[info] Iteration   9: 7.782 us/op
[info] Iteration  10: 7.896 us/op
[info] Iteration  11: 7.788 us/op
[info] Iteration  12: 7.768 us/op
[info] Iteration  13: 7.920 us/op
[info] Iteration  14: 7.896 us/op
[info] Iteration  15: 7.803 us/op
[info] Iteration  16: 7.842 us/op
[info] Iteration  17: 7.790 us/op
[info] Iteration  18: 7.963 us/op
[info] Iteration  19: 7.826 us/op
[info] Iteration  20: 7.804 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet":
[info]   7.843 ±(99.9%) 0.049 us/op [Average]
[info]   (min, avg, max) = (7.768, 7.843, 7.963), stdev = 0.057
[info]   CI (99.9%): [7.794, 7.892] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Array
[info] # Run progress: 50.00% complete, ETA 00:09:27
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: ≈ 10⁻³ us/op
[info] # Warmup Iteration   2: ≈ 10⁻³ us/op
[info] # Warmup Iteration   3: ≈ 10⁻³ us/op
[info] # Warmup Iteration   4: ≈ 10⁻³ us/op
[info] # Warmup Iteration   5: ≈ 10⁻³ us/op
[info] # Warmup Iteration   6: ≈ 10⁻³ us/op
[info] # Warmup Iteration   7: ≈ 10⁻³ us/op
[info] # Warmup Iteration   8: ≈ 10⁻³ us/op
[info] # Warmup Iteration   9: ≈ 10⁻³ us/op
[info] # Warmup Iteration  10: ≈ 10⁻³ us/op
[info] Iteration   1: ≈ 10⁻³ us/op
[info] Iteration   2: ≈ 10⁻³ us/op
[info] Iteration   3: ≈ 10⁻³ us/op
[info] Iteration   4: ≈ 10⁻³ us/op
[info] Iteration   5: ≈ 10⁻³ us/op
[info] Iteration   6: ≈ 10⁻³ us/op
[info] Iteration   7: ≈ 10⁻³ us/op
[info] Iteration   8: ≈ 10⁻³ us/op
[info] Iteration   9: ≈ 10⁻³ us/op
[info] Iteration  10: ≈ 10⁻³ us/op
[info] Iteration  11: ≈ 10⁻³ us/op
[info] Iteration  12: ≈ 10⁻³ us/op
[info] Iteration  13: ≈ 10⁻³ us/op
[info] Iteration  14: ≈ 10⁻³ us/op
[info] Iteration  15: ≈ 10⁻³ us/op
[info] Iteration  16: ≈ 10⁻³ us/op
[info] Iteration  17: ≈ 10⁻³ us/op
[info] Iteration  18: ≈ 10⁻³ us/op
[info] Iteration  19: ≈ 10⁻³ us/op
[info] Iteration  20: ≈ 10⁻³ us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Array":
[info]   ≈ 10⁻³ us/op
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet
[info] # Run progress: 52.78% complete, ETA 00:08:54
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3056023.523 us/op
[info] # Warmup Iteration   2: 2.950 us/op
[info] # Warmup Iteration   3: 2.800 us/op
[info] # Warmup Iteration   4: 2.842 us/op
[info] # Warmup Iteration   5: 2.835 us/op
[info] # Warmup Iteration   6: 2.831 us/op
[info] # Warmup Iteration   7: 2.813 us/op
[info] # Warmup Iteration   8: 2.793 us/op
[info] # Warmup Iteration   9: 2.836 us/op
[info] # Warmup Iteration  10: 2.806 us/op
[info] Iteration   1: 2.782 us/op
[info] Iteration   2: 2.821 us/op
[info] Iteration   3: 2.806 us/op
[info] Iteration   4: 2.851 us/op
[info] Iteration   5: 2.781 us/op
[info] Iteration   6: 2.838 us/op
[info] Iteration   7: 2.786 us/op
[info] Iteration   8: 2.805 us/op
[info] Iteration   9: 2.820 us/op
[info] Iteration  10: 2.892 us/op
[info] Iteration  11: 2.861 us/op
[info] Iteration  12: 2.780 us/op
[info] Iteration  13: 2.813 us/op
[info] Iteration  14: 2.860 us/op
[info] Iteration  15: 2.816 us/op
[info] Iteration  16: 2.868 us/op
[info] Iteration  17: 2.788 us/op
[info] Iteration  18: 2.816 us/op
[info] Iteration  19: 2.868 us/op
[info] Iteration  20: 2.784 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet":
[info]   2.822 ±(99.9%) 0.030 us/op [Average]
[info]   (min, avg, max) = (2.780, 2.822, 2.892), stdev = 0.035
[info]   CI (99.9%): [2.792, 2.852] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_BitSet
[info] # Run progress: 55.56% complete, ETA 00:08:24
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3053738.074 us/op
[info] # Warmup Iteration   2: 3.151 us/op
[info] # Warmup Iteration   3: 2.783 us/op
[info] # Warmup Iteration   4: 3.450 us/op
[info] # Warmup Iteration   5: 3.413 us/op
[info] # Warmup Iteration   6: 3.457 us/op
[info] # Warmup Iteration   7: 3.412 us/op
[info] # Warmup Iteration   8: 3.432 us/op
[info] # Warmup Iteration   9: 3.415 us/op
[info] # Warmup Iteration  10: 3.421 us/op
[info] Iteration   1: 3.451 us/op
[info] Iteration   2: 3.437 us/op
[info] Iteration   3: 3.425 us/op
[info] Iteration   4: 3.609 us/op
[info] Iteration   5: 3.428 us/op
[info] Iteration   6: 3.480 us/op
[info] Iteration   7: 3.419 us/op
[info] Iteration   8: 3.417 us/op
[info] Iteration   9: 3.413 us/op
[info] Iteration  10: 3.432 us/op
[info] Iteration  11: 3.453 us/op
[info] Iteration  12: 3.412 us/op
[info] Iteration  13: 3.435 us/op
[info] Iteration  14: 3.444 us/op
[info] Iteration  15: 3.412 us/op
[info] Iteration  16: 3.466 us/op
[info] Iteration  17: 3.415 us/op
[info] Iteration  18: 3.436 us/op
[info] Iteration  19: 3.433 us/op
[info] Iteration  20: 3.573 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_BitSet":
[info]   3.449 ±(99.9%) 0.045 us/op [Average]
[info]   (min, avg, max) = (3.412, 3.449, 3.609), stdev = 0.052
[info]   CI (99.9%): [3.404, 3.495] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet
[info] # Run progress: 58.33% complete, ETA 00:07:54
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2886102.863 us/op
[info] # Warmup Iteration   2: 11.242 us/op
[info] # Warmup Iteration   3: 11.249 us/op
[info] # Warmup Iteration   4: 11.076 us/op
[info] # Warmup Iteration   5: 11.104 us/op
[info] # Warmup Iteration   6: 11.068 us/op
[info] # Warmup Iteration   7: 11.295 us/op
[info] # Warmup Iteration   8: 11.138 us/op
[info] # Warmup Iteration   9: 10.791 us/op
[info] # Warmup Iteration  10: 11.011 us/op
[info] Iteration   1: 10.935 us/op
[info] Iteration   2: 11.041 us/op
[info] Iteration   3: 11.111 us/op
[info] Iteration   4: 11.146 us/op
[info] Iteration   5: 11.170 us/op
[info] Iteration   6: 11.010 us/op
[info] Iteration   7: 10.986 us/op
[info] Iteration   8: 11.193 us/op
[info] Iteration   9: 10.963 us/op
[info] Iteration  10: 11.065 us/op
[info] Iteration  11: 11.739 us/op
[info] Iteration  12: 11.044 us/op
[info] Iteration  13: 11.244 us/op
[info] Iteration  14: 11.119 us/op
[info] Iteration  15: 10.996 us/op
[info] Iteration  16: 10.811 us/op
[info] Iteration  17: 11.153 us/op
[info] Iteration  18: 11.136 us/op
[info] Iteration  19: 11.046 us/op
[info] Iteration  20: 10.988 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet":
[info]   11.095 ±(99.9%) 0.159 us/op [Average]
[info]   (min, avg, max) = (10.811, 11.095, 11.739), stdev = 0.183
[info]   CI (99.9%): [10.936, 11.253] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Set
[info] # Run progress: 61.11% complete, ETA 00:07:23
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2902985.679 us/op
[info] # Warmup Iteration   2: 62.611 us/op
[info] # Warmup Iteration   3: 57.123 us/op
[info] # Warmup Iteration   4: 57.839 us/op
[info] # Warmup Iteration   5: 57.453 us/op
[info] # Warmup Iteration   6: 57.950 us/op
[info] # Warmup Iteration   7: 59.143 us/op
[info] # Warmup Iteration   8: 59.042 us/op
[info] # Warmup Iteration   9: 56.731 us/op
[info] # Warmup Iteration  10: 57.019 us/op
[info] Iteration   1: 57.556 us/op
[info] Iteration   2: 56.699 us/op
[info] Iteration   3: 56.450 us/op
[info] Iteration   4: 56.792 us/op
[info] Iteration   5: 56.734 us/op
[info] Iteration   6: 57.640 us/op
[info] Iteration   7: 57.328 us/op
[info] Iteration   8: 57.129 us/op
[info] Iteration   9: 57.000 us/op
[info] Iteration  10: 57.130 us/op
[info] Iteration  11: 57.522 us/op
[info] Iteration  12: 56.657 us/op
[info] Iteration  13: 58.172 us/op
[info] Iteration  14: 56.731 us/op
[info] Iteration  15: 56.531 us/op
[info] Iteration  16: 57.515 us/op
[info] Iteration  17: 56.644 us/op
[info] Iteration  18: 56.982 us/op
[info] Iteration  19: 56.655 us/op
[info] Iteration  20: 56.722 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Set":
[info]   57.029 ±(99.9%) 0.398 us/op [Average]
[info]   (min, avg, max) = (56.450, 57.029, 58.172), stdev = 0.459
[info]   CI (99.9%): [56.631, 57.428] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet
[info] # Run progress: 63.89% complete, ETA 00:06:52
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 4493291.615 us/op
[info] # Warmup Iteration   2: 670.309 us/op
[info] # Warmup Iteration   3: 630.524 us/op
[info] # Warmup Iteration   4: 632.865 us/op
[info] # Warmup Iteration   5: 652.319 us/op
[info] # Warmup Iteration   6: 659.638 us/op
[info] # Warmup Iteration   7: 677.592 us/op
[info] # Warmup Iteration   8: 660.839 us/op
[info] # Warmup Iteration   9: 662.273 us/op
[info] # Warmup Iteration  10: 658.089 us/op
[info] Iteration   1: 658.513 us/op
[info] Iteration   2: 666.167 us/op
[info] Iteration   3: 662.813 us/op
[info] Iteration   4: 693.870 us/op
[info] Iteration   5: 656.882 us/op
[info] Iteration   6: 673.232 us/op
[info] Iteration   7: 664.611 us/op
[info] Iteration   8: 663.561 us/op
[info] Iteration   9: 655.331 us/op
[info] Iteration  10: 660.452 us/op
[info] Iteration  11: 655.117 us/op
[info] Iteration  12: 665.290 us/op
[info] Iteration  13: 652.891 us/op
[info] Iteration  14: 663.483 us/op
[info] Iteration  15: 656.465 us/op
[info] Iteration  16: 656.385 us/op
[info] Iteration  17: 669.122 us/op
[info] Iteration  18: 655.771 us/op
[info] Iteration  19: 657.717 us/op
[info] Iteration  20: 652.075 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet":
[info]   661.987 ±(99.9%) 8.132 us/op [Average]
[info]   (min, avg, max) = (652.075, 661.987, 693.870), stdev = 9.365
[info]   CI (99.9%): [653.856, 670.119] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Array
[info] # Run progress: 66.67% complete, ETA 00:06:21
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1108832.763 us/op
[info] # Warmup Iteration   2: 75.504 us/op
[info] # Warmup Iteration   3: 71.196 us/op
[info] # Warmup Iteration   4: 71.457 us/op
[info] # Warmup Iteration   5: 71.578 us/op
[info] # Warmup Iteration   6: 72.825 us/op
[info] # Warmup Iteration   7: 71.313 us/op
[info] # Warmup Iteration   8: 70.908 us/op
[info] # Warmup Iteration   9: 71.446 us/op
[info] # Warmup Iteration  10: 71.468 us/op
[info] Iteration   1: 72.056 us/op
[info] Iteration   2: 71.086 us/op
[info] Iteration   3: 71.370 us/op
[info] Iteration   4: 71.591 us/op
[info] Iteration   5: 71.186 us/op
[info] Iteration   6: 72.209 us/op
[info] Iteration   7: 71.611 us/op
[info] Iteration   8: 71.474 us/op
[info] Iteration   9: 71.145 us/op
[info] Iteration  10: 71.001 us/op
[info] Iteration  11: 72.559 us/op
[info] Iteration  12: 71.700 us/op
[info] Iteration  13: 71.378 us/op
[info] Iteration  14: 70.998 us/op
[info] Iteration  15: 71.120 us/op
[info] Iteration  16: 72.500 us/op
[info] Iteration  17: 71.008 us/op
[info] Iteration  18: 71.131 us/op
[info] Iteration  19: 71.356 us/op
[info] Iteration  20: 71.278 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Array":
[info]   71.488 ±(99.9%) 0.423 us/op [Average]
[info]   (min, avg, max) = (70.998, 71.488, 72.559), stdev = 0.487
[info]   CI (99.9%): [71.065, 71.911] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet
[info] # Run progress: 69.44% complete, ETA 00:05:49
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1083172.223 us/op
[info] # Warmup Iteration   2: 1.145 us/op
[info] # Warmup Iteration   3: 1.104 us/op
[info] # Warmup Iteration   4: 0.843 us/op
[info] # Warmup Iteration   5: 0.864 us/op
[info] # Warmup Iteration   6: 0.894 us/op
[info] # Warmup Iteration   7: 0.854 us/op
[info] # Warmup Iteration   8: 0.863 us/op
[info] # Warmup Iteration   9: 0.850 us/op
[info] # Warmup Iteration  10: 0.872 us/op
[info] Iteration   1: 0.852 us/op
[info] Iteration   2: 0.848 us/op
[info] Iteration   3: 0.840 us/op
[info] Iteration   4: 0.838 us/op
[info] Iteration   5: 0.820 us/op
[info] Iteration   6: 0.843 us/op
[info] Iteration   7: 0.815 us/op
[info] Iteration   8: 0.841 us/op
[info] Iteration   9: 0.809 us/op
[info] Iteration  10: 0.858 us/op
[info] Iteration  11: 0.809 us/op
[info] Iteration  12: 0.841 us/op
[info] Iteration  13: 0.808 us/op
[info] Iteration  14: 0.845 us/op
[info] Iteration  15: 0.819 us/op
[info] Iteration  16: 0.843 us/op
[info] Iteration  17: 0.816 us/op
[info] Iteration  18: 0.848 us/op
[info] Iteration  19: 0.808 us/op
[info] Iteration  20: 0.851 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet":
[info]   0.833 ±(99.9%) 0.015 us/op [Average]
[info]   (min, avg, max) = (0.808, 0.833, 0.858), stdev = 0.017
[info]   CI (99.9%): [0.818, 0.847] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_BitSet
[info] # Run progress: 72.22% complete, ETA 00:05:17
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1015928.350 us/op
[info] # Warmup Iteration   2: 2.725 us/op
[info] # Warmup Iteration   3: 2.269 us/op
[info] # Warmup Iteration   4: 2.997 us/op
[info] # Warmup Iteration   5: 2.935 us/op
[info] # Warmup Iteration   6: 2.968 us/op
[info] # Warmup Iteration   7: 2.894 us/op
[info] # Warmup Iteration   8: 2.911 us/op
[info] # Warmup Iteration   9: 2.953 us/op
[info] # Warmup Iteration  10: 2.915 us/op
[info] Iteration   1: 2.917 us/op
[info] Iteration   2: 2.868 us/op
[info] Iteration   3: 2.918 us/op
[info] Iteration   4: 2.897 us/op
[info] Iteration   5: 2.894 us/op
[info] Iteration   6: 2.905 us/op
[info] Iteration   7: 2.943 us/op
[info] Iteration   8: 2.958 us/op
[info] Iteration   9: 3.005 us/op
[info] Iteration  10: 2.965 us/op
[info] Iteration  11: 3.002 us/op
[info] Iteration  12: 2.971 us/op
[info] Iteration  13: 3.109 us/op
[info] Iteration  14: 3.006 us/op
[info] Iteration  15: 2.983 us/op
[info] Iteration  16: 2.963 us/op
[info] Iteration  17: 2.957 us/op
[info] Iteration  18: 2.964 us/op
[info] Iteration  19: 3.005 us/op
[info] Iteration  20: 2.987 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_BitSet":
[info]   2.961 ±(99.9%) 0.047 us/op [Average]
[info]   (min, avg, max) = (2.868, 2.961, 3.109), stdev = 0.054
[info]   CI (99.9%): [2.914, 3.008] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet
[info] # Run progress: 75.00% complete, ETA 00:04:45
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1061561.571 us/op
[info] # Warmup Iteration   2: 6.261 us/op
[info] # Warmup Iteration   3: 6.127 us/op
[info] # Warmup Iteration   4: 5.951 us/op
[info] # Warmup Iteration   5: 6.141 us/op
[info] # Warmup Iteration   6: 5.950 us/op
[info] # Warmup Iteration   7: 5.894 us/op
[info] # Warmup Iteration   8: 6.005 us/op
[info] # Warmup Iteration   9: 5.983 us/op
[info] # Warmup Iteration  10: 5.963 us/op
[info] Iteration   1: 6.012 us/op
[info] Iteration   2: 5.908 us/op
[info] Iteration   3: 6.096 us/op
[info] Iteration   4: 5.985 us/op
[info] Iteration   5: 5.977 us/op
[info] Iteration   6: 5.939 us/op
[info] Iteration   7: 5.987 us/op
[info] Iteration   8: 6.029 us/op
[info] Iteration   9: 6.000 us/op
[info] Iteration  10: 5.951 us/op
[info] Iteration  11: 5.898 us/op
[info] Iteration  12: 5.903 us/op
[info] Iteration  13: 5.957 us/op
[info] Iteration  14: 5.884 us/op
[info] Iteration  15: 5.883 us/op
[info] Iteration  16: 5.913 us/op
[info] Iteration  17: 5.882 us/op
[info] Iteration  18: 5.976 us/op
[info] Iteration  19: 5.917 us/op
[info] Iteration  20: 6.456 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet":
[info]   5.978 ±(99.9%) 0.109 us/op [Average]
[info]   (min, avg, max) = (5.882, 5.978, 6.456), stdev = 0.126
[info]   CI (99.9%): [5.868, 6.087] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Set
[info] # Run progress: 77.78% complete, ETA 00:04:13
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 20848.915 us/op
[info] # Warmup Iteration   2: 7.893 us/op
[info] # Warmup Iteration   3: 7.410 us/op
[info] # Warmup Iteration   4: 7.426 us/op
[info] # Warmup Iteration   5: 7.350 us/op
[info] # Warmup Iteration   6: 7.351 us/op
[info] # Warmup Iteration   7: 7.447 us/op
[info] # Warmup Iteration   8: 7.375 us/op
[info] # Warmup Iteration   9: 7.384 us/op
[info] # Warmup Iteration  10: 7.356 us/op
[info] Iteration   1: 7.399 us/op
[info] Iteration   2: 7.484 us/op
[info] Iteration   3: 7.345 us/op
[info] Iteration   4: 7.344 us/op
[info] Iteration   5: 7.383 us/op
[info] Iteration   6: 7.405 us/op
[info] Iteration   7: 7.466 us/op
[info] Iteration   8: 7.356 us/op
[info] Iteration   9: 7.378 us/op
[info] Iteration  10: 7.379 us/op
[info] Iteration  11: 7.333 us/op
[info] Iteration  12: 7.431 us/op
[info] Iteration  13: 7.307 us/op
[info] Iteration  14: 7.346 us/op
[info] Iteration  15: 7.348 us/op
[info] Iteration  16: 7.310 us/op
[info] Iteration  17: 7.424 us/op
[info] Iteration  18: 7.357 us/op
[info] Iteration  19: 7.551 us/op
[info] Iteration  20: 7.541 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Set":
[info]   7.394 ±(99.9%) 0.061 us/op [Average]
[info]   (min, avg, max) = (7.307, 7.394, 7.551), stdev = 0.070
[info]   CI (99.9%): [7.334, 7.455] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet
[info] # Run progress: 80.56% complete, ETA 00:03:41
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1086998.282 us/op
[info] # Warmup Iteration   2: 18.432 us/op
[info] # Warmup Iteration   3: 17.909 us/op
[info] # Warmup Iteration   4: 18.025 us/op
[info] # Warmup Iteration   5: 18.383 us/op
[info] # Warmup Iteration   6: 18.515 us/op
[info] # Warmup Iteration   7: 18.444 us/op
[info] # Warmup Iteration   8: 19.283 us/op
[info] # Warmup Iteration   9: 18.456 us/op
[info] # Warmup Iteration  10: 18.321 us/op
[info] Iteration   1: 18.545 us/op
[info] Iteration   2: 18.333 us/op
[info] Iteration   3: 18.553 us/op
[info] Iteration   4: 18.523 us/op
[info] Iteration   5: 18.384 us/op
[info] Iteration   6: 18.522 us/op
[info] Iteration   7: 18.559 us/op
[info] Iteration   8: 18.603 us/op
[info] Iteration   9: 18.491 us/op
[info] Iteration  10: 18.335 us/op
[info] Iteration  11: 18.701 us/op
[info] Iteration  12: 18.325 us/op
[info] Iteration  13: 18.291 us/op
[info] Iteration  14: 18.354 us/op
[info] Iteration  15: 18.512 us/op
[info] Iteration  16: 18.636 us/op
[info] Iteration  17: 18.352 us/op
[info] Iteration  18: 18.473 us/op
[info] Iteration  19: 18.562 us/op
[info] Iteration  20: 19.482 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet":
[info]   18.527 ±(99.9%) 0.220 us/op [Average]
[info]   (min, avg, max) = (18.291, 18.527, 19.482), stdev = 0.253
[info]   CI (99.9%): [18.307, 18.747] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array
[info] # Run progress: 83.33% complete, ETA 00:03:09
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 149.556 us/op
[info] # Warmup Iteration   2: 4.792 us/op
[info] # Warmup Iteration   3: 4.617 us/op
[info] # Warmup Iteration   4: 4.639 us/op
[info] # Warmup Iteration   5: 4.609 us/op
[info] # Warmup Iteration   6: 4.698 us/op
[info] # Warmup Iteration   7: 4.662 us/op
[info] # Warmup Iteration   8: 4.657 us/op
[info] # Warmup Iteration   9: 4.639 us/op
[info] # Warmup Iteration  10: 4.648 us/op
[info] Iteration   1: 4.662 us/op
[info] Iteration   2: 4.636 us/op
[info] Iteration   3: 4.659 us/op
[info] Iteration   4: 4.633 us/op
[info] Iteration   5: 4.649 us/op
[info] Iteration   6: 4.711 us/op
[info] Iteration   7: 4.586 us/op
[info] Iteration   8: 4.594 us/op
[info] Iteration   9: 4.599 us/op
[info] Iteration  10: 4.634 us/op
[info] Iteration  11: 4.646 us/op
[info] Iteration  12: 4.588 us/op
[info] Iteration  13: 4.592 us/op
[info] Iteration  14: 4.611 us/op
[info] Iteration  15: 4.575 us/op
[info] Iteration  16: 4.675 us/op
[info] Iteration  17: 4.606 us/op
[info] Iteration  18: 4.600 us/op
[info] Iteration  19: 4.587 us/op
[info] Iteration  20: 4.585 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array":
[info]   4.621 ±(99.9%) 0.032 us/op [Average]
[info]   (min, avg, max) = (4.575, 4.621, 4.711), stdev = 0.037
[info]   CI (99.9%): [4.589, 4.653] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet
[info] # Run progress: 86.11% complete, ETA 00:02:37
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 34.643 us/op
[info] # Warmup Iteration   2: 1.007 us/op
[info] # Warmup Iteration   3: 0.999 us/op
[info] # Warmup Iteration   4: 0.772 us/op
[info] # Warmup Iteration   5: 0.824 us/op
[info] # Warmup Iteration   6: 0.793 us/op
[info] # Warmup Iteration   7: 0.805 us/op
[info] # Warmup Iteration   8: 0.809 us/op
[info] # Warmup Iteration   9: 0.821 us/op
[info] # Warmup Iteration  10: 0.814 us/op
[info] Iteration   1: 0.811 us/op
[info] Iteration   2: 0.813 us/op
[info] Iteration   3: 0.840 us/op
[info] Iteration   4: 0.769 us/op
[info] Iteration   5: 0.822 us/op
[info] Iteration   6: 0.807 us/op
[info] Iteration   7: 0.825 us/op
[info] Iteration   8: 0.802 us/op
[info] Iteration   9: 0.803 us/op
[info] Iteration  10: 0.824 us/op
[info] Iteration  11: 0.818 us/op
[info] Iteration  12: 0.770 us/op
[info] Iteration  13: 0.812 us/op
[info] Iteration  14: 0.772 us/op
[info] Iteration  15: 0.822 us/op
[info] Iteration  16: 0.809 us/op
[info] Iteration  17: 0.809 us/op
[info] Iteration  18: 0.844 us/op
[info] Iteration  19: 0.786 us/op
[info] Iteration  20: 0.815 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet":
[info]   0.809 ±(99.9%) 0.018 us/op [Average]
[info]   (min, avg, max) = (0.769, 0.809, 0.844), stdev = 0.021
[info]   CI (99.9%): [0.790, 0.827] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet
[info] # Run progress: 88.89% complete, ETA 00:02:06
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 64.632 us/op
[info] # Warmup Iteration   2: 1.910 us/op
[info] # Warmup Iteration   3: 2.129 us/op
[info] # Warmup Iteration   4: 2.567 us/op
[info] # Warmup Iteration   5: 2.519 us/op
[info] # Warmup Iteration   6: 2.496 us/op
[info] # Warmup Iteration   7: 2.506 us/op
[info] # Warmup Iteration   8: 2.487 us/op
[info] # Warmup Iteration   9: 2.513 us/op
[info] # Warmup Iteration  10: 2.492 us/op
[info] Iteration   1: 2.474 us/op
[info] Iteration   2: 2.489 us/op
[info] Iteration   3: 2.481 us/op
[info] Iteration   4: 2.527 us/op
[info] Iteration   5: 2.484 us/op
[info] Iteration   6: 2.506 us/op
[info] Iteration   7: 2.510 us/op
[info] Iteration   8: 2.483 us/op
[info] Iteration   9: 2.511 us/op
[info] Iteration  10: 2.484 us/op
[info] Iteration  11: 2.489 us/op
[info] Iteration  12: 2.486 us/op
[info] Iteration  13: 2.528 us/op
[info] Iteration  14: 2.747 us/op
[info] Iteration  15: 2.483 us/op
[info] Iteration  16: 2.507 us/op
[info] Iteration  17: 2.471 us/op
[info] Iteration  18: 2.487 us/op
[info] Iteration  19: 2.559 us/op
[info] Iteration  20: 2.493 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet":
[info]   2.510 ±(99.9%) 0.052 us/op [Average]
[info]   (min, avg, max) = (2.471, 2.510, 2.747), stdev = 0.060
[info]   CI (99.9%): [2.458, 2.562] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet
[info] # Run progress: 91.67% complete, ETA 00:01:34
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 118.329 us/op
[info] # Warmup Iteration   2: 6.006 us/op
[info] # Warmup Iteration   3: 6.029 us/op
[info] # Warmup Iteration   4: 5.858 us/op
[info] # Warmup Iteration   5: 5.918 us/op
[info] # Warmup Iteration   6: 5.901 us/op
[info] # Warmup Iteration   7: 5.896 us/op
[info] # Warmup Iteration   8: 5.956 us/op
[info] # Warmup Iteration   9: 5.870 us/op
[info] # Warmup Iteration  10: 5.867 us/op
[info] Iteration   1: 5.895 us/op
[info] Iteration   2: 5.877 us/op
[info] Iteration   3: 6.013 us/op
[info] Iteration   4: 5.860 us/op
[info] Iteration   5: 5.961 us/op
[info] Iteration   6: 5.887 us/op
[info] Iteration   7: 5.903 us/op
[info] Iteration   8: 5.974 us/op
[info] Iteration   9: 5.922 us/op
[info] Iteration  10: 5.853 us/op
[info] Iteration  11: 5.831 us/op
[info] Iteration  12: 5.853 us/op
[info] Iteration  13: 5.957 us/op
[info] Iteration  14: 5.872 us/op
[info] Iteration  15: 6.213 us/op
[info] Iteration  16: 5.867 us/op
[info] Iteration  17: 5.887 us/op
[info] Iteration  18: 5.899 us/op
[info] Iteration  19: 5.895 us/op
[info] Iteration  20: 5.842 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet":
[info]   5.913 ±(99.9%) 0.074 us/op [Average]
[info]   (min, avg, max) = (5.831, 5.913, 6.213), stdev = 0.085
[info]   CI (99.9%): [5.839, 5.987] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set
[info] # Run progress: 94.44% complete, ETA 00:01:03
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1050786.894 us/op
[info] # Warmup Iteration   2: 5.899 us/op
[info] # Warmup Iteration   3: 5.596 us/op
[info] # Warmup Iteration   4: 5.632 us/op
[info] # Warmup Iteration   5: 5.569 us/op
[info] # Warmup Iteration   6: 5.548 us/op
[info] # Warmup Iteration   7: 5.626 us/op
[info] # Warmup Iteration   8: 5.569 us/op
[info] # Warmup Iteration   9: 5.577 us/op
[info] # Warmup Iteration  10: 5.560 us/op
[info] Iteration   1: 5.581 us/op
[info] Iteration   2: 5.660 us/op
[info] Iteration   3: 5.575 us/op
[info] Iteration   4: 5.569 us/op
[info] Iteration   5: 5.887 us/op
[info] Iteration   6: 5.594 us/op
[info] Iteration   7: 5.606 us/op
[info] Iteration   8: 5.467 us/op
[info] Iteration   9: 5.481 us/op
[info] Iteration  10: 5.499 us/op
[info] Iteration  11: 5.478 us/op
[info] Iteration  12: 5.536 us/op
[info] Iteration  13: 5.485 us/op
[info] Iteration  14: 5.957 us/op
[info] Iteration  15: 5.482 us/op
[info] Iteration  16: 5.479 us/op
[info] Iteration  17: 5.535 us/op
[info] Iteration  18: 5.540 us/op
[info] Iteration  19: 5.521 us/op
[info] Iteration  20: 5.472 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set":
[info]   5.570 ±(99.9%) 0.115 us/op [Average]
[info]   (min, avg, max) = (5.467, 5.570, 5.957), stdev = 0.132
[info]   CI (99.9%): [5.456, 5.685] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet
[info] # Run progress: 97.22% complete, ETA 00:00:31
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1076944.713 us/op
[info] # Warmup Iteration   2: 9.039 us/op
[info] # Warmup Iteration   3: 9.643 us/op
[info] # Warmup Iteration   4: 8.002 us/op
[info] # Warmup Iteration   5: 7.823 us/op
[info] # Warmup Iteration   6: 7.851 us/op
[info] # Warmup Iteration   7: 7.909 us/op
[info] # Warmup Iteration   8: 7.926 us/op
[info] # Warmup Iteration   9: 9.231 us/op
[info] # Warmup Iteration  10: 7.896 us/op
[info] Iteration   1: 7.812 us/op
[info] Iteration   2: 7.906 us/op
[info] Iteration   3: 8.097 us/op
[info] Iteration   4: 8.591 us/op
[info] Iteration   5: 7.830 us/op
[info] Iteration   6: 7.878 us/op
[info] Iteration   7: 7.979 us/op
[info] Iteration   8: 7.839 us/op
[info] Iteration   9: 7.826 us/op
[info] Iteration  10: 7.829 us/op
[info] Iteration  11: 7.815 us/op
[info] Iteration  12: 7.990 us/op
[info] Iteration  13: 7.838 us/op
[info] Iteration  14: 7.800 us/op
[info] Iteration  15: 8.154 us/op
[info] Iteration  16: 7.865 us/op
[info] Iteration  17: 7.910 us/op
[info] Iteration  18: 7.821 us/op
[info] Iteration  19: 7.839 us/op
[info] Iteration  20: 7.878 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet":
[info]   7.925 ±(99.9%) 0.160 us/op [Average]
[info]   (min, avg, max) = (7.800, 7.925, 8.591), stdev = 0.184
[info]   CI (99.9%): [7.765, 8.085] (assumes normal distribution)
[info] # Run complete. Total time: 00:18:53
[info] REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on
[info] why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial
[info] experiments, perform baseline and negative tests that provide experimental control, make sure
[info] the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts.
[info] Do not assume the numbers tell you what you want them to tell.
[info] NOTE: Current JVM experimentally supports Compiler Blackholes, and they are in use. Please exercise
[info] extra caution when trusting the results, look into the generated code to check the benchmark still
[info] works, and factor in a small probability of new VM bugs. Additionally, while comparisons between
[info] different JVMs are already problematic, the performance difference caused by different Blackhole
[info] modes can be very significant. Please make sure you use the consistent Blackhole mode for comparisons.
[info] Benchmark                                                       Mode  Cnt    Score    Error  Units
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_Array            avgt   20   ≈ 10⁻³           us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet         avgt   20    2.471 ±  0.021  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet           avgt   20    3.433 ±  0.020  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet      avgt   20   12.092 ±  0.168  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_Set              avgt   20   47.875 ±  0.320  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet        avgt   20  663.188 ±  9.702  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_Array            avgt   20   71.745 ±  1.178  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet         avgt   20    0.894 ±  0.014  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet           avgt   20    3.102 ±  0.051  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet      avgt   20    6.547 ±  0.116  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_Set              avgt   20    9.302 ±  0.374  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet        avgt   20   18.907 ±  0.322  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array        avgt   20    4.627 ±  0.027  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet     avgt   20    0.826 ±  0.010  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet       avgt   20    2.520 ±  0.017  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet  avgt   20    6.837 ±  0.257  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set          avgt   20    6.256 ±  0.132  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet    avgt   20    7.843 ±  0.049  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_Array               avgt   20   ≈ 10⁻³           us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet            avgt   20    2.822 ±  0.030  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_BitSet              avgt   20    3.449 ±  0.045  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet         avgt   20   11.095 ±  0.159  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_Set                 avgt   20   57.029 ±  0.398  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet           avgt   20  661.987 ±  8.132  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_Array               avgt   20   71.488 ±  0.423  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet            avgt   20    0.833 ±  0.015  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_BitSet              avgt   20    2.961 ±  0.047  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet         avgt   20    5.978 ±  0.109  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_Set                 avgt   20    7.394 ±  0.061  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet           avgt   20   18.527 ±  0.220  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array           avgt   20    4.621 ±  0.032  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet        avgt   20    0.809 ±  0.018  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet          avgt   20    2.510 ±  0.052  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet     avgt   20    5.913 ±  0.074  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set             avgt   20    5.570 ±  0.115  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet       avgt   20    7.925 ±  0.160  us/op
[success] Total time: 1136 s (18:56), completed Nov 6, 2024, 12:34:06 PM
[info] welcome to sbt 1.10.1 (Eclipse Adoptium Java 21.0.4)
[info] loading settings for project global-plugins from metals.sbt,plugins.sbt ...
[info] loading global plugins from /home/gaelrenoux/.sbt/1.0/plugins
[info] loading settings for project public-scalaio2024-benchmarks-build from plugins.sbt ...
[info] loading project definition from /home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/project
[success] Generated .bloop/public-scalaio2024-benchmarks-build.json
[success] Total time: 0 s, completed Nov 6, 2024, 12:34:12 PM
[info] loading settings for project public-scalaio2024-benchmarks from build.sbt ...
[info] set current project to scalaio2024-benchmarks (in build file:/home/gaelrenoux/Repositories/DataDome/public-scalaio2024-benchmarks/)
[info] running (fork) org.openjdk.jmh.Main -i 20 -wi 10 -f1 -t1 .*chapter3.SetBenchmark_.*Invoice_HalfHit_(VerySmall|Small|Large).*
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Array
[info] # Run progress: 0.00% complete, ETA 00:18:00
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: ≈ 10⁻³ us/op
[info] # Warmup Iteration   2: ≈ 10⁻³ us/op
[info] # Warmup Iteration   3: ≈ 10⁻³ us/op
[info] # Warmup Iteration   4: ≈ 10⁻³ us/op
[info] # Warmup Iteration   5: ≈ 10⁻³ us/op
[info] # Warmup Iteration   6: ≈ 10⁻³ us/op
[info] # Warmup Iteration   7: ≈ 10⁻³ us/op
[info] # Warmup Iteration   8: ≈ 10⁻³ us/op
[info] # Warmup Iteration   9: ≈ 10⁻³ us/op
[info] # Warmup Iteration  10: ≈ 10⁻³ us/op
[info] Iteration   1: ≈ 10⁻³ us/op
[info] Iteration   2: ≈ 10⁻³ us/op
[info] Iteration   3: ≈ 10⁻³ us/op
[info] Iteration   4: ≈ 10⁻³ us/op
[info] Iteration   5: ≈ 10⁻³ us/op
[info] Iteration   6: ≈ 10⁻³ us/op
[info] Iteration   7: ≈ 10⁻³ us/op
[info] Iteration   8: ≈ 10⁻³ us/op
[info] Iteration   9: ≈ 10⁻³ us/op
[info] Iteration  10: ≈ 10⁻³ us/op
[info] Iteration  11: ≈ 10⁻³ us/op
[info] Iteration  12: ≈ 10⁻³ us/op
[info] Iteration  13: ≈ 10⁻³ us/op
[info] Iteration  14: ≈ 10⁻³ us/op
[info] Iteration  15: ≈ 10⁻³ us/op
[info] Iteration  16: ≈ 10⁻³ us/op
[info] Iteration  17: ≈ 10⁻³ us/op
[info] Iteration  18: ≈ 10⁻³ us/op
[info] Iteration  19: ≈ 10⁻³ us/op
[info] Iteration  20: ≈ 10⁻³ us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Array":
[info]   ≈ 10⁻³ us/op
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet
[info] # Run progress: 2.78% complete, ETA 00:18:00
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2799607.689 us/op
[info] # Warmup Iteration   2: 2.968 us/op
[info] # Warmup Iteration   3: 2.841 us/op
[info] # Warmup Iteration   4: 2.818 us/op
[info] # Warmup Iteration   5: 2.795 us/op
[info] # Warmup Iteration   6: 2.818 us/op
[info] # Warmup Iteration   7: 2.796 us/op
[info] # Warmup Iteration   8: 2.857 us/op
[info] # Warmup Iteration   9: 2.801 us/op
[info] # Warmup Iteration  10: 2.809 us/op
[info] Iteration   1: 2.920 us/op
[info] Iteration   2: 3.701 us/op
[info] Iteration   3: 2.860 us/op
[info] Iteration   4: 2.809 us/op
[info] Iteration   5: 2.796 us/op
[info] Iteration   6: 2.793 us/op
[info] Iteration   7: 2.816 us/op
[info] Iteration   8: 2.822 us/op
[info] Iteration   9: 2.798 us/op
[info] Iteration  10: 2.809 us/op
[info] Iteration  11: 2.808 us/op
[info] Iteration  12: 2.822 us/op
[info] Iteration  13: 2.841 us/op
[info] Iteration  14: 2.799 us/op
[info] Iteration  15: 2.812 us/op
[info] Iteration  16: 2.807 us/op
[info] Iteration  17: 2.799 us/op
[info] Iteration  18: 2.829 us/op
[info] Iteration  19: 2.816 us/op
[info] Iteration  20: 2.824 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet":
[info]   2.864 ±(99.9%) 0.173 us/op [Average]
[info]   (min, avg, max) = (2.793, 2.864, 3.701), stdev = 0.199
[info]   CI (99.9%): [2.691, 3.037] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet
[info] # Run progress: 5.56% complete, ETA 00:17:59
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2987955.937 us/op
[info] # Warmup Iteration   2: 3.123 us/op
[info] # Warmup Iteration   3: 2.722 us/op
[info] # Warmup Iteration   4: 3.429 us/op
[info] # Warmup Iteration   5: 3.463 us/op
[info] # Warmup Iteration   6: 3.413 us/op
[info] # Warmup Iteration   7: 3.429 us/op
[info] # Warmup Iteration   8: 3.426 us/op
[info] # Warmup Iteration   9: 3.399 us/op
[info] # Warmup Iteration  10: 3.462 us/op
[info] Iteration   1: 3.411 us/op
[info] Iteration   2: 3.432 us/op
[info] Iteration   3: 3.402 us/op
[info] Iteration   4: 3.407 us/op
[info] Iteration   5: 3.447 us/op
[info] Iteration   6: 3.419 us/op
[info] Iteration   7: 3.413 us/op
[info] Iteration   8: 3.405 us/op
[info] Iteration   9: 3.404 us/op
[info] Iteration  10: 3.462 us/op
[info] Iteration  11: 3.406 us/op
[info] Iteration  12: 3.403 us/op
[info] Iteration  13: 3.406 us/op
[info] Iteration  14: 3.422 us/op
[info] Iteration  15: 3.444 us/op
[info] Iteration  16: 3.410 us/op
[info] Iteration  17: 3.416 us/op
[info] Iteration  18: 3.430 us/op
[info] Iteration  19: 3.404 us/op
[info] Iteration  20: 3.451 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet":
[info]   3.420 ±(99.9%) 0.016 us/op [Average]
[info]   (min, avg, max) = (3.402, 3.420, 3.462), stdev = 0.018
[info]   CI (99.9%): [3.404, 3.436] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet
[info] # Run progress: 8.33% complete, ETA 00:17:39
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3121902.954 us/op
[info] # Warmup Iteration   2: 12.891 us/op
[info] # Warmup Iteration   3: 12.521 us/op
[info] # Warmup Iteration   4: 12.231 us/op
[info] # Warmup Iteration   5: 12.176 us/op
[info] # Warmup Iteration   6: 12.186 us/op
[info] # Warmup Iteration   7: 12.341 us/op
[info] # Warmup Iteration   8: 12.178 us/op
[info] # Warmup Iteration   9: 12.214 us/op
[info] # Warmup Iteration  10: 12.105 us/op
[info] Iteration   1: 12.150 us/op
[info] Iteration   2: 11.829 us/op
[info] Iteration   3: 12.073 us/op
[info] Iteration   4: 12.118 us/op
[info] Iteration   5: 12.238 us/op
[info] Iteration   6: 11.771 us/op
[info] Iteration   7: 12.299 us/op
[info] Iteration   8: 12.106 us/op
[info] Iteration   9: 12.265 us/op
[info] Iteration  10: 12.112 us/op
[info] Iteration  11: 12.121 us/op
[info] Iteration  12: 12.221 us/op
[info] Iteration  13: 12.200 us/op
[info] Iteration  14: 12.136 us/op
[info] Iteration  15: 12.063 us/op
[info] Iteration  16: 11.829 us/op
[info] Iteration  17: 12.356 us/op
[info] Iteration  18: 12.095 us/op
[info] Iteration  19: 12.094 us/op
[info] Iteration  20: 12.089 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet":
[info]   12.108 ±(99.9%) 0.132 us/op [Average]
[info]   (min, avg, max) = (11.771, 12.108, 12.356), stdev = 0.152
[info]   CI (99.9%): [11.977, 12.240] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Set
[info] # Run progress: 11.11% complete, ETA 00:17:14
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2875427.528 us/op
[info] # Warmup Iteration   2: 51.496 us/op
[info] # Warmup Iteration   3: 47.699 us/op
[info] # Warmup Iteration   4: 48.311 us/op
[info] # Warmup Iteration   5: 48.738 us/op
[info] # Warmup Iteration   6: 48.423 us/op
[info] # Warmup Iteration   7: 47.625 us/op
[info] # Warmup Iteration   8: 47.599 us/op
[info] # Warmup Iteration   9: 47.635 us/op
[info] # Warmup Iteration  10: 48.060 us/op
[info] Iteration   1: 48.532 us/op
[info] Iteration   2: 47.574 us/op
[info] Iteration   3: 47.494 us/op
[info] Iteration   4: 47.468 us/op
[info] Iteration   5: 48.611 us/op
[info] Iteration   6: 47.503 us/op
[info] Iteration   7: 47.728 us/op
[info] Iteration   8: 47.572 us/op
[info] Iteration   9: 47.147 us/op
[info] Iteration  10: 47.488 us/op
[info] Iteration  11: 47.067 us/op
[info] Iteration  12: 47.281 us/op
[info] Iteration  13: 48.406 us/op
[info] Iteration  14: 50.815 us/op
[info] Iteration  15: 47.782 us/op
[info] Iteration  16: 47.388 us/op
[info] Iteration  17: 47.795 us/op
[info] Iteration  18: 47.462 us/op
[info] Iteration  19: 47.786 us/op
[info] Iteration  20: 48.073 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_Set":
[info]   47.849 ±(99.9%) 0.710 us/op [Average]
[info]   (min, avg, max) = (47.067, 47.849, 50.815), stdev = 0.817
[info]   CI (99.9%): [47.139, 48.558] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet
[info] # Run progress: 13.89% complete, ETA 00:16:44
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 4590403.606 us/op
[info] # Warmup Iteration   2: 656.933 us/op
[info] # Warmup Iteration   3: 621.672 us/op
[info] # Warmup Iteration   4: 620.825 us/op
[info] # Warmup Iteration   5: 651.522 us/op
[info] # Warmup Iteration   6: 646.407 us/op
[info] # Warmup Iteration   7: 655.177 us/op
[info] # Warmup Iteration   8: 647.726 us/op
[info] # Warmup Iteration   9: 651.542 us/op
[info] # Warmup Iteration  10: 657.071 us/op
[info] Iteration   1: 646.694 us/op
[info] Iteration   2: 650.116 us/op
[info] Iteration   3: 655.092 us/op
[info] Iteration   4: 643.752 us/op
[info] Iteration   5: 660.166 us/op
[info] Iteration   6: 647.508 us/op
[info] Iteration   7: 655.705 us/op
[info] Iteration   8: 645.541 us/op
[info] Iteration   9: 647.955 us/op
[info] Iteration  10: 656.247 us/op
[info] Iteration  11: 656.380 us/op
[info] Iteration  12: 648.799 us/op
[info] Iteration  13: 646.744 us/op
[info] Iteration  14: 663.685 us/op
[info] Iteration  15: 660.455 us/op
[info] Iteration  16: 648.355 us/op
[info] Iteration  17: 646.751 us/op
[info] Iteration  18: 641.361 us/op
[info] Iteration  19: 646.083 us/op
[info] Iteration  20: 660.916 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet":
[info]   651.415 ±(99.9%) 5.679 us/op [Average]
[info]   (min, avg, max) = (641.361, 651.415, 663.685), stdev = 6.540
[info]   CI (99.9%): [645.736, 657.095] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Array
[info] # Run progress: 16.67% complete, ETA 00:16:22
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1083563.476 us/op
[info] # Warmup Iteration   2: 75.008 us/op
[info] # Warmup Iteration   3: 71.038 us/op
[info] # Warmup Iteration   4: 71.798 us/op
[info] # Warmup Iteration   5: 70.825 us/op
[info] # Warmup Iteration   6: 71.538 us/op
[info] # Warmup Iteration   7: 71.439 us/op
[info] # Warmup Iteration   8: 70.537 us/op
[info] # Warmup Iteration   9: 71.615 us/op
[info] # Warmup Iteration  10: 71.200 us/op
[info] Iteration   1: 70.626 us/op
[info] Iteration   2: 70.456 us/op
[info] Iteration   3: 70.651 us/op
[info] Iteration   4: 71.951 us/op
[info] Iteration   5: 70.614 us/op
[info] Iteration   6: 70.762 us/op
[info] Iteration   7: 70.394 us/op
[info] Iteration   8: 70.835 us/op
[info] Iteration   9: 72.027 us/op
[info] Iteration  10: 70.530 us/op
[info] Iteration  11: 71.440 us/op
[info] Iteration  12: 71.479 us/op
[info] Iteration  13: 70.445 us/op
[info] Iteration  14: 71.288 us/op
[info] Iteration  15: 70.845 us/op
[info] Iteration  16: 71.289 us/op
[info] Iteration  17: 73.088 us/op
[info] Iteration  18: 71.547 us/op
[info] Iteration  19: 71.499 us/op
[info] Iteration  20: 70.848 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Array":
[info]   71.131 ±(99.9%) 0.593 us/op [Average]
[info]   (min, avg, max) = (70.394, 71.131, 73.088), stdev = 0.682
[info]   CI (99.9%): [70.538, 71.723] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet
[info] # Run progress: 19.44% complete, ETA 00:15:41
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1095015.765 us/op
[info] # Warmup Iteration   2: 1.169 us/op
[info] # Warmup Iteration   3: 1.166 us/op
[info] # Warmup Iteration   4: 0.875 us/op
[info] # Warmup Iteration   5: 0.881 us/op
[info] # Warmup Iteration   6: 0.872 us/op
[info] # Warmup Iteration   7: 0.886 us/op
[info] # Warmup Iteration   8: 0.886 us/op
[info] # Warmup Iteration   9: 0.883 us/op
[info] # Warmup Iteration  10: 0.894 us/op
[info] Iteration   1: 0.882 us/op
[info] Iteration   2: 0.878 us/op
[info] Iteration   3: 0.893 us/op
[info] Iteration   4: 0.878 us/op
[info] Iteration   5: 0.885 us/op
[info] Iteration   6: 0.885 us/op
[info] Iteration   7: 0.881 us/op
[info] Iteration   8: 0.892 us/op
[info] Iteration   9: 0.891 us/op
[info] Iteration  10: 0.888 us/op
[info] Iteration  11: 0.876 us/op
[info] Iteration  12: 0.886 us/op
[info] Iteration  13: 0.900 us/op
[info] Iteration  14: 0.883 us/op
[info] Iteration  15: 0.888 us/op
[info] Iteration  16: 0.878 us/op
[info] Iteration  17: 0.881 us/op
[info] Iteration  18: 0.890 us/op
[info] Iteration  19: 0.883 us/op
[info] Iteration  20: 0.878 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet":
[info]   0.885 ±(99.9%) 0.005 us/op [Average]
[info]   (min, avg, max) = (0.876, 0.885, 0.900), stdev = 0.006
[info]   CI (99.9%): [0.879, 0.890] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet
[info] # Run progress: 22.22% complete, ETA 00:15:03
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1088642.819 us/op
[info] # Warmup Iteration   2: 2.779 us/op
[info] # Warmup Iteration   3: 2.258 us/op
[info] # Warmup Iteration   4: 2.947 us/op
[info] # Warmup Iteration   5: 2.952 us/op
[info] # Warmup Iteration   6: 2.933 us/op
[info] # Warmup Iteration   7: 2.972 us/op
[info] # Warmup Iteration   8: 2.949 us/op
[info] # Warmup Iteration   9: 2.961 us/op
[info] # Warmup Iteration  10: 2.940 us/op
[info] Iteration   1: 2.940 us/op
[info] Iteration   2: 3.216 us/op
[info] Iteration   3: 2.980 us/op
[info] Iteration   4: 2.982 us/op
[info] Iteration   5: 2.963 us/op
[info] Iteration   6: 2.959 us/op
[info] Iteration   7: 2.989 us/op
[info] Iteration   8: 2.948 us/op
[info] Iteration   9: 2.937 us/op
[info] Iteration  10: 2.959 us/op
[info] Iteration  11: 2.946 us/op
[info] Iteration  12: 3.045 us/op
[info] Iteration  13: 2.965 us/op
[info] Iteration  14: 2.989 us/op
[info] Iteration  15: 2.952 us/op
[info] Iteration  16: 2.939 us/op
[info] Iteration  17: 2.965 us/op
[info] Iteration  18: 2.949 us/op
[info] Iteration  19: 2.957 us/op
[info] Iteration  20: 2.944 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet":
[info]   2.976 ±(99.9%) 0.054 us/op [Average]
[info]   (min, avg, max) = (2.937, 2.976, 3.216), stdev = 0.062
[info]   CI (99.9%): [2.923, 3.030] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet
[info] # Run progress: 25.00% complete, ETA 00:14:27
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1047158.396 us/op
[info] # Warmup Iteration   2: 6.916 us/op
[info] # Warmup Iteration   3: 6.629 us/op
[info] # Warmup Iteration   4: 6.607 us/op
[info] # Warmup Iteration   5: 6.638 us/op
[info] # Warmup Iteration   6: 6.616 us/op
[info] # Warmup Iteration   7: 6.667 us/op
[info] # Warmup Iteration   8: 6.581 us/op
[info] # Warmup Iteration   9: 6.556 us/op
[info] # Warmup Iteration  10: 6.604 us/op
[info] Iteration   1: 6.576 us/op
[info] Iteration   2: 6.667 us/op
[info] Iteration   3: 6.587 us/op
[info] Iteration   4: 6.622 us/op
[info] Iteration   5: 6.609 us/op
[info] Iteration   6: 6.586 us/op
[info] Iteration   7: 6.690 us/op
[info] Iteration   8: 6.951 us/op
[info] Iteration   9: 6.649 us/op
[info] Iteration  10: 6.619 us/op
[info] Iteration  11: 6.668 us/op
[info] Iteration  12: 6.711 us/op
[info] Iteration  13: 6.598 us/op
[info] Iteration  14: 6.583 us/op
[info] Iteration  15: 6.587 us/op
[info] Iteration  16: 6.487 us/op
[info] Iteration  17: 6.423 us/op
[info] Iteration  18: 6.380 us/op
[info] Iteration  19: 6.347 us/op
[info] Iteration  20: 6.310 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet":
[info]   6.582 ±(99.9%) 0.125 us/op [Average]
[info]   (min, avg, max) = (6.310, 6.582, 6.951), stdev = 0.144
[info]   CI (99.9%): [6.458, 6.707] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Set
[info] # Run progress: 27.78% complete, ETA 00:13:52
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1084515.578 us/op
[info] # Warmup Iteration   2: 9.784 us/op
[info] # Warmup Iteration   3: 9.066 us/op
[info] # Warmup Iteration   4: 8.989 us/op
[info] # Warmup Iteration   5: 9.050 us/op
[info] # Warmup Iteration   6: 9.106 us/op
[info] # Warmup Iteration   7: 9.018 us/op
[info] # Warmup Iteration   8: 9.156 us/op
[info] # Warmup Iteration   9: 8.989 us/op
[info] # Warmup Iteration  10: 9.023 us/op
[info] Iteration   1: 9.211 us/op
[info] Iteration   2: 9.073 us/op
[info] Iteration   3: 8.992 us/op
[info] Iteration   4: 8.981 us/op
[info] Iteration   5: 9.033 us/op
[info] Iteration   6: 9.056 us/op
[info] Iteration   7: 8.994 us/op
[info] Iteration   8: 8.957 us/op
[info] Iteration   9: 9.047 us/op
[info] Iteration  10: 8.988 us/op
[info] Iteration  11: 9.126 us/op
[info] Iteration  12: 9.696 us/op
[info] Iteration  13: 9.054 us/op
[info] Iteration  14: 9.113 us/op
[info] Iteration  15: 9.009 us/op
[info] Iteration  16: 9.107 us/op
[info] Iteration  17: 9.021 us/op
[info] Iteration  18: 9.124 us/op
[info] Iteration  19: 9.016 us/op
[info] Iteration  20: 9.075 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_Set":
[info]   9.084 ±(99.9%) 0.136 us/op [Average]
[info]   (min, avg, max) = (8.957, 9.084, 9.696), stdev = 0.157
[info]   CI (99.9%): [8.947, 9.220] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet
[info] # Run progress: 30.56% complete, ETA 00:13:17
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1007601.064 us/op
[info] # Warmup Iteration   2: 26.659 us/op
[info] # Warmup Iteration   3: 22.875 us/op
[info] # Warmup Iteration   4: 18.231 us/op
[info] # Warmup Iteration   5: 20.566 us/op
[info] # Warmup Iteration   6: 19.127 us/op
[info] # Warmup Iteration   7: 18.815 us/op
[info] # Warmup Iteration   8: 18.615 us/op
[info] # Warmup Iteration   9: 18.782 us/op
[info] # Warmup Iteration  10: 19.071 us/op
[info] Iteration   1: 18.752 us/op
[info] Iteration   2: 18.786 us/op
[info] Iteration   3: 18.716 us/op
[info] Iteration   4: 18.637 us/op
[info] Iteration   5: 18.838 us/op
[info] Iteration   6: 18.797 us/op
[info] Iteration   7: 18.739 us/op
[info] Iteration   8: 20.122 us/op
[info] Iteration   9: 19.848 us/op
[info] Iteration  10: 19.044 us/op
[info] Iteration  11: 18.825 us/op
[info] Iteration  12: 18.705 us/op
[info] Iteration  13: 18.721 us/op
[info] Iteration  14: 18.808 us/op
[info] Iteration  15: 18.936 us/op
[info] Iteration  16: 18.789 us/op
[info] Iteration  17: 18.838 us/op
[info] Iteration  18: 18.815 us/op
[info] Iteration  19: 18.864 us/op
[info] Iteration  20: 18.986 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet":
[info]   18.928 ±(99.9%) 0.327 us/op [Average]
[info]   (min, avg, max) = (18.637, 18.928, 20.122), stdev = 0.376
[info]   CI (99.9%): [18.602, 19.255] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array
[info] # Run progress: 33.33% complete, ETA 00:12:43
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1075173.842 us/op
[info] # Warmup Iteration   2: 4.976 us/op
[info] # Warmup Iteration   3: 4.663 us/op
[info] # Warmup Iteration   4: 4.718 us/op
[info] # Warmup Iteration   5: 4.635 us/op
[info] # Warmup Iteration   6: 4.640 us/op
[info] # Warmup Iteration   7: 4.665 us/op
[info] # Warmup Iteration   8: 4.636 us/op
[info] # Warmup Iteration   9: 4.819 us/op
[info] # Warmup Iteration  10: 4.664 us/op
[info] Iteration   1: 4.654 us/op
[info] Iteration   2: 4.630 us/op
[info] Iteration   3: 4.631 us/op
[info] Iteration   4: 4.724 us/op
[info] Iteration   5: 4.633 us/op
[info] Iteration   6: 4.633 us/op
[info] Iteration   7: 4.639 us/op
[info] Iteration   8: 4.656 us/op
[info] Iteration   9: 4.678 us/op
[info] Iteration  10: 4.569 us/op
[info] Iteration  11: 4.606 us/op
[info] Iteration  12: 4.814 us/op
[info] Iteration  13: 4.614 us/op
[info] Iteration  14: 4.645 us/op
[info] Iteration  15: 4.591 us/op
[info] Iteration  16: 4.589 us/op
[info] Iteration  17: 4.571 us/op
[info] Iteration  18: 4.567 us/op
[info] Iteration  19: 4.620 us/op
[info] Iteration  20: 4.627 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array":
[info]   4.635 ±(99.9%) 0.049 us/op [Average]
[info]   (min, avg, max) = (4.567, 4.635, 4.814), stdev = 0.057
[info]   CI (99.9%): [4.585, 4.684] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet
[info] # Run progress: 36.11% complete, ETA 00:12:10
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 38.249 us/op
[info] # Warmup Iteration   2: 1.050 us/op
[info] # Warmup Iteration   3: 1.080 us/op
[info] # Warmup Iteration   4: 0.821 us/op
[info] # Warmup Iteration   5: 0.823 us/op
[info] # Warmup Iteration   6: 0.816 us/op
[info] # Warmup Iteration   7: 0.821 us/op
[info] # Warmup Iteration   8: 0.837 us/op
[info] # Warmup Iteration   9: 0.830 us/op
[info] # Warmup Iteration  10: 0.833 us/op
[info] Iteration   1: 0.820 us/op
[info] Iteration   2: 0.832 us/op
[info] Iteration   3: 0.896 us/op
[info] Iteration   4: 0.827 us/op
[info] Iteration   5: 0.829 us/op
[info] Iteration   6: 0.828 us/op
[info] Iteration   7: 0.842 us/op
[info] Iteration   8: 0.901 us/op
[info] Iteration   9: 0.826 us/op
[info] Iteration  10: 0.827 us/op
[info] Iteration  11: 0.817 us/op
[info] Iteration  12: 0.819 us/op
[info] Iteration  13: 0.832 us/op
[info] Iteration  14: 0.821 us/op
[info] Iteration  15: 0.811 us/op
[info] Iteration  16: 0.818 us/op
[info] Iteration  17: 0.819 us/op
[info] Iteration  18: 0.841 us/op
[info] Iteration  19: 0.827 us/op
[info] Iteration  20: 0.827 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet":
[info]   0.833 ±(99.9%) 0.021 us/op [Average]
[info]   (min, avg, max) = (0.811, 0.833, 0.901), stdev = 0.024
[info]   CI (99.9%): [0.813, 0.854] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet
[info] # Run progress: 38.89% complete, ETA 00:11:36
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 61.592 us/op
[info] # Warmup Iteration   2: 1.950 us/op
[info] # Warmup Iteration   3: 2.149 us/op
[info] # Warmup Iteration   4: 2.543 us/op
[info] # Warmup Iteration   5: 2.533 us/op
[info] # Warmup Iteration   6: 2.514 us/op
[info] # Warmup Iteration   7: 2.517 us/op
[info] # Warmup Iteration   8: 2.551 us/op
[info] # Warmup Iteration   9: 2.541 us/op
[info] # Warmup Iteration  10: 2.524 us/op
[info] Iteration   1: 2.521 us/op
[info] Iteration   2: 2.522 us/op
[info] Iteration   3: 2.546 us/op
[info] Iteration   4: 2.511 us/op
[info] Iteration   5: 2.511 us/op
[info] Iteration   6: 2.511 us/op
[info] Iteration   7: 2.526 us/op
[info] Iteration   8: 2.542 us/op
[info] Iteration   9: 2.520 us/op
[info] Iteration  10: 2.528 us/op
[info] Iteration  11: 2.542 us/op
[info] Iteration  12: 2.523 us/op
[info] Iteration  13: 2.545 us/op
[info] Iteration  14: 2.513 us/op
[info] Iteration  15: 2.518 us/op
[info] Iteration  16: 2.512 us/op
[info] Iteration  17: 2.516 us/op
[info] Iteration  18: 2.547 us/op
[info] Iteration  19: 2.536 us/op
[info] Iteration  20: 2.516 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet":
[info]   2.525 ±(99.9%) 0.011 us/op [Average]
[info]   (min, avg, max) = (2.511, 2.525, 2.547), stdev = 0.013
[info]   CI (99.9%): [2.514, 2.537] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet
[info] # Run progress: 41.67% complete, ETA 00:11:04
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1013852.397 us/op
[info] # Warmup Iteration   2: 7.367 us/op
[info] # Warmup Iteration   3: 6.655 us/op
[info] # Warmup Iteration   4: 6.639 us/op
[info] # Warmup Iteration   5: 6.615 us/op
[info] # Warmup Iteration   6: 6.651 us/op
[info] # Warmup Iteration   7: 6.744 us/op
[info] # Warmup Iteration   8: 6.671 us/op
[info] # Warmup Iteration   9: 6.848 us/op
[info] # Warmup Iteration  10: 6.677 us/op
[info] Iteration   1: 6.636 us/op
[info] Iteration   2: 6.729 us/op
[info] Iteration   3: 6.645 us/op
[info] Iteration   4: 6.648 us/op
[info] Iteration   5: 7.193 us/op
[info] Iteration   6: 6.746 us/op
[info] Iteration   7: 6.732 us/op
[info] Iteration   8: 6.718 us/op
[info] Iteration   9: 6.619 us/op
[info] Iteration  10: 6.787 us/op
[info] Iteration  11: 6.345 us/op
[info] Iteration  12: 6.422 us/op
[info] Iteration  13: 6.363 us/op
[info] Iteration  14: 6.302 us/op
[info] Iteration  15: 6.329 us/op
[info] Iteration  16: 6.298 us/op
[info] Iteration  17: 6.447 us/op
[info] Iteration  18: 6.363 us/op
[info] Iteration  19: 6.307 us/op
[info] Iteration  20: 6.316 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet":
[info]   6.547 ±(99.9%) 0.205 us/op [Average]
[info]   (min, avg, max) = (6.298, 6.547, 7.193), stdev = 0.236
[info]   CI (99.9%): [6.342, 6.752] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set
[info] # Run progress: 44.44% complete, ETA 00:10:31
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1072124.675 us/op
[info] # Warmup Iteration   2: 6.819 us/op
[info] # Warmup Iteration   3: 6.415 us/op
[info] # Warmup Iteration   4: 6.431 us/op
[info] # Warmup Iteration   5: 6.377 us/op
[info] # Warmup Iteration   6: 6.468 us/op
[info] # Warmup Iteration   7: 6.375 us/op
[info] # Warmup Iteration   8: 6.404 us/op
[info] # Warmup Iteration   9: 6.883 us/op
[info] # Warmup Iteration  10: 6.370 us/op
[info] Iteration   1: 6.488 us/op
[info] Iteration   2: 6.493 us/op
[info] Iteration   3: 6.384 us/op
[info] Iteration   4: 6.367 us/op
[info] Iteration   5: 6.362 us/op
[info] Iteration   6: 6.480 us/op
[info] Iteration   7: 6.390 us/op
[info] Iteration   8: 6.367 us/op
[info] Iteration   9: 6.406 us/op
[info] Iteration  10: 6.395 us/op
[info] Iteration  11: 6.518 us/op
[info] Iteration  12: 6.350 us/op
[info] Iteration  13: 6.085 us/op
[info] Iteration  14: 6.127 us/op
[info] Iteration  15: 6.086 us/op
[info] Iteration  16: 6.167 us/op
[info] Iteration  17: 6.108 us/op
[info] Iteration  18: 6.113 us/op
[info] Iteration  19: 6.071 us/op
[info] Iteration  20: 6.079 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set":
[info]   6.292 ±(99.9%) 0.143 us/op [Average]
[info]   (min, avg, max) = (6.071, 6.292, 6.518), stdev = 0.165
[info]   CI (99.9%): [6.149, 6.435] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet
[info] # Run progress: 47.22% complete, ETA 00:09:59
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1078144.357 us/op
[info] # Warmup Iteration   2: 8.595 us/op
[info] # Warmup Iteration   3: 7.955 us/op
[info] # Warmup Iteration   4: 8.623 us/op
[info] # Warmup Iteration   5: 9.129 us/op
[info] # Warmup Iteration   6: 8.523 us/op
[info] # Warmup Iteration   7: 8.688 us/op
[info] # Warmup Iteration   8: 8.532 us/op
[info] # Warmup Iteration   9: 8.558 us/op
[info] # Warmup Iteration  10: 8.607 us/op
[info] Iteration   1: 8.551 us/op
[info] Iteration   2: 8.554 us/op
[info] Iteration   3: 8.598 us/op
[info] Iteration   4: 8.569 us/op
[info] Iteration   5: 8.605 us/op
[info] Iteration   6: 9.258 us/op
[info] Iteration   7: 8.642 us/op
[info] Iteration   8: 8.537 us/op
[info] Iteration   9: 8.572 us/op
[info] Iteration  10: 8.665 us/op
[info] Iteration  11: 8.594 us/op
[info] Iteration  12: 8.490 us/op
[info] Iteration  13: 8.404 us/op
[info] Iteration  14: 8.504 us/op
[info] Iteration  15: 8.812 us/op
[info] Iteration  16: 8.636 us/op
[info] Iteration  17: 8.645 us/op
[info] Iteration  18: 8.694 us/op
[info] Iteration  19: 8.617 us/op
[info] Iteration  20: 8.765 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet":
[info]   8.636 ±(99.9%) 0.150 us/op [Average]
[info]   (min, avg, max) = (8.404, 8.636, 9.258), stdev = 0.173
[info]   CI (99.9%): [8.485, 8.786] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Array
[info] # Run progress: 50.00% complete, ETA 00:09:26
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: ≈ 10⁻³ us/op
[info] # Warmup Iteration   2: ≈ 10⁻³ us/op
[info] # Warmup Iteration   3: ≈ 10⁻³ us/op
[info] # Warmup Iteration   4: ≈ 10⁻³ us/op
[info] # Warmup Iteration   5: ≈ 10⁻³ us/op
[info] # Warmup Iteration   6: ≈ 10⁻³ us/op
[info] # Warmup Iteration   7: ≈ 10⁻³ us/op
[info] # Warmup Iteration   8: ≈ 10⁻³ us/op
[info] # Warmup Iteration   9: ≈ 10⁻³ us/op
[info] # Warmup Iteration  10: 0.001 us/op
[info] Iteration   1: ≈ 10⁻³ us/op
[info] Iteration   2: ≈ 10⁻³ us/op
[info] Iteration   3: ≈ 10⁻³ us/op
[info] Iteration   4: ≈ 10⁻³ us/op
[info] Iteration   5: ≈ 10⁻³ us/op
[info] Iteration   6: ≈ 10⁻³ us/op
[info] Iteration   7: ≈ 10⁻³ us/op
[info] Iteration   8: ≈ 10⁻³ us/op
[info] Iteration   9: ≈ 10⁻³ us/op
[info] Iteration  10: ≈ 10⁻³ us/op
[info] Iteration  11: ≈ 10⁻³ us/op
[info] Iteration  12: ≈ 10⁻³ us/op
[info] Iteration  13: ≈ 10⁻³ us/op
[info] Iteration  14: ≈ 10⁻³ us/op
[info] Iteration  15: ≈ 10⁻³ us/op
[info] Iteration  16: ≈ 10⁻³ us/op
[info] Iteration  17: ≈ 10⁻³ us/op
[info] Iteration  18: ≈ 10⁻³ us/op
[info] Iteration  19: ≈ 10⁻³ us/op
[info] Iteration  20: ≈ 10⁻³ us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Array":
[info]   ≈ 10⁻³ us/op
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet
[info] # Run progress: 52.78% complete, ETA 00:08:54
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2991862.088 us/op
[info] # Warmup Iteration   2: 3.226 us/op
[info] # Warmup Iteration   3: 3.608 us/op
[info] # Warmup Iteration   4: 3.143 us/op
[info] # Warmup Iteration   5: 3.119 us/op
[info] # Warmup Iteration   6: 3.169 us/op
[info] # Warmup Iteration   7: 3.125 us/op
[info] # Warmup Iteration   8: 3.138 us/op
[info] # Warmup Iteration   9: 3.118 us/op
[info] # Warmup Iteration  10: 3.151 us/op
[info] Iteration   1: 3.321 us/op
[info] Iteration   2: 3.133 us/op
[info] Iteration   3: 3.152 us/op
[info] Iteration   4: 3.163 us/op
[info] Iteration   5: 3.132 us/op
[info] Iteration   6: 3.171 us/op
[info] Iteration   7: 3.132 us/op
[info] Iteration   8: 3.152 us/op
[info] Iteration   9: 3.132 us/op
[info] Iteration  10: 3.132 us/op
[info] Iteration  11: 3.187 us/op
[info] Iteration  12: 3.151 us/op
[info] Iteration  13: 3.168 us/op
[info] Iteration  14: 3.134 us/op
[info] Iteration  15: 3.190 us/op
[info] Iteration  16: 3.199 us/op
[info] Iteration  17: 3.132 us/op
[info] Iteration  18: 3.137 us/op
[info] Iteration  19: 3.132 us/op
[info] Iteration  20: 3.149 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet":
[info]   3.160 ±(99.9%) 0.038 us/op [Average]
[info]   (min, avg, max) = (3.132, 3.160, 3.321), stdev = 0.044
[info]   CI (99.9%): [3.122, 3.198] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_BitSet
[info] # Run progress: 55.56% complete, ETA 00:08:24
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2960480.647 us/op
[info] # Warmup Iteration   2: 3.152 us/op
[info] # Warmup Iteration   3: 2.780 us/op
[info] # Warmup Iteration   4: 3.679 us/op
[info] # Warmup Iteration   5: 3.411 us/op
[info] # Warmup Iteration   6: 3.411 us/op
[info] # Warmup Iteration   7: 3.405 us/op
[info] # Warmup Iteration   8: 3.402 us/op
[info] # Warmup Iteration   9: 3.446 us/op
[info] # Warmup Iteration  10: 3.438 us/op
[info] Iteration   1: 3.419 us/op
[info] Iteration   2: 3.428 us/op
[info] Iteration   3: 3.407 us/op
[info] Iteration   4: 3.468 us/op
[info] Iteration   5: 3.405 us/op
[info] Iteration   6: 3.402 us/op
[info] Iteration   7: 3.407 us/op
[info] Iteration   8: 3.418 us/op
[info] Iteration   9: 3.446 us/op
[info] Iteration  10: 3.414 us/op
[info] Iteration  11: 3.403 us/op
[info] Iteration  12: 3.419 us/op
[info] Iteration  13: 3.403 us/op
[info] Iteration  14: 3.453 us/op
[info] Iteration  15: 3.442 us/op
[info] Iteration  16: 3.442 us/op
[info] Iteration  17: 3.416 us/op
[info] Iteration  18: 3.403 us/op
[info] Iteration  19: 3.454 us/op
[info] Iteration  20: 3.435 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_BitSet":
[info]   3.424 ±(99.9%) 0.018 us/op [Average]
[info]   (min, avg, max) = (3.402, 3.424, 3.468), stdev = 0.021
[info]   CI (99.9%): [3.406, 3.442] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet
[info] # Run progress: 58.33% complete, ETA 00:07:53
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 3015084.691 us/op
[info] # Warmup Iteration   2: 11.439 us/op
[info] # Warmup Iteration   3: 10.863 us/op
[info] # Warmup Iteration   4: 11.117 us/op
[info] # Warmup Iteration   5: 11.142 us/op
[info] # Warmup Iteration   6: 11.074 us/op
[info] # Warmup Iteration   7: 11.133 us/op
[info] # Warmup Iteration   8: 10.822 us/op
[info] # Warmup Iteration   9: 11.120 us/op
[info] # Warmup Iteration  10: 11.040 us/op
[info] Iteration   1: 11.724 us/op
[info] Iteration   2: 11.185 us/op
[info] Iteration   3: 11.065 us/op
[info] Iteration   4: 11.017 us/op
[info] Iteration   5: 11.176 us/op
[info] Iteration   6: 11.179 us/op
[info] Iteration   7: 11.162 us/op
[info] Iteration   8: 11.036 us/op
[info] Iteration   9: 11.053 us/op
[info] Iteration  10: 11.095 us/op
[info] Iteration  11: 11.141 us/op
[info] Iteration  12: 11.137 us/op
[info] Iteration  13: 11.062 us/op
[info] Iteration  14: 11.061 us/op
[info] Iteration  15: 11.073 us/op
[info] Iteration  16: 11.218 us/op
[info] Iteration  17: 11.198 us/op
[info] Iteration  18: 11.080 us/op
[info] Iteration  19: 11.030 us/op
[info] Iteration  20: 11.100 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet":
[info]   11.140 ±(99.9%) 0.131 us/op [Average]
[info]   (min, avg, max) = (11.017, 11.140, 11.724), stdev = 0.151
[info]   CI (99.9%): [11.009, 11.270] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Set
[info] # Run progress: 61.11% complete, ETA 00:07:23
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 2987315.339 us/op
[info] # Warmup Iteration   2: 62.846 us/op
[info] # Warmup Iteration   3: 61.644 us/op
[info] # Warmup Iteration   4: 61.263 us/op
[info] # Warmup Iteration   5: 59.429 us/op
[info] # Warmup Iteration   6: 64.569 us/op
[info] # Warmup Iteration   7: 60.505 us/op
[info] # Warmup Iteration   8: 62.940 us/op
[info] # Warmup Iteration   9: 59.471 us/op
[info] # Warmup Iteration  10: 59.495 us/op
[info] Iteration   1: 59.225 us/op
[info] Iteration   2: 59.368 us/op
[info] Iteration   3: 60.320 us/op
[info] Iteration   4: 59.600 us/op
[info] Iteration   5: 59.410 us/op
[info] Iteration   6: 59.998 us/op
[info] Iteration   7: 59.716 us/op
[info] Iteration   8: 60.116 us/op
[info] Iteration   9: 59.396 us/op
[info] Iteration  10: 58.851 us/op
[info] Iteration  11: 59.978 us/op
[info] Iteration  12: 59.060 us/op
[info] Iteration  13: 60.333 us/op
[info] Iteration  14: 59.876 us/op
[info] Iteration  15: 60.212 us/op
[info] Iteration  16: 59.906 us/op
[info] Iteration  17: 59.299 us/op
[info] Iteration  18: 60.556 us/op
[info] Iteration  19: 59.638 us/op
[info] Iteration  20: 59.363 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_Set":
[info]   59.711 ±(99.9%) 0.404 us/op [Average]
[info]   (min, avg, max) = (58.851, 59.711, 60.556), stdev = 0.466
[info]   CI (99.9%): [59.307, 60.116] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet
[info] # Run progress: 63.89% complete, ETA 00:06:52
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 4613920.156 us/op
[info] # Warmup Iteration   2: 666.397 us/op
[info] # Warmup Iteration   3: 638.648 us/op
[info] # Warmup Iteration   4: 642.048 us/op
[info] # Warmup Iteration   5: 643.598 us/op
[info] # Warmup Iteration   6: 662.809 us/op
[info] # Warmup Iteration   7: 652.047 us/op
[info] # Warmup Iteration   8: 651.810 us/op
[info] # Warmup Iteration   9: 666.646 us/op
[info] # Warmup Iteration  10: 661.191 us/op
[info] Iteration   1: 655.570 us/op
[info] Iteration   2: 653.663 us/op
[info] Iteration   3: 649.829 us/op
[info] Iteration   4: 667.134 us/op
[info] Iteration   5: 652.668 us/op
[info] Iteration   6: 656.230 us/op
[info] Iteration   7: 656.114 us/op
[info] Iteration   8: 661.238 us/op
[info] Iteration   9: 681.137 us/op
[info] Iteration  10: 663.440 us/op
[info] Iteration  11: 660.460 us/op
[info] Iteration  12: 662.949 us/op
[info] Iteration  13: 711.517 us/op
[info] Iteration  14: 670.944 us/op
[info] Iteration  15: 658.537 us/op
[info] Iteration  16: 660.538 us/op
[info] Iteration  17: 655.067 us/op
[info] Iteration  18: 656.221 us/op
[info] Iteration  19: 669.016 us/op
[info] Iteration  20: 677.022 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet":
[info]   663.965 ±(99.9%) 12.015 us/op [Average]
[info]   (min, avg, max) = (649.829, 663.965, 711.517), stdev = 13.837
[info]   CI (99.9%): [651.949, 675.980] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Array
[info] # Run progress: 66.67% complete, ETA 00:06:21
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1054919.603 us/op
[info] # Warmup Iteration   2: 75.492 us/op
[info] # Warmup Iteration   3: 72.760 us/op
[info] # Warmup Iteration   4: 72.177 us/op
[info] # Warmup Iteration   5: 71.723 us/op
[info] # Warmup Iteration   6: 71.864 us/op
[info] # Warmup Iteration   7: 72.062 us/op
[info] # Warmup Iteration   8: 73.816 us/op
[info] # Warmup Iteration   9: 72.487 us/op
[info] # Warmup Iteration  10: 72.259 us/op
[info] Iteration   1: 71.763 us/op
[info] Iteration   2: 72.528 us/op
[info] Iteration   3: 72.694 us/op
[info] Iteration   4: 71.787 us/op
[info] Iteration   5: 71.917 us/op
[info] Iteration   6: 72.221 us/op
[info] Iteration   7: 71.595 us/op
[info] Iteration   8: 73.137 us/op
[info] Iteration   9: 72.359 us/op
[info] Iteration  10: 72.997 us/op
[info] Iteration  11: 71.661 us/op
[info] Iteration  12: 71.799 us/op
[info] Iteration  13: 72.867 us/op
[info] Iteration  14: 72.336 us/op
[info] Iteration  15: 72.024 us/op
[info] Iteration  16: 79.187 us/op
[info] Iteration  17: 71.902 us/op
[info] Iteration  18: 73.097 us/op
[info] Iteration  19: 72.639 us/op
[info] Iteration  20: 71.880 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Array":
[info]   72.620 ±(99.9%) 1.410 us/op [Average]
[info]   (min, avg, max) = (71.595, 72.620, 79.187), stdev = 1.624
[info]   CI (99.9%): [71.209, 74.030] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet
[info] # Run progress: 69.44% complete, ETA 00:05:49
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1110445.089 us/op
[info] # Warmup Iteration   2: 1.156 us/op
[info] # Warmup Iteration   3: 1.113 us/op
[info] # Warmup Iteration   4: 0.861 us/op
[info] # Warmup Iteration   5: 0.854 us/op
[info] # Warmup Iteration   6: 0.843 us/op
[info] # Warmup Iteration   7: 0.859 us/op
[info] # Warmup Iteration   8: 0.856 us/op
[info] # Warmup Iteration   9: 0.853 us/op
[info] # Warmup Iteration  10: 0.853 us/op
[info] Iteration   1: 0.852 us/op
[info] Iteration   2: 0.856 us/op
[info] Iteration   3: 0.853 us/op
[info] Iteration   4: 0.845 us/op
[info] Iteration   5: 0.846 us/op
[info] Iteration   6: 0.846 us/op
[info] Iteration   7: 0.866 us/op
[info] Iteration   8: 0.853 us/op
[info] Iteration   9: 0.857 us/op
[info] Iteration  10: 0.846 us/op
[info] Iteration  11: 0.851 us/op
[info] Iteration  12: 0.859 us/op
[info] Iteration  13: 0.847 us/op
[info] Iteration  14: 0.847 us/op
[info] Iteration  15: 0.854 us/op
[info] Iteration  16: 0.847 us/op
[info] Iteration  17: 0.919 us/op
[info] Iteration  18: 0.848 us/op
[info] Iteration  19: 0.867 us/op
[info] Iteration  20: 0.846 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet":
[info]   0.855 ±(99.9%) 0.014 us/op [Average]
[info]   (min, avg, max) = (0.845, 0.855, 0.919), stdev = 0.016
[info]   CI (99.9%): [0.841, 0.869] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_BitSet
[info] # Run progress: 72.22% complete, ETA 00:05:17
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1092409.896 us/op
[info] # Warmup Iteration   2: 2.922 us/op
[info] # Warmup Iteration   3: 2.803 us/op
[info] # Warmup Iteration   4: 3.083 us/op
[info] # Warmup Iteration   5: 3.082 us/op
[info] # Warmup Iteration   6: 3.142 us/op
[info] # Warmup Iteration   7: 3.094 us/op
[info] # Warmup Iteration   8: 3.116 us/op
[info] # Warmup Iteration   9: 3.106 us/op
[info] # Warmup Iteration  10: 3.104 us/op
[info] Iteration   1: 3.123 us/op
[info] Iteration   2: 3.087 us/op
[info] Iteration   3: 3.085 us/op
[info] Iteration   4: 3.102 us/op
[info] Iteration   5: 3.082 us/op
[info] Iteration   6: 3.139 us/op
[info] Iteration   7: 3.092 us/op
[info] Iteration   8: 3.102 us/op
[info] Iteration   9: 3.083 us/op
[info] Iteration  10: 3.089 us/op
[info] Iteration  11: 3.125 us/op
[info] Iteration  12: 3.100 us/op
[info] Iteration  13: 3.100 us/op
[info] Iteration  14: 3.086 us/op
[info] Iteration  15: 3.228 us/op
[info] Iteration  16: 3.148 us/op
[info] Iteration  17: 3.118 us/op
[info] Iteration  18: 3.083 us/op
[info] Iteration  19: 3.083 us/op
[info] Iteration  20: 3.089 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_BitSet":
[info]   3.107 ±(99.9%) 0.030 us/op [Average]
[info]   (min, avg, max) = (3.082, 3.107, 3.228), stdev = 0.035
[info]   CI (99.9%): [3.077, 3.137] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet
[info] # Run progress: 75.00% complete, ETA 00:04:45
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1063085.117 us/op
[info] # Warmup Iteration   2: 6.219 us/op
[info] # Warmup Iteration   3: 5.967 us/op
[info] # Warmup Iteration   4: 5.988 us/op
[info] # Warmup Iteration   5: 6.005 us/op
[info] # Warmup Iteration   6: 5.945 us/op
[info] # Warmup Iteration   7: 5.939 us/op
[info] # Warmup Iteration   8: 5.976 us/op
[info] # Warmup Iteration   9: 5.948 us/op
[info] # Warmup Iteration  10: 6.032 us/op
[info] Iteration   1: 5.960 us/op
[info] Iteration   2: 5.970 us/op
[info] Iteration   3: 5.943 us/op
[info] Iteration   4: 5.963 us/op
[info] Iteration   5: 6.036 us/op
[info] Iteration   6: 5.994 us/op
[info] Iteration   7: 5.922 us/op
[info] Iteration   8: 6.048 us/op
[info] Iteration   9: 5.959 us/op
[info] Iteration  10: 6.253 us/op
[info] Iteration  11: 5.870 us/op
[info] Iteration  12: 5.877 us/op
[info] Iteration  13: 5.878 us/op
[info] Iteration  14: 5.934 us/op
[info] Iteration  15: 5.954 us/op
[info] Iteration  16: 5.879 us/op
[info] Iteration  17: 5.864 us/op
[info] Iteration  18: 5.925 us/op
[info] Iteration  19: 5.968 us/op
[info] Iteration  20: 5.958 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet":
[info]   5.958 ±(99.9%) 0.075 us/op [Average]
[info]   (min, avg, max) = (5.864, 5.958, 6.253), stdev = 0.087
[info]   CI (99.9%): [5.883, 6.033] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Set
[info] # Run progress: 77.78% complete, ETA 00:04:13
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1045448.326 us/op
[info] # Warmup Iteration   2: 8.078 us/op
[info] # Warmup Iteration   3: 7.643 us/op
[info] # Warmup Iteration   4: 7.754 us/op
[info] # Warmup Iteration   5: 7.642 us/op
[info] # Warmup Iteration   6: 7.600 us/op
[info] # Warmup Iteration   7: 7.597 us/op
[info] # Warmup Iteration   8: 7.600 us/op
[info] # Warmup Iteration   9: 7.722 us/op
[info] # Warmup Iteration  10: 7.613 us/op
[info] Iteration   1: 7.539 us/op
[info] Iteration   2: 7.549 us/op
[info] Iteration   3: 7.590 us/op
[info] Iteration   4: 7.646 us/op
[info] Iteration   5: 7.569 us/op
[info] Iteration   6: 7.568 us/op
[info] Iteration   7: 8.040 us/op
[info] Iteration   8: 7.571 us/op
[info] Iteration   9: 7.641 us/op
[info] Iteration  10: 7.599 us/op
[info] Iteration  11: 7.677 us/op
[info] Iteration  12: 7.583 us/op
[info] Iteration  13: 7.494 us/op
[info] Iteration  14: 7.629 us/op
[info] Iteration  15: 7.603 us/op
[info] Iteration  16: 7.481 us/op
[info] Iteration  17: 7.480 us/op
[info] Iteration  18: 7.495 us/op
[info] Iteration  19: 7.686 us/op
[info] Iteration  20: 7.494 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_Set":
[info]   7.597 ±(99.9%) 0.106 us/op [Average]
[info]   (min, avg, max) = (7.480, 7.597, 8.040), stdev = 0.122
[info]   CI (99.9%): [7.491, 7.703] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet
[info] # Run progress: 80.56% complete, ETA 00:03:41
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 546.773 us/op
[info] # Warmup Iteration   2: 18.005 us/op
[info] # Warmup Iteration   3: 17.665 us/op
[info] # Warmup Iteration   4: 17.883 us/op
[info] # Warmup Iteration   5: 18.846 us/op
[info] # Warmup Iteration   6: 18.220 us/op
[info] # Warmup Iteration   7: 18.377 us/op
[info] # Warmup Iteration   8: 18.194 us/op
[info] # Warmup Iteration   9: 18.652 us/op
[info] # Warmup Iteration  10: 18.569 us/op
[info] Iteration   1: 18.441 us/op
[info] Iteration   2: 18.334 us/op
[info] Iteration   3: 18.290 us/op
[info] Iteration   4: 18.836 us/op
[info] Iteration   5: 18.343 us/op
[info] Iteration   6: 18.252 us/op
[info] Iteration   7: 18.359 us/op
[info] Iteration   8: 18.197 us/op
[info] Iteration   9: 18.648 us/op
[info] Iteration  10: 18.511 us/op
[info] Iteration  11: 18.291 us/op
[info] Iteration  12: 18.343 us/op
[info] Iteration  13: 18.391 us/op
[info] Iteration  14: 20.149 us/op
[info] Iteration  15: 18.409 us/op
[info] Iteration  16: 18.314 us/op
[info] Iteration  17: 18.363 us/op
[info] Iteration  18: 18.480 us/op
[info] Iteration  19: 18.663 us/op
[info] Iteration  20: 18.407 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet":
[info]   18.501 ±(99.9%) 0.362 us/op [Average]
[info]   (min, avg, max) = (18.197, 18.501, 20.149), stdev = 0.417
[info]   CI (99.9%): [18.139, 18.863] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array
[info] # Run progress: 83.33% complete, ETA 00:03:09
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 145.052 us/op
[info] # Warmup Iteration   2: 4.746 us/op
[info] # Warmup Iteration   3: 4.739 us/op
[info] # Warmup Iteration   4: 4.655 us/op
[info] # Warmup Iteration   5: 4.629 us/op
[info] # Warmup Iteration   6: 4.613 us/op
[info] # Warmup Iteration   7: 4.626 us/op
[info] # Warmup Iteration   8: 4.710 us/op
[info] # Warmup Iteration   9: 4.633 us/op
[info] # Warmup Iteration  10: 4.623 us/op
[info] Iteration   1: 4.639 us/op
[info] Iteration   2: 4.637 us/op
[info] Iteration   3: 4.668 us/op
[info] Iteration   4: 4.602 us/op
[info] Iteration   5: 4.580 us/op
[info] Iteration   6: 4.835 us/op
[info] Iteration   7: 4.586 us/op
[info] Iteration   8: 4.648 us/op
[info] Iteration   9: 4.584 us/op
[info] Iteration  10: 4.621 us/op
[info] Iteration  11: 4.591 us/op
[info] Iteration  12: 4.588 us/op
[info] Iteration  13: 4.649 us/op
[info] Iteration  14: 4.661 us/op
[info] Iteration  15: 4.622 us/op
[info] Iteration  16: 4.614 us/op
[info] Iteration  17: 4.584 us/op
[info] Iteration  18: 4.666 us/op
[info] Iteration  19: 4.592 us/op
[info] Iteration  20: 4.575 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array":
[info]   4.627 ±(99.9%) 0.050 us/op [Average]
[info]   (min, avg, max) = (4.575, 4.627, 4.835), stdev = 0.058
[info]   CI (99.9%): [4.577, 4.678] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet
[info] # Run progress: 86.11% complete, ETA 00:02:37
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 37.146 us/op
[info] # Warmup Iteration   2: 1.075 us/op
[info] # Warmup Iteration   3: 1.069 us/op
[info] # Warmup Iteration   4: 0.855 us/op
[info] # Warmup Iteration   5: 0.846 us/op
[info] # Warmup Iteration   6: 0.846 us/op
[info] # Warmup Iteration   7: 0.862 us/op
[info] # Warmup Iteration   8: 0.851 us/op
[info] # Warmup Iteration   9: 0.859 us/op
[info] # Warmup Iteration  10: 0.931 us/op
[info] Iteration   1: 0.846 us/op
[info] Iteration   2: 0.864 us/op
[info] Iteration   3: 0.850 us/op
[info] Iteration   4: 0.850 us/op
[info] Iteration   5: 0.837 us/op
[info] Iteration   6: 0.848 us/op
[info] Iteration   7: 0.852 us/op
[info] Iteration   8: 0.854 us/op
[info] Iteration   9: 0.837 us/op
[info] Iteration  10: 0.847 us/op
[info] Iteration  11: 0.831 us/op
[info] Iteration  12: 0.868 us/op
[info] Iteration  13: 0.841 us/op
[info] Iteration  14: 0.858 us/op
[info] Iteration  15: 0.848 us/op
[info] Iteration  16: 0.857 us/op
[info] Iteration  17: 0.858 us/op
[info] Iteration  18: 0.853 us/op
[info] Iteration  19: 0.845 us/op
[info] Iteration  20: 0.859 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet":
[info]   0.850 ±(99.9%) 0.008 us/op [Average]
[info]   (min, avg, max) = (0.831, 0.850, 0.868), stdev = 0.009
[info]   CI (99.9%): [0.842, 0.858] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet
[info] # Run progress: 88.89% complete, ETA 00:02:06
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 81.915 us/op
[info] # Warmup Iteration   2: 2.201 us/op
[info] # Warmup Iteration   3: 2.352 us/op
[info] # Warmup Iteration   4: 2.679 us/op
[info] # Warmup Iteration   5: 2.673 us/op
[info] # Warmup Iteration   6: 2.688 us/op
[info] # Warmup Iteration   7: 2.671 us/op
[info] # Warmup Iteration   8: 2.666 us/op
[info] # Warmup Iteration   9: 2.680 us/op
[info] # Warmup Iteration  10: 2.657 us/op
[info] Iteration   1: 2.696 us/op
[info] Iteration   2: 2.648 us/op
[info] Iteration   3: 2.665 us/op
[info] Iteration   4: 2.660 us/op
[info] Iteration   5: 2.684 us/op
[info] Iteration   6: 2.701 us/op
[info] Iteration   7: 2.662 us/op
[info] Iteration   8: 2.662 us/op
[info] Iteration   9: 2.882 us/op
[info] Iteration  10: 2.664 us/op
[info] Iteration  11: 2.696 us/op
[info] Iteration  12: 2.674 us/op
[info] Iteration  13: 2.680 us/op
[info] Iteration  14: 2.667 us/op
[info] Iteration  15: 2.684 us/op
[info] Iteration  16: 2.702 us/op
[info] Iteration  17: 2.684 us/op
[info] Iteration  18: 2.626 us/op
[info] Iteration  19: 2.649 us/op
[info] Iteration  20: 2.613 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet":
[info]   2.680 ±(99.9%) 0.046 us/op [Average]
[info]   (min, avg, max) = (2.613, 2.680, 2.882), stdev = 0.053
[info]   CI (99.9%): [2.634, 2.726] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet
[info] # Run progress: 91.67% complete, ETA 00:01:34
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1251.009 us/op
[info] # Warmup Iteration   2: 6.210 us/op
[info] # Warmup Iteration   3: 5.959 us/op
[info] # Warmup Iteration   4: 5.920 us/op
[info] # Warmup Iteration   5: 5.903 us/op
[info] # Warmup Iteration   6: 5.953 us/op
[info] # Warmup Iteration   7: 5.927 us/op
[info] # Warmup Iteration   8: 5.893 us/op
[info] # Warmup Iteration   9: 5.880 us/op
[info] # Warmup Iteration  10: 5.908 us/op
[info] Iteration   1: 5.927 us/op
[info] Iteration   2: 6.157 us/op
[info] Iteration   3: 6.071 us/op
[info] Iteration   4: 6.074 us/op
[info] Iteration   5: 5.897 us/op
[info] Iteration   6: 5.949 us/op
[info] Iteration   7: 5.955 us/op
[info] Iteration   8: 5.843 us/op
[info] Iteration   9: 5.850 us/op
[info] Iteration  10: 5.942 us/op
[info] Iteration  11: 5.939 us/op
[info] Iteration  12: 5.852 us/op
[info] Iteration  13: 6.167 us/op
[info] Iteration  14: 5.888 us/op
[info] Iteration  15: 5.887 us/op
[info] Iteration  16: 5.932 us/op
[info] Iteration  17: 5.878 us/op
[info] Iteration  18: 5.887 us/op
[info] Iteration  19: 5.903 us/op
[info] Iteration  20: 5.899 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet":
[info]   5.945 ±(99.9%) 0.084 us/op [Average]
[info]   (min, avg, max) = (5.843, 5.945, 6.167), stdev = 0.096
[info]   CI (99.9%): [5.861, 6.028] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set
[info] # Run progress: 94.44% complete, ETA 00:01:03
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1021679.221 us/op
[info] # Warmup Iteration   2: 5.874 us/op
[info] # Warmup Iteration   3: 5.660 us/op
[info] # Warmup Iteration   4: 5.554 us/op
[info] # Warmup Iteration   5: 5.553 us/op
[info] # Warmup Iteration   6: 5.570 us/op
[info] # Warmup Iteration   7: 5.592 us/op
[info] # Warmup Iteration   8: 5.557 us/op
[info] # Warmup Iteration   9: 5.488 us/op
[info] # Warmup Iteration  10: 5.646 us/op
[info] Iteration   1: 5.570 us/op
[info] Iteration   2: 5.574 us/op
[info] Iteration   3: 5.830 us/op
[info] Iteration   4: 5.596 us/op
[info] Iteration   5: 5.911 us/op
[info] Iteration   6: 5.573 us/op
[info] Iteration   7: 5.545 us/op
[info] Iteration   8: 5.748 us/op
[info] Iteration   9: 5.596 us/op
[info] Iteration  10: 5.588 us/op
[info] Iteration  11: 5.466 us/op
[info] Iteration  12: 5.490 us/op
[info] Iteration  13: 5.458 us/op
[info] Iteration  14: 5.462 us/op
[info] Iteration  15: 5.545 us/op
[info] Iteration  16: 5.486 us/op
[info] Iteration  17: 5.447 us/op
[info] Iteration  18: 5.458 us/op
[info] Iteration  19: 5.473 us/op
[info] Iteration  20: 5.580 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set":
[info]   5.570 ±(99.9%) 0.110 us/op [Average]
[info]   (min, avg, max) = (5.447, 5.570, 5.911), stdev = 0.126
[info]   CI (99.9%): [5.460, 5.680] (assumes normal distribution)
[info] # JMH version: 1.37
[info] # VM version: JDK 21.0.4, OpenJDK 64-Bit Server VM, 21.0.4+7-LTS
[info] # VM invoker: /home/gaelrenoux/.sdkman/candidates/java/21.0.4-tem/bin/java
[info] # VM options: -server -Xms1g -Xmx1g -XX:NewSize=512m -XX:MaxNewSize=512m -XX:InitialCodeCacheSize=256m -XX:ReservedCodeCacheSize=256m -XX:+UseParallelGC -XX:MaxInlineLevel=18 -XX:+AlwaysPreTouch
[info] # Blackhole mode: compiler (auto-detected, use -Djmh.blackhole.autoDetect=false to disable)
[info] # Warmup: 10 iterations, 1 s each
[info] # Measurement: 20 iterations, 1 s each
[info] # Timeout: 10 min per iteration
[info] # Threads: 1 thread, will synchronize iterations
[info] # Benchmark mode: Average time, time/op
[info] # Benchmark: co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet
[info] # Run progress: 97.22% complete, ETA 00:00:31
[info] # Fork: 1 of 1
[info] # Warmup Iteration   1: 1074704.502 us/op
[info] # Warmup Iteration   2: 8.494 us/op
[info] # Warmup Iteration   3: 7.495 us/op
[info] # Warmup Iteration   4: 8.189 us/op
[info] # Warmup Iteration   5: 8.130 us/op
[info] # Warmup Iteration   6: 8.090 us/op
[info] # Warmup Iteration   7: 8.326 us/op
[info] # Warmup Iteration   8: 8.142 us/op
[info] # Warmup Iteration   9: 8.141 us/op
[info] # Warmup Iteration  10: 8.247 us/op
[info] Iteration   1: 8.505 us/op
[info] Iteration   2: 8.133 us/op
[info] Iteration   3: 8.012 us/op
[info] Iteration   4: 8.265 us/op
[info] Iteration   5: 8.161 us/op
[info] Iteration   6: 8.227 us/op
[info] Iteration   7: 8.174 us/op
[info] Iteration   8: 8.173 us/op
[info] Iteration   9: 8.278 us/op
[info] Iteration  10: 8.332 us/op
[info] Iteration  11: 8.164 us/op
[info] Iteration  12: 8.159 us/op
[info] Iteration  13: 8.165 us/op
[info] Iteration  14: 8.215 us/op
[info] Iteration  15: 8.110 us/op
[info] Iteration  16: 8.128 us/op
[info] Iteration  17: 8.313 us/op
[info] Iteration  18: 8.037 us/op
[info] Iteration  19: 8.232 us/op
[info] Iteration  20: 8.144 us/op
[info] Result "co.datadome.pub.scalaio2024.benchmarks.chapter3.SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet":
[info]   8.196 ±(99.9%) 0.094 us/op [Average]
[info]   (min, avg, max) = (8.012, 8.196, 8.505), stdev = 0.109
[info]   CI (99.9%): [8.102, 8.291] (assumes normal distribution)
[info] # Run complete. Total time: 00:18:53
[info] REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on
[info] why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial
[info] experiments, perform baseline and negative tests that provide experimental control, make sure
[info] the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts.
[info] Do not assume the numbers tell you what you want them to tell.
[info] NOTE: Current JVM experimentally supports Compiler Blackholes, and they are in use. Please exercise
[info] extra caution when trusting the results, look into the generated code to check the benchmark still
[info] works, and factor in a small probability of new VM bugs. Additionally, while comparisons between
[info] different JVMs are already problematic, the performance difference caused by different Blackhole
[info] modes can be very significant. Please make sure you use the consistent Blackhole mode for comparisons.
[info] Benchmark                                                       Mode  Cnt    Score    Error  Units
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_Array            avgt   20   ≈ 10⁻³           us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_ArraySet         avgt   20    2.864 ±  0.173  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_BitSet           avgt   20    3.420 ±  0.016  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_JavaHashSet      avgt   20   12.108 ±  0.132  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_Set              avgt   20   47.849 ±  0.710  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Large.contains_SortedSet        avgt   20  651.415 ±  5.679  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_Array            avgt   20   71.131 ±  0.593  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_ArraySet         avgt   20    0.885 ±  0.005  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_BitSet           avgt   20    2.976 ±  0.054  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_JavaHashSet      avgt   20    6.582 ±  0.125  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_Set              avgt   20    9.084 ±  0.136  us/op
[info] SetBenchmark_BadInvoice_HalfHit_Small.contains_SortedSet        avgt   20   18.928 ±  0.327  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Array        avgt   20    4.635 ±  0.049  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_ArraySet     avgt   20    0.833 ±  0.021  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_BitSet       avgt   20    2.525 ±  0.011  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_JavaHashSet  avgt   20    6.547 ±  0.205  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_Set          avgt   20    6.292 ±  0.143  us/op
[info] SetBenchmark_BadInvoice_HalfHit_VerySmall.contains_SortedSet    avgt   20    8.636 ±  0.150  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_Array               avgt   20   ≈ 10⁻³           us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_ArraySet            avgt   20    3.160 ±  0.038  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_BitSet              avgt   20    3.424 ±  0.018  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_JavaHashSet         avgt   20   11.140 ±  0.131  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_Set                 avgt   20   59.711 ±  0.404  us/op
[info] SetBenchmark_Invoice_HalfHit_Large.contains_SortedSet           avgt   20  663.965 ± 12.015  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_Array               avgt   20   72.620 ±  1.410  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_ArraySet            avgt   20    0.855 ±  0.014  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_BitSet              avgt   20    3.107 ±  0.030  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_JavaHashSet         avgt   20    5.958 ±  0.075  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_Set                 avgt   20    7.597 ±  0.106  us/op
[info] SetBenchmark_Invoice_HalfHit_Small.contains_SortedSet           avgt   20   18.501 ±  0.362  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_Array           avgt   20    4.627 ±  0.050  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_ArraySet        avgt   20    0.850 ±  0.008  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_BitSet          avgt   20    2.680 ±  0.046  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_JavaHashSet     avgt   20    5.945 ±  0.084  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_Set             avgt   20    5.570 ±  0.110  us/op
[info] SetBenchmark_Invoice_HalfHit_VerySmall.contains_SortedSet       avgt   20    8.196 ±  0.094  us/op
[success] Total time: 1136 s (18:56), completed Nov 6, 2024, 12:53:09 PM