Skip to content

[AST] [Performance] Use 'SmallArray' instead of 'Vector' #7010

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

[AST] [Performance] Use 'SmallArray' instead of 'Vector' #7010

wants to merge 1 commit into from

Conversation

effectfully
Copy link
Contributor

#6602 will require optimizing case, so let's try doing that separately.

@effectfully effectfully added Evaluation AST Performance EXPERIMENT Experiments that we probably don't want to merge labels Apr 3, 2025
@effectfully effectfully self-assigned this Apr 3, 2025
@effectfully
Copy link
Contributor Author

/benchmark lists

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Comparing benchmark results of 'lists' on '684818da3a' (base) and '5c2f60cc51' (PR)

Results table
Script 684818d 5c2f60c Change
sort/ghcSort/50 181.1 μs 188.1 μs +3.9%
sort/ghcSort/100 419.4 μs 442.3 μs +5.5%
sort/ghcSort/150 721.5 μs 759.9 μs +5.3%
sort/ghcSort/200 972.6 μs 1.022 ms +5.1%
sort/ghcSort/250 1.255 ms 1.320 ms +5.2%
sort/ghcSort/300 1.658 ms 1.743 ms +5.1%
sort/insertionSort/50 615.6 μs 630.2 μs +2.4%
sort/insertionSort/100 2.463 ms 2.514 ms +2.1%
sort/insertionSort/150 5.561 ms 5.663 ms +1.8%
sort/insertionSort/200 9.911 ms 10.08 ms +1.7%
sort/insertionSort/250 15.54 ms 15.82 ms +1.8%
sort/insertionSort/300 22.37 ms 22.93 ms +2.5%
sort/mergeSort/50 544.0 μs 561.0 μs +3.1%
sort/mergeSort/100 1.249 ms 1.288 ms +3.1%
sort/mergeSort/150 2.009 ms 2.074 ms +3.2%
sort/mergeSort/200 2.821 ms 2.908 ms +3.1%
sort/mergeSort/250 3.700 ms 3.823 ms +3.3%
sort/mergeSort/300 4.501 ms 4.648 ms +3.3%
sort/quickSort/50 1.456 ms 1.471 ms +1.0%
sort/quickSort/100 6.017 ms 6.046 ms +0.5%
sort/quickSort/150 13.52 ms 13.58 ms +0.4%
sort/quickSort/200 23.95 ms 24.04 ms +0.4%
sort/quickSort/250 37.75 ms 37.90 ms +0.4%
sort/quickSort/300 54.52 ms 54.50 ms -0.0%
sum/compiled-from-Haskell/sum-right-builtin/100 78.13 μs 76.99 μs -1.5%
sum/compiled-from-Haskell/sum-right-builtin/500 405.8 μs 403.7 μs -0.5%
sum/compiled-from-Haskell/sum-right-builtin/1000 864.3 μs 859.3 μs -0.6%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.662 ms 2.661 ms -0.0%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.754 ms 5.754 ms 0.0%
sum/compiled-from-Haskell/sum-right-Scott/100 44.19 μs 45.41 μs +2.8%
sum/compiled-from-Haskell/sum-right-Scott/500 233.3 μs 239.3 μs +2.6%
sum/compiled-from-Haskell/sum-right-Scott/1000 493.5 μs 525.8 μs +6.5%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.718 ms 1.805 ms +5.1%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.130 ms 4.192 ms +1.5%
sum/compiled-from-Haskell/sum-right-data/100 257.3 μs 256.9 μs -0.2%
sum/compiled-from-Haskell/sum-right-data/500 1.415 ms 1.415 ms 0.0%
sum/compiled-from-Haskell/sum-right-data/1000 3.286 ms 3.165 ms -3.7%
sum/compiled-from-Haskell/sum-right-data/2500 8.464 ms 8.464 ms 0.0%
sum/compiled-from-Haskell/sum-right-data/5000 18.03 ms 18.06 ms +0.2%
sum/compiled-from-Haskell/sum-left-builtin/100 75.35 μs 75.68 μs +0.4%
sum/compiled-from-Haskell/sum-left-builtin/500 389.8 μs 392.9 μs +0.8%
sum/compiled-from-Haskell/sum-left-builtin/1000 843.4 μs 842.8 μs -0.1%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.569 ms 2.584 ms +0.6%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.691 ms 5.709 ms +0.3%
sum/compiled-from-Haskell/sum-left-Scott/100 42.56 μs 44.72 μs +5.1%
sum/compiled-from-Haskell/sum-left-Scott/500 224.6 μs 235.2 μs +4.7%
sum/compiled-from-Haskell/sum-left-Scott/1000 491.9 μs 518.6 μs +5.4%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.620 ms 1.722 ms +6.3%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.050 ms 4.311 ms +6.4%
sum/compiled-from-Haskell/sum-left-data/100 275.7 μs 263.4 μs -4.5%
sum/compiled-from-Haskell/sum-left-data/500 1.452 ms 1.457 ms +0.3%
sum/compiled-from-Haskell/sum-left-data/1000 3.271 ms 3.269 ms -0.1%
sum/compiled-from-Haskell/sum-left-data/2500 8.671 ms 8.698 ms +0.3%
sum/compiled-from-Haskell/sum-left-data/5000 18.45 ms 18.45 ms 0.0%
sum/hand-written-PLC/sum-right-builtin/100 52.22 μs 53.02 μs +1.5%
sum/hand-written-PLC/sum-right-builtin/500 262.4 μs 267.2 μs +1.8%
sum/hand-written-PLC/sum-right-builtin/1000 536.0 μs 552.7 μs +3.1%
sum/hand-written-PLC/sum-right-builtin/2500 1.569 ms 1.593 ms +1.5%
sum/hand-written-PLC/sum-right-builtin/5000 3.467 ms 3.531 ms +1.8%
sum/hand-written-PLC/sum-right-Scott/100 34.66 μs 33.28 μs -4.0%
sum/hand-written-PLC/sum-right-Scott/500 182.0 μs 183.0 μs +0.5%
sum/hand-written-PLC/sum-right-Scott/1000 409.8 μs 404.9 μs -1.2%
sum/hand-written-PLC/sum-right-Scott/2500 1.368 ms 1.355 ms -1.0%
sum/hand-written-PLC/sum-right-Scott/5000 4.130 ms 4.072 ms -1.4%
sum/hand-written-PLC/sum-left-builtin/100 55.79 μs 55.02 μs -1.4%
sum/hand-written-PLC/sum-left-builtin/500 273.5 μs 270.3 μs -1.2%
sum/hand-written-PLC/sum-left-builtin/1000 542.5 μs 536.9 μs -1.0%
sum/hand-written-PLC/sum-left-builtin/2500 1.360 ms 1.338 ms -1.6%
sum/hand-written-PLC/sum-left-builtin/5000 2.708 ms 2.650 ms -2.1%
sum/hand-written-PLC/sum-left-Scott/100 38.83 μs 37.51 μs -3.4%
sum/hand-written-PLC/sum-left-Scott/500 209.8 μs 204.7 μs -2.4%
sum/hand-written-PLC/sum-left-Scott/1000 461.4 μs 453.3 μs -1.8%
sum/hand-written-PLC/sum-left-Scott/2500 1.604 ms 1.560 ms -2.7%
sum/hand-written-PLC/sum-left-Scott/5000 4.431 ms 4.369 ms -1.4%
684818d 5c2f60c Change
TOTAL 333.4 ms 336.0 ms +0.8%

@effectfully
Copy link
Contributor Author

(the results should be disregarded, I screwed up the implementation and made it slower than it can be)

@effectfully effectfully force-pushed the effectfully/ast/performance/use-SmallArray-instead-of-Vector branch from 5c2f60c to dbbd853 Compare April 3, 2025 20:52
@effectfully
Copy link
Contributor Author

/benchmark lists

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Click here to check the status of your benchmark.

@effectfully effectfully force-pushed the effectfully/ast/performance/use-SmallArray-instead-of-Vector branch from dbbd853 to ccca4dd Compare April 3, 2025 20:53
@effectfully
Copy link
Contributor Author

/benchmark lists

1 similar comment
@effectfully
Copy link
Contributor Author

/benchmark lists

@effectfully
Copy link
Contributor Author

/benchmark nofib

1 similar comment
@effectfully
Copy link
Contributor Author

/benchmark nofib

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Click here to check the status of your benchmark.

@effectfully
Copy link
Contributor Author

/benchmark validation

@effectfully effectfully mentioned this pull request Apr 3, 2025
Open
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Comparing benchmark results of 'lists' on '2596b5b93c' (base) and 'ccca4dd6d7' (PR)

Results table
Script 2596b5b ccca4dd Change
sort/ghcSort/50 181.1 μs 176.5 μs -2.5%
sort/ghcSort/100 419.0 μs 410.0 μs -2.1%
sort/ghcSort/150 721.3 μs 709.0 μs -1.7%
sort/ghcSort/200 970.5 μs 952.1 μs -1.9%
sort/ghcSort/250 1.257 ms 1.230 ms -2.1%
sort/ghcSort/300 1.652 ms 1.624 ms -1.7%
sort/insertionSort/50 609.1 μs 604.5 μs -0.8%
sort/insertionSort/100 2.446 ms 2.414 ms -1.3%
sort/insertionSort/150 5.553 ms 5.413 ms -2.5%
sort/insertionSort/200 9.960 ms 9.678 ms -2.8%
sort/insertionSort/250 15.49 ms 15.19 ms -1.9%
sort/insertionSort/300 22.37 ms 21.93 ms -2.0%
sort/mergeSort/50 542.0 μs 535.2 μs -1.3%
sort/mergeSort/100 1.244 ms 1.232 ms -1.0%
sort/mergeSort/150 2.004 ms 1.976 ms -1.4%
sort/mergeSort/200 2.812 ms 2.770 ms -1.5%
sort/mergeSort/250 3.691 ms 3.638 ms -1.4%
sort/mergeSort/300 4.492 ms 4.421 ms -1.6%
sort/quickSort/50 1.425 ms 1.399 ms -1.8%
sort/quickSort/100 5.904 ms 5.780 ms -2.1%
sort/quickSort/150 13.25 ms 12.99 ms -2.0%
sort/quickSort/200 23.54 ms 23.06 ms -2.0%
sort/quickSort/250 37.02 ms 36.22 ms -2.2%
sort/quickSort/300 53.06 ms 52.32 ms -1.4%
sum/compiled-from-Haskell/sum-right-builtin/100 77.87 μs 77.95 μs +0.1%
sum/compiled-from-Haskell/sum-right-builtin/500 405.8 μs 406.8 μs +0.2%
sum/compiled-from-Haskell/sum-right-builtin/1000 867.2 μs 865.7 μs -0.2%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.685 ms 2.655 ms -1.1%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.757 ms 5.751 ms -0.1%
sum/compiled-from-Haskell/sum-right-Scott/100 43.81 μs 43.98 μs +0.4%
sum/compiled-from-Haskell/sum-right-Scott/500 232.8 μs 232.5 μs -0.1%
sum/compiled-from-Haskell/sum-right-Scott/1000 493.2 μs 509.6 μs +3.3%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.721 ms 1.727 ms +0.3%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.129 ms 4.170 ms +1.0%
sum/compiled-from-Haskell/sum-right-data/100 257.9 μs 252.2 μs -2.2%
sum/compiled-from-Haskell/sum-right-data/500 1.475 ms 1.388 ms -5.9%
sum/compiled-from-Haskell/sum-right-data/1000 3.161 ms 3.116 ms -1.4%
sum/compiled-from-Haskell/sum-right-data/2500 8.477 ms 8.312 ms -1.9%
sum/compiled-from-Haskell/sum-right-data/5000 18.08 ms 17.74 ms -1.9%
sum/compiled-from-Haskell/sum-left-builtin/100 74.95 μs 76.13 μs +1.6%
sum/compiled-from-Haskell/sum-left-builtin/500 390.0 μs 394.3 μs +1.1%
sum/compiled-from-Haskell/sum-left-builtin/1000 835.9 μs 846.7 μs +1.3%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.577 ms 2.595 ms +0.7%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.673 ms 5.726 ms +0.9%
sum/compiled-from-Haskell/sum-left-Scott/100 42.54 μs 42.11 μs -1.0%
sum/compiled-from-Haskell/sum-left-Scott/500 223.8 μs 224.0 μs +0.1%
sum/compiled-from-Haskell/sum-left-Scott/1000 490.7 μs 491.1 μs +0.1%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.622 ms 1.629 ms +0.4%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.043 ms 4.083 ms +1.0%
sum/compiled-from-Haskell/sum-left-data/100 264.8 μs 259.5 μs -2.0%
sum/compiled-from-Haskell/sum-left-data/500 1.516 ms 1.439 ms -5.1%
sum/compiled-from-Haskell/sum-left-data/1000 3.294 ms 3.232 ms -1.9%
sum/compiled-from-Haskell/sum-left-data/2500 8.691 ms 8.597 ms -1.1%
sum/compiled-from-Haskell/sum-left-data/5000 18.47 ms 18.22 ms -1.4%
sum/hand-written-PLC/sum-right-builtin/100 52.13 μs 53.91 μs +3.4%
sum/hand-written-PLC/sum-right-builtin/500 268.9 μs 271.0 μs +0.8%
sum/hand-written-PLC/sum-right-builtin/1000 537.1 μs 558.3 μs +3.9%
sum/hand-written-PLC/sum-right-builtin/2500 1.562 ms 1.604 ms +2.7%
sum/hand-written-PLC/sum-right-builtin/5000 3.500 ms 3.542 ms +1.2%
sum/hand-written-PLC/sum-right-Scott/100 35.31 μs 34.97 μs -1.0%
sum/hand-written-PLC/sum-right-Scott/500 183.9 μs 187.6 μs +2.0%
sum/hand-written-PLC/sum-right-Scott/1000 412.0 μs 412.7 μs +0.2%
sum/hand-written-PLC/sum-right-Scott/2500 1.378 ms 1.373 ms -0.4%
sum/hand-written-PLC/sum-right-Scott/5000 4.127 ms 4.095 ms -0.8%
sum/hand-written-PLC/sum-left-builtin/100 55.54 μs 56.79 μs +2.3%
sum/hand-written-PLC/sum-left-builtin/500 273.4 μs 278.6 μs +1.9%
sum/hand-written-PLC/sum-left-builtin/1000 545.5 μs 546.7 μs +0.2%
sum/hand-written-PLC/sum-left-builtin/2500 1.359 ms 1.373 ms +1.0%
sum/hand-written-PLC/sum-left-builtin/5000 2.702 ms 2.719 ms +0.6%
sum/hand-written-PLC/sum-left-Scott/100 38.23 μs 38.09 μs -0.4%
sum/hand-written-PLC/sum-left-Scott/500 206.8 μs 207.1 μs +0.1%
sum/hand-written-PLC/sum-left-Scott/1000 464.6 μs 457.7 μs -1.5%
sum/hand-written-PLC/sum-left-Scott/2500 1.587 ms 1.573 ms -0.9%
sum/hand-written-PLC/sum-left-Scott/5000 4.425 ms 4.394 ms -0.7%
2596b5b ccca4dd Change
TOTAL 330.4 ms 325.6 ms -1.5%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Comparing benchmark results of 'lists' on '2596b5b93c' (base) and 'ccca4dd6d7' (PR)

Results table
Script 2596b5b ccca4dd Change
sort/ghcSort/50 180.0 μs 176.7 μs -1.8%
sort/ghcSort/100 415.7 μs 410.7 μs -1.2%
sort/ghcSort/150 718.0 μs 707.4 μs -1.5%
sort/ghcSort/200 962.0 μs 952.3 μs -1.0%
sort/ghcSort/250 1.244 ms 1.229 ms -1.2%
sort/ghcSort/300 1.640 ms 1.620 ms -1.2%
sort/insertionSort/50 611.1 μs 604.5 μs -1.1%
sort/insertionSort/100 2.457 ms 2.415 ms -1.7%
sort/insertionSort/150 5.544 ms 5.416 ms -2.3%
sort/insertionSort/200 9.865 ms 9.681 ms -1.9%
sort/insertionSort/250 15.57 ms 15.15 ms -2.7%
sort/insertionSort/300 22.32 ms 21.97 ms -1.6%
sort/mergeSort/50 545.3 μs 536.2 μs -1.7%
sort/mergeSort/100 1.249 ms 1.230 ms -1.5%
sort/mergeSort/150 2.011 ms 1.974 ms -1.8%
sort/mergeSort/200 2.829 ms 2.770 ms -2.1%
sort/mergeSort/250 3.699 ms 3.629 ms -1.9%
sort/mergeSort/300 4.504 ms 4.420 ms -1.9%
sort/quickSort/50 1.422 ms 1.398 ms -1.7%
sort/quickSort/100 5.845 ms 5.770 ms -1.3%
sort/quickSort/150 13.14 ms 12.99 ms -1.1%
sort/quickSort/200 23.26 ms 22.98 ms -1.2%
sort/quickSort/250 36.56 ms 36.18 ms -1.0%
sort/quickSort/300 52.73 ms 52.38 ms -0.7%
sum/compiled-from-Haskell/sum-right-builtin/100 77.28 μs 78.21 μs +1.2%
sum/compiled-from-Haskell/sum-right-builtin/500 403.7 μs 406.7 μs +0.7%
sum/compiled-from-Haskell/sum-right-builtin/1000 857.5 μs 864.8 μs +0.9%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.633 ms 2.654 ms +0.8%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.701 ms 5.755 ms +0.9%
sum/compiled-from-Haskell/sum-right-Scott/100 43.49 μs 43.90 μs +0.9%
sum/compiled-from-Haskell/sum-right-Scott/500 230.8 μs 231.7 μs +0.4%
sum/compiled-from-Haskell/sum-right-Scott/1000 489.4 μs 508.1 μs +3.8%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.704 ms 1.725 ms +1.2%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.116 ms 4.168 ms +1.3%
sum/compiled-from-Haskell/sum-right-data/100 269.5 μs 252.3 μs -6.4%
sum/compiled-from-Haskell/sum-right-data/500 1.447 ms 1.393 ms -3.7%
sum/compiled-from-Haskell/sum-right-data/1000 3.157 ms 3.117 ms -1.3%
sum/compiled-from-Haskell/sum-right-data/2500 8.464 ms 8.342 ms -1.4%
sum/compiled-from-Haskell/sum-right-data/5000 18.04 ms 17.77 ms -1.5%
sum/compiled-from-Haskell/sum-left-builtin/100 75.14 μs 75.60 μs +0.6%
sum/compiled-from-Haskell/sum-left-builtin/500 390.5 μs 393.7 μs +0.8%
sum/compiled-from-Haskell/sum-left-builtin/1000 836.9 μs 846.2 μs +1.1%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.572 ms 2.584 ms +0.5%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.664 ms 5.698 ms +0.6%
sum/compiled-from-Haskell/sum-left-Scott/100 42.58 μs 42.03 μs -1.3%
sum/compiled-from-Haskell/sum-left-Scott/500 224.7 μs 224.3 μs -0.2%
sum/compiled-from-Haskell/sum-left-Scott/1000 490.9 μs 490.1 μs -0.2%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.619 ms 1.627 ms +0.5%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.037 ms 4.078 ms +1.0%
sum/compiled-from-Haskell/sum-left-data/100 277.2 μs 260.5 μs -6.0%
sum/compiled-from-Haskell/sum-left-data/500 1.457 ms 1.439 ms -1.2%
sum/compiled-from-Haskell/sum-left-data/1000 3.275 ms 3.240 ms -1.1%
sum/compiled-from-Haskell/sum-left-data/2500 8.705 ms 8.592 ms -1.3%
sum/compiled-from-Haskell/sum-left-data/5000 18.46 ms 18.23 ms -1.2%
sum/hand-written-PLC/sum-right-builtin/100 52.16 μs 53.15 μs +1.9%
sum/hand-written-PLC/sum-right-builtin/500 262.2 μs 270.9 μs +3.3%
sum/hand-written-PLC/sum-right-builtin/1000 540.5 μs 557.7 μs +3.2%
sum/hand-written-PLC/sum-right-builtin/2500 1.558 ms 1.604 ms +3.0%
sum/hand-written-PLC/sum-right-builtin/5000 3.458 ms 3.543 ms +2.5%
sum/hand-written-PLC/sum-right-Scott/100 34.79 μs 34.91 μs +0.3%
sum/hand-written-PLC/sum-right-Scott/500 182.8 μs 187.1 μs +2.4%
sum/hand-written-PLC/sum-right-Scott/1000 405.3 μs 413.5 μs +2.0%
sum/hand-written-PLC/sum-right-Scott/2500 1.364 ms 1.367 ms +0.2%
sum/hand-written-PLC/sum-right-Scott/5000 4.111 ms 4.093 ms -0.4%
sum/hand-written-PLC/sum-left-builtin/100 55.74 μs 56.86 μs +2.0%
sum/hand-written-PLC/sum-left-builtin/500 274.8 μs 277.8 μs +1.1%
sum/hand-written-PLC/sum-left-builtin/1000 544.0 μs 547.0 μs +0.6%
sum/hand-written-PLC/sum-left-builtin/2500 1.363 ms 1.373 ms +0.7%
sum/hand-written-PLC/sum-left-builtin/5000 2.702 ms 2.725 ms +0.9%
sum/hand-written-PLC/sum-left-Scott/100 38.92 μs 38.08 μs -2.2%
sum/hand-written-PLC/sum-left-Scott/500 206.7 μs 207.1 μs +0.2%
sum/hand-written-PLC/sum-left-Scott/1000 460.6 μs 456.6 μs -0.9%
sum/hand-written-PLC/sum-left-Scott/2500 1.583 ms 1.572 ms -0.7%
sum/hand-written-PLC/sum-left-Scott/5000 4.422 ms 4.388 ms -0.8%
2596b5b ccca4dd Change
TOTAL 328.7 ms 325.5 ms -1.0%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Comparing benchmark results of 'nofib' on '2596b5b93c' (base) and 'ccca4dd6d7' (PR)

Results table
Script 2596b5b ccca4dd Change
clausify/formula1 2.202 ms 2.187 ms -0.7%
clausify/formula2 2.971 ms 2.953 ms -0.6%
clausify/formula3 8.243 ms 8.176 ms -0.8%
clausify/formula4 17.72 ms 17.69 ms -0.2%
clausify/formula5 40.15 ms 39.78 ms -0.9%
knights/4x4 14.86 ms 14.81 ms -0.3%
knights/6x6 36.46 ms 35.82 ms -1.8%
knights/8x8 63.15 ms 62.01 ms -1.8%
primetest/05digits 8.959 ms 9.139 ms +2.0%
primetest/10digits 17.49 ms 17.89 ms +2.3%
primetest/30digits 53.81 ms 55.36 ms +2.9%
primetest/50digits 88.80 ms 91.16 ms +2.7%
queens4x4/bt 4.125 ms 4.013 ms -2.7%
queens4x4/bm 5.061 ms 5.014 ms -0.9%
queens4x4/bjbt1 4.918 ms 4.791 ms -2.6%
queens4x4/bjbt2 4.645 ms 4.522 ms -2.6%
queens4x4/fc 10.12 ms 9.995 ms -1.2%
queens5x5/bt 57.45 ms 55.93 ms -2.6%
queens5x5/bm 58.07 ms 57.61 ms -0.8%
queens5x5/bjbt1 66.37 ms 64.87 ms -2.3%
queens5x5/bjbt2 64.40 ms 63.17 ms -1.9%
queens5x5/fc 128.2 ms 126.7 ms -1.2%
2596b5b ccca4dd Change
TOTAL 758.2 ms 753.6 ms -0.6%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Comparing benchmark results of 'nofib' on '2596b5b93c' (base) and 'ccca4dd6d7' (PR)

Results table
Script 2596b5b ccca4dd Change
clausify/formula1 2.230 ms 2.171 ms -2.6%
clausify/formula2 3.010 ms 2.929 ms -2.7%
clausify/formula3 8.270 ms 8.101 ms -2.0%
clausify/formula4 17.79 ms 17.56 ms -1.3%
clausify/formula5 40.33 ms 39.48 ms -2.1%
knights/4x4 14.90 ms 14.62 ms -1.9%
knights/6x6 36.52 ms 35.73 ms -2.2%
knights/8x8 63.28 ms 61.88 ms -2.2%
primetest/05digits 8.937 ms 9.030 ms +1.0%
primetest/10digits 17.58 ms 17.64 ms +0.3%
primetest/30digits 53.85 ms 54.63 ms +1.4%
primetest/50digits 89.39 ms 90.06 ms +0.7%
queens4x4/bt 4.118 ms 4.013 ms -2.5%
queens4x4/bm 5.062 ms 5.009 ms -1.0%
queens4x4/bjbt1 4.921 ms 4.779 ms -2.9%
queens4x4/bjbt2 4.636 ms 4.514 ms -2.6%
queens4x4/fc 10.10 ms 9.969 ms -1.3%
queens5x5/bt 57.77 ms 55.95 ms -3.2%
queens5x5/bm 58.56 ms 57.48 ms -1.8%
queens5x5/bjbt1 66.99 ms 64.86 ms -3.2%
queens5x5/bjbt2 65.09 ms 63.06 ms -3.1%
queens5x5/fc 129.2 ms 126.6 ms -2.0%
2596b5b ccca4dd Change
TOTAL 762.5 ms 750.1 ms -1.6%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Comparing benchmark results of 'validation' on '2596b5b93c' (base) and 'ccca4dd6d7' (PR)

Results table
Script 2596b5b ccca4dd Change
auction_1-1 164.7 μs 164.7 μs 0.0%
auction_1-2 528.1 μs 530.4 μs +0.4%
auction_1-3 534.1 μs 528.5 μs -1.0%
auction_1-4 213.5 μs 213.4 μs -0.0%
auction_2-1 164.1 μs 168.3 μs +2.6%
auction_2-2 525.1 μs 529.2 μs +0.8%
auction_2-3 676.7 μs 688.7 μs +1.8%
auction_2-4 524.3 μs 529.4 μs +1.0%
auction_2-5 218.9 μs 213.1 μs -2.6%
crowdfunding-success-1 193.3 μs 195.5 μs +1.1%
crowdfunding-success-2 192.8 μs 195.8 μs +1.6%
crowdfunding-success-3 192.6 μs 195.6 μs +1.6%
currency-1 210.5 μs 212.2 μs +0.8%
escrow-redeem_1-1 297.1 μs 304.8 μs +2.6%
escrow-redeem_1-2 298.4 μs 303.7 μs +1.8%
escrow-redeem_2-1 347.9 μs 356.6 μs +2.5%
escrow-redeem_2-2 348.4 μs 357.2 μs +2.5%
escrow-redeem_2-3 347.4 μs 357.4 μs +2.9%
escrow-refund-1 141.8 μs 145.6 μs +2.7%
future-increase-margin-1 210.8 μs 213.0 μs +1.0%
future-increase-margin-2 450.8 μs 468.7 μs +4.0%
future-increase-margin-3 448.4 μs 464.4 μs +3.6%
future-increase-margin-4 403.1 μs 412.1 μs +2.2%
future-increase-margin-5 683.6 μs 693.2 μs +1.4%
future-pay-out-1 211.2 μs 213.2 μs +0.9%
future-pay-out-2 450.7 μs 464.5 μs +3.1%
future-pay-out-3 449.5 μs 466.3 μs +3.7%
future-pay-out-4 683.4 μs 693.6 μs +1.5%
future-settle-early-1 210.9 μs 212.9 μs +0.9%
future-settle-early-2 448.8 μs 463.7 μs +3.3%
future-settle-early-3 450.4 μs 464.5 μs +3.1%
future-settle-early-4 518.7 μs 529.0 μs +2.0%
game-sm-success_1-1 335.2 μs 336.0 μs +0.2%
game-sm-success_1-2 183.8 μs 187.8 μs +2.2%
game-sm-success_1-3 527.0 μs 539.4 μs +2.4%
game-sm-success_1-4 214.0 μs 221.7 μs +3.6%
game-sm-success_2-1 330.1 μs 336.3 μs +1.9%
game-sm-success_2-2 183.4 μs 187.8 μs +2.4%
game-sm-success_2-3 529.6 μs 540.0 μs +2.0%
game-sm-success_2-4 212.5 μs 216.6 μs +1.9%
game-sm-success_2-5 529.5 μs 538.8 μs +1.8%
game-sm-success_2-6 213.6 μs 216.8 μs +1.5%
multisig-sm-1 335.0 μs 341.7 μs +2.0%
multisig-sm-2 325.7 μs 329.4 μs +1.1%
multisig-sm-3 338.5 μs 340.4 μs +0.6%
multisig-sm-4 333.4 μs 339.4 μs +1.8%
multisig-sm-5 465.3 μs 467.5 μs +0.5%
multisig-sm-6 333.4 μs 341.1 μs +2.3%
multisig-sm-7 325.0 μs 330.1 μs +1.6%
multisig-sm-8 327.1 μs 332.8 μs +1.7%
multisig-sm-9 331.1 μs 337.2 μs +1.8%
multisig-sm-10 460.5 μs 466.1 μs +1.2%
ping-pong-1 277.6 μs 279.7 μs +0.8%
ping-pong-2 275.4 μs 279.9 μs +1.6%
ping-pong_2-1 176.1 μs 180.5 μs +2.5%
prism-1 153.6 μs 157.1 μs +2.3%
prism-2 349.3 μs 358.5 μs +2.6%
prism-3 316.1 μs 322.4 μs +2.0%
pubkey-1 131.6 μs 134.1 μs +1.9%
stablecoin_1-1 795.7 μs 807.8 μs +1.5%
stablecoin_1-2 178.2 μs 183.0 μs +2.7%
stablecoin_1-3 911.8 μs 921.7 μs +1.1%
stablecoin_1-4 188.8 μs 193.2 μs +2.3%
stablecoin_1-5 1.148 ms 1.170 ms +1.9%
stablecoin_1-6 230.7 μs 239.2 μs +3.7%
stablecoin_2-1 792.9 μs 816.0 μs +2.9%
stablecoin_2-2 176.8 μs 183.2 μs +3.6%
stablecoin_2-3 910.3 μs 930.0 μs +2.2%
stablecoin_2-4 187.4 μs 193.6 μs +3.3%
token-account-1 162.2 μs 166.3 μs +2.5%
token-account-2 286.3 μs 295.3 μs +3.1%
uniswap-1 335.9 μs 341.8 μs +1.8%
uniswap-2 194.6 μs 201.5 μs +3.5%
uniswap-3 1.460 ms 1.456 ms -0.3%
uniswap-4 305.0 μs 311.2 μs +2.0%
uniswap-5 960.1 μs 984.6 μs +2.6%
uniswap-6 286.8 μs 304.6 μs +6.2%
vesting-1 291.0 μs 302.6 μs +4.0%
2596b5b ccca4dd Change
TOTAL 30.06 ms 30.61 ms +1.8%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@effectfully effectfully

Labels
AST Evaluation EXPERIMENT Experiments that we probably don't want to merge Performance
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@effectfully