Skip to content

[AST] [Performance] Use 'Array' instead of 'Vector' #7012

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

[AST] [Performance] Use 'Array' instead of 'Vector' #7012

wants to merge 1 commit into from

Conversation

effectfully
Copy link
Contributor

Same as #7010 except using Array rather than SmallArray.

@effectfully effectfully added Evaluation AST Performance EXPERIMENT Experiments that we probably don't want to merge labels Apr 3, 2025
@effectfully effectfully self-assigned this Apr 3, 2025
@effectfully
Copy link
Contributor Author

/benchmark lists

1 similar comment
@effectfully
Copy link
Contributor Author

/benchmark lists

@effectfully
Copy link
Contributor Author

/benchmark nofib

1 similar comment
@effectfully
Copy link
Contributor Author

/benchmark nofib

@effectfully
Copy link
Contributor Author

/benchmark validation

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Comparing benchmark results of 'lists' on '2596b5b93c' (base) and '4d053a266a' (PR)

Results table
Script 2596b5b 4d053a2 Change
sort/ghcSort/50 181.8 μs 177.8 μs -2.2%
sort/ghcSort/100 419.8 μs 414.1 μs -1.4%
sort/ghcSort/150 720.8 μs 716.6 μs -0.6%
sort/ghcSort/200 969.3 μs 964.1 μs -0.5%
sort/ghcSort/250 1.252 ms 1.245 ms -0.6%
sort/ghcSort/300 1.654 ms 1.644 ms -0.6%
sort/insertionSort/50 616.3 μs 614.7 μs -0.3%
sort/insertionSort/100 2.467 ms 2.442 ms -1.0%
sort/insertionSort/150 5.556 ms 5.517 ms -0.7%
sort/insertionSort/200 9.871 ms 9.815 ms -0.6%
sort/insertionSort/250 15.48 ms 15.37 ms -0.7%
sort/insertionSort/300 22.35 ms 22.19 ms -0.7%
sort/mergeSort/50 542.3 μs 542.5 μs +0.0%
sort/mergeSort/100 1.245 ms 1.240 ms -0.4%
sort/mergeSort/150 2.005 ms 2.006 ms +0.0%
sort/mergeSort/200 2.811 ms 2.812 ms +0.0%
sort/mergeSort/250 3.690 ms 3.684 ms -0.2%
sort/mergeSort/300 4.488 ms 4.486 ms -0.0%
sort/quickSort/50 1.423 ms 1.423 ms 0.0%
sort/quickSort/100 5.875 ms 5.891 ms +0.3%
sort/quickSort/150 13.21 ms 13.28 ms +0.5%
sort/quickSort/200 23.46 ms 23.45 ms -0.0%
sort/quickSort/250 36.96 ms 37.68 ms +1.9%
sort/quickSort/300 53.32 ms 53.38 ms +0.1%
sum/compiled-from-Haskell/sum-right-builtin/100 78.02 μs 80.29 μs +2.9%
sum/compiled-from-Haskell/sum-right-builtin/500 405.0 μs 417.5 μs +3.1%
sum/compiled-from-Haskell/sum-right-builtin/1000 862.5 μs 887.0 μs +2.8%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.656 ms 2.718 ms +2.3%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.741 ms 5.872 ms +2.3%
sum/compiled-from-Haskell/sum-right-Scott/100 43.53 μs 44.67 μs +2.6%
sum/compiled-from-Haskell/sum-right-Scott/500 231.8 μs 234.1 μs +1.0%
sum/compiled-from-Haskell/sum-right-Scott/1000 489.4 μs 512.0 μs +4.6%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.717 ms 1.733 ms +0.9%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.152 ms 4.181 ms +0.7%
sum/compiled-from-Haskell/sum-right-data/100 269.7 μs 256.6 μs -4.9%
sum/compiled-from-Haskell/sum-right-data/500 1.480 ms 1.412 ms -4.6%
sum/compiled-from-Haskell/sum-right-data/1000 3.169 ms 3.175 ms +0.2%
sum/compiled-from-Haskell/sum-right-data/2500 8.509 ms 8.496 ms -0.2%
sum/compiled-from-Haskell/sum-right-data/5000 18.17 ms 18.30 ms +0.7%
sum/compiled-from-Haskell/sum-left-builtin/100 75.54 μs 78.82 μs +4.3%
sum/compiled-from-Haskell/sum-left-builtin/500 392.4 μs 408.4 μs +4.1%
sum/compiled-from-Haskell/sum-left-builtin/1000 842.1 μs 874.9 μs +3.9%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.588 ms 2.665 ms +3.0%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.710 ms 5.883 ms +3.0%
sum/compiled-from-Haskell/sum-left-Scott/100 42.76 μs 42.70 μs -0.1%
sum/compiled-from-Haskell/sum-left-Scott/500 225.2 μs 228.1 μs +1.3%
sum/compiled-from-Haskell/sum-left-Scott/1000 493.4 μs 499.9 μs +1.3%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.631 ms 1.651 ms +1.2%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.085 ms 4.132 ms +1.2%
sum/compiled-from-Haskell/sum-left-data/100 266.8 μs 261.9 μs -1.8%
sum/compiled-from-Haskell/sum-left-data/500 1.526 ms 1.432 ms -6.2%
sum/compiled-from-Haskell/sum-left-data/1000 3.294 ms 3.231 ms -1.9%
sum/compiled-from-Haskell/sum-left-data/2500 8.742 ms 8.633 ms -1.2%
sum/compiled-from-Haskell/sum-left-data/5000 18.60 ms 18.43 ms -0.9%
sum/hand-written-PLC/sum-right-builtin/100 51.83 μs 54.08 μs +4.3%
sum/hand-written-PLC/sum-right-builtin/500 263.8 μs 265.8 μs +0.8%
sum/hand-written-PLC/sum-right-builtin/1000 541.5 μs 567.0 μs +4.7%
sum/hand-written-PLC/sum-right-builtin/2500 1.622 ms 1.596 ms -1.6%
sum/hand-written-PLC/sum-right-builtin/5000 3.521 ms 3.535 ms +0.4%
sum/hand-written-PLC/sum-right-Scott/100 34.65 μs 34.90 μs +0.7%
sum/hand-written-PLC/sum-right-Scott/500 183.9 μs 186.3 μs +1.3%
sum/hand-written-PLC/sum-right-Scott/1000 411.2 μs 410.7 μs -0.1%
sum/hand-written-PLC/sum-right-Scott/2500 1.377 ms 1.376 ms -0.1%
sum/hand-written-PLC/sum-right-Scott/5000 4.146 ms 4.133 ms -0.3%
sum/hand-written-PLC/sum-left-builtin/100 55.94 μs 55.72 μs -0.4%
sum/hand-written-PLC/sum-left-builtin/500 275.6 μs 272.2 μs -1.2%
sum/hand-written-PLC/sum-left-builtin/1000 547.4 μs 541.0 μs -1.2%
sum/hand-written-PLC/sum-left-builtin/2500 1.367 ms 1.352 ms -1.1%
sum/hand-written-PLC/sum-left-builtin/5000 2.717 ms 2.682 ms -1.3%
sum/hand-written-PLC/sum-left-Scott/100 38.91 μs 38.82 μs -0.2%
sum/hand-written-PLC/sum-left-Scott/500 207.5 μs 210.4 μs +1.4%
sum/hand-written-PLC/sum-left-Scott/1000 462.8 μs 463.9 μs +0.2%
sum/hand-written-PLC/sum-left-Scott/2500 1.595 ms 1.589 ms -0.4%
sum/hand-written-PLC/sum-left-Scott/5000 4.458 ms 4.440 ms -0.4%
2596b5b 4d053a2 Change
TOTAL 330.9 ms 331.6 ms +0.2%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Comparing benchmark results of 'lists' on '2596b5b93c' (base) and '4d053a266a' (PR)

Results table
Script 2596b5b 4d053a2 Change
sort/ghcSort/50 178.7 μs 182.6 μs +2.2%
sort/ghcSort/100 417.1 μs 425.0 μs +1.9%
sort/ghcSort/150 716.5 μs 735.1 μs +2.6%
sort/ghcSort/200 962.5 μs 983.4 μs +2.2%
sort/ghcSort/250 1.244 ms 1.271 ms +2.2%
sort/ghcSort/300 1.634 ms 1.675 ms +2.5%
sort/insertionSort/50 611.0 μs 632.0 μs +3.4%
sort/insertionSort/100 2.444 ms 2.516 ms +2.9%
sort/insertionSort/150 5.484 ms 5.669 ms +3.4%
sort/insertionSort/200 9.783 ms 10.17 ms +4.0%
sort/insertionSort/250 15.34 ms 15.89 ms +3.6%
sort/insertionSort/300 22.17 ms 23.00 ms +3.7%
sort/mergeSort/50 538.4 μs 551.3 μs +2.4%
sort/mergeSort/100 1.235 ms 1.264 ms +2.3%
sort/mergeSort/150 2.007 ms 2.031 ms +1.2%
sort/mergeSort/200 2.818 ms 2.853 ms +1.2%
sort/mergeSort/250 3.657 ms 3.743 ms +2.4%
sort/mergeSort/300 4.457 ms 4.553 ms +2.2%
sort/quickSort/50 1.411 ms 1.488 ms +5.5%
sort/quickSort/100 5.911 ms 6.162 ms +4.2%
sort/quickSort/150 13.30 ms 13.84 ms +4.1%
sort/quickSort/200 23.46 ms 24.49 ms +4.4%
sort/quickSort/250 36.97 ms 38.56 ms +4.3%
sort/quickSort/300 53.17 ms 55.67 ms +4.7%
sum/compiled-from-Haskell/sum-right-builtin/100 77.88 μs 79.24 μs +1.7%
sum/compiled-from-Haskell/sum-right-builtin/500 405.7 μs 412.7 μs +1.7%
sum/compiled-from-Haskell/sum-right-builtin/1000 863.7 μs 874.5 μs +1.3%
sum/compiled-from-Haskell/sum-right-builtin/2500 2.657 ms 2.685 ms +1.1%
sum/compiled-from-Haskell/sum-right-builtin/5000 5.756 ms 5.797 ms +0.7%
sum/compiled-from-Haskell/sum-right-Scott/100 43.69 μs 44.14 μs +1.0%
sum/compiled-from-Haskell/sum-right-Scott/500 231.9 μs 232.0 μs +0.0%
sum/compiled-from-Haskell/sum-right-Scott/1000 489.2 μs 506.3 μs +3.5%
sum/compiled-from-Haskell/sum-right-Scott/2500 1.718 ms 1.715 ms -0.2%
sum/compiled-from-Haskell/sum-right-Scott/5000 4.158 ms 4.152 ms -0.1%
sum/compiled-from-Haskell/sum-right-data/100 266.1 μs 252.9 μs -5.0%
sum/compiled-from-Haskell/sum-right-data/500 1.420 ms 1.396 ms -1.7%
sum/compiled-from-Haskell/sum-right-data/1000 3.171 ms 3.132 ms -1.2%
sum/compiled-from-Haskell/sum-right-data/2500 8.525 ms 8.384 ms -1.7%
sum/compiled-from-Haskell/sum-right-data/5000 18.16 ms 17.88 ms -1.5%
sum/compiled-from-Haskell/sum-left-builtin/100 75.78 μs 77.35 μs +2.1%
sum/compiled-from-Haskell/sum-left-builtin/500 392.4 μs 401.0 μs +2.2%
sum/compiled-from-Haskell/sum-left-builtin/1000 844.6 μs 859.5 μs +1.8%
sum/compiled-from-Haskell/sum-left-builtin/2500 2.592 ms 2.622 ms +1.2%
sum/compiled-from-Haskell/sum-left-builtin/5000 5.726 ms 5.779 ms +0.9%
sum/compiled-from-Haskell/sum-left-Scott/100 42.84 μs 42.05 μs -1.8%
sum/compiled-from-Haskell/sum-left-Scott/500 226.0 μs 225.7 μs -0.1%
sum/compiled-from-Haskell/sum-left-Scott/1000 495.4 μs 494.2 μs -0.2%
sum/compiled-from-Haskell/sum-left-Scott/2500 1.634 ms 1.639 ms +0.3%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.087 ms 4.089 ms +0.0%
sum/compiled-from-Haskell/sum-left-data/100 266.8 μs 258.9 μs -3.0%
sum/compiled-from-Haskell/sum-left-data/500 1.468 ms 1.425 ms -2.9%
sum/compiled-from-Haskell/sum-left-data/1000 3.303 ms 3.201 ms -3.1%
sum/compiled-from-Haskell/sum-left-data/2500 8.799 ms 8.537 ms -3.0%
sum/compiled-from-Haskell/sum-left-data/5000 18.55 ms 18.18 ms -2.0%
sum/hand-written-PLC/sum-right-builtin/100 52.64 μs 52.68 μs +0.1%
sum/hand-written-PLC/sum-right-builtin/500 261.0 μs 265.3 μs +1.6%
sum/hand-written-PLC/sum-right-builtin/1000 539.1 μs 546.8 μs +1.4%
sum/hand-written-PLC/sum-right-builtin/2500 1.582 ms 1.586 ms +0.3%
sum/hand-written-PLC/sum-right-builtin/5000 3.495 ms 3.506 ms +0.3%
sum/hand-written-PLC/sum-right-Scott/100 35.00 μs 33.73 μs -3.6%
sum/hand-written-PLC/sum-right-Scott/500 184.6 μs 185.2 μs +0.3%
sum/hand-written-PLC/sum-right-Scott/1000 411.7 μs 408.2 μs -0.9%
sum/hand-written-PLC/sum-right-Scott/2500 1.375 ms 1.363 ms -0.9%
sum/hand-written-PLC/sum-right-Scott/5000 4.149 ms 4.116 ms -0.8%
sum/hand-written-PLC/sum-left-builtin/100 56.23 μs 55.04 μs -2.1%
sum/hand-written-PLC/sum-left-builtin/500 275.6 μs 270.1 μs -2.0%
sum/hand-written-PLC/sum-left-builtin/1000 548.5 μs 534.3 μs -2.6%
sum/hand-written-PLC/sum-left-builtin/2500 1.370 ms 1.336 ms -2.5%
sum/hand-written-PLC/sum-left-builtin/5000 2.707 ms 2.649 ms -2.1%
sum/hand-written-PLC/sum-left-Scott/100 39.10 μs 38.52 μs -1.5%
sum/hand-written-PLC/sum-left-Scott/500 208.1 μs 208.5 μs +0.2%
sum/hand-written-PLC/sum-left-Scott/1000 463.9 μs 458.7 μs -1.1%
sum/hand-written-PLC/sum-left-Scott/2500 1.599 ms 1.576 ms -1.4%
sum/hand-written-PLC/sum-left-Scott/5000 4.459 ms 4.400 ms -1.3%
2596b5b 4d053a2 Change
TOTAL 330.2 ms 337.3 ms +2.2%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Comparing benchmark results of 'nofib' on '2596b5b93c' (base) and '4d053a266a' (PR)

Results table
Script 2596b5b 4d053a2 Change
clausify/formula1 2.220 ms 2.127 ms -4.2%
clausify/formula2 3.003 ms 2.880 ms -4.1%
clausify/formula3 8.317 ms 7.976 ms -4.1%
clausify/formula4 17.85 ms 17.40 ms -2.5%
clausify/formula5 40.43 ms 38.86 ms -3.9%
knights/4x4 14.98 ms 14.74 ms -1.6%
knights/6x6 36.60 ms 35.71 ms -2.4%
knights/8x8 63.49 ms 61.79 ms -2.7%
primetest/05digits 9.009 ms 9.114 ms +1.2%
primetest/10digits 17.64 ms 17.86 ms +1.2%
primetest/30digits 54.09 ms 54.89 ms +1.5%
primetest/50digits 89.87 ms 90.91 ms +1.2%
queens4x4/bt 4.151 ms 4.063 ms -2.1%
queens4x4/bm 5.100 ms 5.025 ms -1.5%
queens4x4/bjbt1 4.956 ms 4.877 ms -1.6%
queens4x4/bjbt2 4.676 ms 4.598 ms -1.7%
queens4x4/fc 10.19 ms 9.910 ms -2.7%
queens5x5/bt 57.19 ms 57.19 ms 0.0%
queens5x5/bm 57.99 ms 57.77 ms -0.4%
queens5x5/bjbt1 66.30 ms 66.25 ms -0.1%
queens5x5/bjbt2 64.65 ms 64.32 ms -0.5%
queens5x5/fc 128.5 ms 126.8 ms -1.3%
2596b5b 4d053a2 Change
TOTAL 761.2 ms 755.1 ms -0.8%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Comparing benchmark results of 'nofib' on '2596b5b93c' (base) and '4d053a266a' (PR)

Results table
Script 2596b5b 4d053a2 Change
clausify/formula1 2.204 ms 2.136 ms -3.1%
clausify/formula2 2.970 ms 2.900 ms -2.4%
clausify/formula3 8.233 ms 7.989 ms -3.0%
clausify/formula4 17.72 ms 17.51 ms -1.2%
clausify/formula5 40.12 ms 39.11 ms -2.5%
knights/4x4 14.85 ms 14.84 ms -0.1%
knights/6x6 36.47 ms 35.96 ms -1.4%
knights/8x8 63.20 ms 61.76 ms -2.3%
primetest/05digits 8.931 ms 9.169 ms +2.7%
primetest/10digits 17.41 ms 18.03 ms +3.6%
primetest/30digits 53.70 ms 55.32 ms +3.0%
primetest/50digits 89.33 ms 91.40 ms +2.3%
queens4x4/bt 4.117 ms 4.084 ms -0.8%
queens4x4/bm 5.061 ms 4.996 ms -1.3%
queens4x4/bjbt1 4.918 ms 4.867 ms -1.0%
queens4x4/bjbt2 4.637 ms 4.601 ms -0.8%
queens4x4/fc 10.11 ms 9.947 ms -1.6%
queens5x5/bt 57.42 ms 57.15 ms -0.5%
queens5x5/bm 58.07 ms 57.60 ms -0.8%
queens5x5/bjbt1 66.37 ms 66.04 ms -0.5%
queens5x5/bjbt2 64.66 ms 64.23 ms -0.7%
queens5x5/fc 128.4 ms 126.5 ms -1.5%
2596b5b 4d053a2 Change
TOTAL 758.9 ms 756.1 ms -0.4%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 4, 2025

Comparing benchmark results of 'validation' on '2596b5b93c' (base) and '4d053a266a' (PR)

Results table
Script 2596b5b 4d053a2 Change
auction_1-1 162.9 μs 160.8 μs -1.3%
auction_1-2 522.4 μs 515.8 μs -1.3%
auction_1-3 519.8 μs 520.4 μs +0.1%
auction_1-4 213.7 μs 208.2 μs -2.6%
auction_2-1 163.8 μs 160.5 μs -2.0%
auction_2-2 522.8 μs 515.7 μs -1.4%
auction_2-3 681.2 μs 669.2 μs -1.8%
auction_2-4 523.9 μs 516.7 μs -1.4%
auction_2-5 212.8 μs 208.0 μs -2.3%
crowdfunding-success-1 190.4 μs 190.1 μs -0.2%
crowdfunding-success-2 191.1 μs 189.8 μs -0.7%
crowdfunding-success-3 191.1 μs 190.7 μs -0.2%
currency-1 208.5 μs 206.6 μs -0.9%
escrow-redeem_1-1 295.5 μs 297.3 μs +0.6%
escrow-redeem_1-2 294.0 μs 296.7 μs +0.9%
escrow-redeem_2-1 345.8 μs 348.1 μs +0.7%
escrow-redeem_2-2 345.8 μs 346.1 μs +0.1%
escrow-redeem_2-3 345.9 μs 347.4 μs +0.4%
escrow-refund-1 144.0 μs 139.4 μs -3.2%
future-increase-margin-1 209.7 μs 206.8 μs -1.4%
future-increase-margin-2 446.0 μs 448.6 μs +0.6%
future-increase-margin-3 446.9 μs 446.8 μs -0.0%
future-increase-margin-4 400.6 μs 399.5 μs -0.3%
future-increase-margin-5 679.7 μs 674.8 μs -0.7%
future-pay-out-1 209.4 μs 207.4 μs -1.0%
future-pay-out-2 445.8 μs 447.6 μs +0.4%
future-pay-out-3 447.5 μs 447.6 μs +0.0%
future-pay-out-4 679.2 μs 673.6 μs -0.8%
future-settle-early-1 208.6 μs 206.4 μs -1.1%
future-settle-early-2 448.2 μs 447.9 μs -0.1%
future-settle-early-3 453.4 μs 446.6 μs -1.5%
future-settle-early-4 514.6 μs 512.0 μs -0.5%
game-sm-success_1-1 326.8 μs 326.6 μs -0.1%
game-sm-success_1-2 182.4 μs 179.0 μs -1.9%
game-sm-success_1-3 531.0 μs 521.8 μs -1.7%
game-sm-success_1-4 211.5 μs 207.8 μs -1.7%
game-sm-success_2-1 326.0 μs 326.7 μs +0.2%
game-sm-success_2-2 182.0 μs 180.2 μs -1.0%
game-sm-success_2-3 525.4 μs 524.0 μs -0.3%
game-sm-success_2-4 211.5 μs 208.5 μs -1.4%
game-sm-success_2-5 530.8 μs 523.8 μs -1.3%
game-sm-success_2-6 211.7 μs 208.6 μs -1.5%
multisig-sm-1 332.9 μs 332.6 μs -0.1%
multisig-sm-2 321.2 μs 320.9 μs -0.1%
multisig-sm-3 328.9 μs 328.6 μs -0.1%
multisig-sm-4 328.2 μs 328.9 μs +0.2%
multisig-sm-5 458.1 μs 455.6 μs -0.5%
multisig-sm-6 330.1 μs 331.7 μs +0.5%
multisig-sm-7 320.3 μs 320.2 μs -0.0%
multisig-sm-8 323.2 μs 324.8 μs +0.5%
multisig-sm-9 327.8 μs 329.1 μs +0.4%
multisig-sm-10 455.9 μs 455.8 μs -0.0%
ping-pong-1 272.6 μs 272.6 μs 0.0%
ping-pong-2 273.3 μs 271.8 μs -0.5%
ping-pong_2-1 174.8 μs 173.2 μs -0.9%
prism-1 152.5 μs 149.8 μs -1.8%
prism-2 346.2 μs 347.1 μs +0.3%
prism-3 319.2 μs 315.7 μs -1.1%
pubkey-1 130.5 μs 129.9 μs -0.5%
stablecoin_1-1 790.1 μs 794.2 μs +0.5%
stablecoin_1-2 176.2 μs 177.0 μs +0.5%
stablecoin_1-3 900.3 μs 910.8 μs +1.2%
stablecoin_1-4 186.2 μs 186.6 μs +0.2%
stablecoin_1-5 1.162 ms 1.153 ms -0.8%
stablecoin_1-6 231.1 μs 229.9 μs -0.5%
stablecoin_2-1 789.8 μs 794.3 μs +0.6%
stablecoin_2-2 175.8 μs 176.9 μs +0.6%
stablecoin_2-3 903.3 μs 910.7 μs +0.8%
stablecoin_2-4 186.2 μs 186.6 μs +0.2%
token-account-1 162.0 μs 162.2 μs +0.1%
token-account-2 285.4 μs 288.4 μs +1.1%
uniswap-1 333.4 μs 333.0 μs -0.1%
uniswap-2 192.4 μs 192.6 μs +0.1%
uniswap-3 1.442 ms 1.409 ms -2.3%
uniswap-4 310.6 μs 298.1 μs -4.0%
uniswap-5 956.1 μs 949.1 μs -0.7%
uniswap-6 286.3 μs 285.2 μs -0.4%
vesting-1 291.6 μs 288.3 μs -1.1%
2596b5b 4d053a2 Change
TOTAL 29.86 ms 29.71 ms -0.5%

Unisay
Unisay reviewed Apr 4, 2025
View reviewed changes
plutus-core/plutus-ir/src/PlutusIR/Purity.hs
<> evalThis (EvalTerm Pure WorkFree t)
<> evalThis (EvalTerm MaybeImpure WorkFree t)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

an "accidental bugfix" :) ?

@kwxm
Copy link
Contributor

kwxm commented Apr 5, 2025

/benchmark validation

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 5, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 5, 2025

Comparing benchmark results of 'validation' on '2596b5b93c' (base) and '4d053a266a' (PR)

Results table
Script 2596b5b 4d053a2 Change
auction_1-1 163.1 μs 163.3 μs +0.1%
auction_1-2 528.1 μs 522.1 μs -1.1%
auction_1-3 525.4 μs 522.4 μs -0.6%
auction_1-4 210.3 μs 210.8 μs +0.2%
auction_2-1 162.8 μs 162.0 μs -0.5%
auction_2-2 526.4 μs 520.7 μs -1.1%
auction_2-3 675.6 μs 676.0 μs +0.1%
auction_2-4 518.4 μs 520.4 μs +0.4%
auction_2-5 210.3 μs 211.4 μs +0.5%
crowdfunding-success-1 191.4 μs 197.2 μs +3.0%
crowdfunding-success-2 191.8 μs 192.3 μs +0.3%
crowdfunding-success-3 191.4 μs 192.1 μs +0.4%
currency-1 209.4 μs 208.9 μs -0.2%
escrow-redeem_1-1 294.2 μs 298.8 μs +1.6%
escrow-redeem_1-2 295.2 μs 298.9 μs +1.3%
escrow-redeem_2-1 346.2 μs 350.0 μs +1.1%
escrow-redeem_2-2 346.9 μs 350.7 μs +1.1%
escrow-redeem_2-3 345.9 μs 350.8 μs +1.4%
escrow-refund-1 140.6 μs 141.1 μs +0.4%
future-increase-margin-1 208.9 μs 209.6 μs +0.3%
future-increase-margin-2 445.0 μs 452.6 μs +1.7%
future-increase-margin-3 446.0 μs 452.9 μs +1.5%
future-increase-margin-4 405.7 μs 400.8 μs -1.2%
future-increase-margin-5 685.3 μs 681.0 μs -0.6%
future-pay-out-1 209.1 μs 208.6 μs -0.2%
future-pay-out-2 444.9 μs 450.6 μs +1.3%
future-pay-out-3 446.6 μs 449.1 μs +0.6%
future-pay-out-4 675.9 μs 674.6 μs -0.2%
future-settle-early-1 209.0 μs 206.5 μs -1.2%
future-settle-early-2 447.4 μs 447.7 μs +0.1%
future-settle-early-3 455.6 μs 448.7 μs -1.5%
future-settle-early-4 515.3 μs 513.5 μs -0.3%
game-sm-success_1-1 326.6 μs 326.5 μs -0.0%
game-sm-success_1-2 182.0 μs 179.6 μs -1.3%
game-sm-success_1-3 522.6 μs 521.4 μs -0.2%
game-sm-success_1-4 211.6 μs 210.3 μs -0.6%
game-sm-success_2-1 326.6 μs 329.8 μs +1.0%
game-sm-success_2-2 182.3 μs 181.5 μs -0.4%
game-sm-success_2-3 531.6 μs 526.6 μs -0.9%
game-sm-success_2-4 214.6 μs 210.6 μs -1.9%
game-sm-success_2-5 523.9 μs 535.2 μs +2.2%
game-sm-success_2-6 211.5 μs 211.4 μs -0.0%
multisig-sm-1 331.7 μs 335.0 μs +1.0%
multisig-sm-2 322.1 μs 324.3 μs +0.7%
multisig-sm-3 328.6 μs 333.0 μs +1.3%
multisig-sm-4 334.6 μs 333.0 μs -0.5%
multisig-sm-5 454.7 μs 461.4 μs +1.5%
multisig-sm-6 331.9 μs 334.9 μs +0.9%
multisig-sm-7 321.2 μs 323.6 μs +0.7%
multisig-sm-8 323.2 μs 327.0 μs +1.2%
multisig-sm-9 328.8 μs 331.5 μs +0.8%
multisig-sm-10 454.4 μs 459.5 μs +1.1%
ping-pong-1 273.1 μs 275.0 μs +0.7%
ping-pong-2 277.9 μs 273.4 μs -1.6%
ping-pong_2-1 174.7 μs 175.1 μs +0.2%
prism-1 151.8 μs 151.0 μs -0.5%
prism-2 345.6 μs 343.6 μs -0.6%
prism-3 320.6 μs 317.3 μs -1.0%
pubkey-1 130.1 μs 129.3 μs -0.6%
stablecoin_1-1 788.4 μs 792.8 μs +0.6%
stablecoin_1-2 176.3 μs 177.3 μs +0.6%
stablecoin_1-3 901.3 μs 925.1 μs +2.6%
stablecoin_1-4 187.2 μs 185.5 μs -0.9%
stablecoin_1-5 1.143 ms 1.144 ms +0.1%
stablecoin_1-6 231.0 μs 228.0 μs -1.3%
stablecoin_2-1 792.2 μs 789.6 μs -0.3%
stablecoin_2-2 177.2 μs 175.3 μs -1.1%
stablecoin_2-3 906.5 μs 901.5 μs -0.6%
stablecoin_2-4 188.0 μs 184.4 μs -1.9%
token-account-1 163.0 μs 160.7 μs -1.4%
token-account-2 286.2 μs 285.8 μs -0.1%
uniswap-1 333.8 μs 332.1 μs -0.5%
uniswap-2 192.7 μs 190.7 μs -1.0%
uniswap-3 1.445 ms 1.408 ms -2.6%
uniswap-4 301.5 μs 309.1 μs +2.5%
uniswap-5 957.4 μs 964.6 μs +0.8%
uniswap-6 288.1 μs 285.1 μs -1.0%
vesting-1 288.5 μs 288.4 μs -0.0%
2596b5b 4d053a2 Change
TOTAL 29.85 ms 29.87 ms +0.1%

@effectfully effectfully force-pushed the effectfully/ast/performance/use-Array-instead-of-Vector branch from 4d053a2 to d9ed722 Compare April 8, 2025 14:12
@effectfully
Copy link
Contributor Author

/benchmark nofib

1 similar comment
@effectfully
Copy link
Contributor Author

/benchmark nofib

@effectfully
Copy link
Contributor Author

/benchmark nofib

1 similar comment
@effectfully
Copy link
Contributor Author

/benchmark nofib

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 8, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 8, 2025

Comparing benchmark results of 'nofib' on 'f810009b23' (base) and 'd9ed72204c' (PR)

Results table
Script f810009 d9ed722 Change
clausify/formula1 2.183 ms 2.134 ms -2.2%
clausify/formula2 2.945 ms 2.885 ms -2.0%
clausify/formula3 8.149 ms 7.979 ms -2.1%
clausify/formula4 17.67 ms 17.49 ms -1.0%
clausify/formula5 39.70 ms 38.95 ms -1.9%
knights/4x4 14.84 ms 14.99 ms +1.0%
knights/6x6 36.42 ms 36.54 ms +0.3%
knights/8x8 63.20 ms 63.12 ms -0.1%
primetest/05digits 8.952 ms 9.404 ms +5.0%
primetest/10digits 17.69 ms 18.54 ms +4.8%
primetest/30digits 54.40 ms 57.22 ms +5.2%
primetest/50digits 91.18 ms 94.51 ms +3.7%
queens4x4/bt 4.110 ms 4.162 ms +1.3%
queens4x4/bm 5.046 ms 5.105 ms +1.2%
queens4x4/bjbt1 4.923 ms 4.948 ms +0.5%
queens4x4/bjbt2 4.622 ms 4.685 ms +1.4%
queens4x4/fc 10.10 ms 10.10 ms 0.0%
queens5x5/bt 57.22 ms 58.14 ms +1.6%
queens5x5/bm 57.96 ms 58.47 ms +0.9%
queens5x5/bjbt1 66.03 ms 67.06 ms +1.6%
queens5x5/bjbt2 64.26 ms 65.26 ms +1.6%
queens5x5/fc 128.0 ms 127.9 ms -0.1%
f810009 d9ed722 Change
TOTAL 759.6 ms 769.6 ms +1.3%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 8, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 8, 2025

Comparing benchmark results of 'nofib' on 'f810009b23' (base) and 'd9ed72204c' (PR)

Results table
Script f810009 d9ed722 Change
clausify/formula1 2.179 ms 2.122 ms -2.6%
clausify/formula2 2.938 ms 2.865 ms -2.5%
clausify/formula3 8.130 ms 7.940 ms -2.3%
clausify/formula4 17.65 ms 17.33 ms -1.8%
clausify/formula5 39.70 ms 38.85 ms -2.1%
knights/4x4 14.80 ms 14.68 ms -0.8%
knights/6x6 36.38 ms 35.93 ms -1.2%
knights/8x8 63.12 ms 61.96 ms -1.8%
primetest/05digits 9.339 ms 9.114 ms -2.4%
primetest/10digits 17.66 ms 18.01 ms +2.0%
primetest/30digits 55.65 ms 55.82 ms +0.3%
primetest/50digits 91.25 ms 91.51 ms +0.3%
queens4x4/bt 4.076 ms 4.085 ms +0.2%
queens4x4/bm 5.001 ms 5.016 ms +0.3%
queens4x4/bjbt1 4.861 ms 4.865 ms +0.1%
queens4x4/bjbt2 4.646 ms 4.600 ms -1.0%
queens4x4/fc 10.01 ms 9.945 ms -0.6%
queens5x5/bt 56.69 ms 56.77 ms +0.1%
queens5x5/bm 57.44 ms 57.45 ms +0.0%
queens5x5/bjbt1 65.57 ms 65.65 ms +0.1%
queens5x5/bjbt2 63.90 ms 63.89 ms -0.0%
queens5x5/fc 127.4 ms 125.8 ms -1.3%
f810009 d9ed722 Change
TOTAL 758.4 ms 754.2 ms -0.6%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 8, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 9, 2025

Comparing benchmark results of 'nofib' on 'f810009b23' (base) and 'd9ed72204c' (PR)

Results table
Script f810009 d9ed722 Change
clausify/formula1 2.169 ms 2.114 ms -2.5%
clausify/formula2 2.917 ms 2.851 ms -2.3%
clausify/formula3 8.078 ms 7.903 ms -2.2%
clausify/formula4 17.53 ms 17.25 ms -1.6%
clausify/formula5 39.31 ms 38.58 ms -1.9%
knights/4x4 14.72 ms 14.60 ms -0.8%
knights/6x6 36.18 ms 35.67 ms -1.4%
knights/8x8 62.90 ms 61.83 ms -1.7%
primetest/05digits 8.886 ms 9.145 ms +2.9%
primetest/10digits 17.53 ms 17.95 ms +2.4%
primetest/30digits 55.73 ms 55.48 ms -0.4%
primetest/50digits 92.07 ms 91.31 ms -0.8%
queens4x4/bt 4.150 ms 4.075 ms -1.8%
queens4x4/bm 5.017 ms 5.011 ms -0.1%
queens4x4/bjbt1 4.894 ms 4.852 ms -0.9%
queens4x4/bjbt2 4.614 ms 4.584 ms -0.7%
queens4x4/fc 10.04 ms 9.896 ms -1.4%
queens5x5/bt 57.08 ms 56.67 ms -0.7%
queens5x5/bm 57.65 ms 57.17 ms -0.8%
queens5x5/bjbt1 65.95 ms 65.54 ms -0.6%
queens5x5/bjbt2 64.23 ms 63.74 ms -0.8%
queens5x5/fc 127.7 ms 125.3 ms -1.9%
f810009 d9ed722 Change
TOTAL 759.3 ms 751.5 ms -1.0%

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 9, 2025

Click here to check the status of your benchmark.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 9, 2025

Comparing benchmark results of 'nofib' on 'f810009b23' (base) and 'd9ed72204c' (PR)

Results table
Script f810009 d9ed722 Change
clausify/formula1 2.179 ms 2.119 ms -2.8%
clausify/formula2 2.943 ms 2.860 ms -2.8%
clausify/formula3 8.148 ms 7.911 ms -2.9%
clausify/formula4 17.63 ms 17.44 ms -1.1%
clausify/formula5 39.64 ms 38.91 ms -1.8%
knights/4x4 14.81 ms 14.82 ms +0.1%
knights/6x6 36.47 ms 36.15 ms -0.9%
knights/8x8 63.31 ms 62.43 ms -1.4%
primetest/05digits 9.304 ms 9.316 ms +0.1%
primetest/10digits 17.72 ms 18.42 ms +4.0%
primetest/30digits 56.38 ms 56.26 ms -0.2%
primetest/50digits 89.46 ms 93.07 ms +4.0%
queens4x4/bt 4.108 ms 4.115 ms +0.2%
queens4x4/bm 5.038 ms 5.055 ms +0.3%
queens4x4/bjbt1 4.909 ms 4.898 ms -0.2%
queens4x4/bjbt2 4.622 ms 4.634 ms +0.3%
queens4x4/fc 10.09 ms 10.00 ms -0.9%
queens5x5/bt 57.17 ms 57.32 ms +0.3%
queens5x5/bm 58.05 ms 57.98 ms -0.1%
queens5x5/bjbt1 66.12 ms 66.32 ms +0.3%
queens5x5/bjbt2 64.30 ms 64.44 ms +0.2%
queens5x5/fc 128.1 ms 126.7 ms -1.1%
f810009 d9ed722 Change
TOTAL 760.5 ms 761.2 ms +0.1%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Unisay Unisay Unisay left review comments

At least 1 approving review is required to merge this pull request.

Assignees

@effectfully effectfully

Labels
AST Evaluation EXPERIMENT Experiments that we probably don't want to merge Performance
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@effectfully @kwxm @Unisay