Skip to content

Latest commit

 

History

History
187 lines (161 loc) · 23.3 KB

RESULTS.md

File metadata and controls

187 lines (161 loc) · 23.3 KB

Results

Algorithms

primes/Simple

Language Time, s %99 Time, s %95 Time, s %50 Time, s %5 Time, s Startup time, s Total time, s Memory, MiB
C++ (clang) 0.054±0.000 0.055 0.055 0.054 0.053 0.002±0.000 0.056±0.001 1.81±0.72
C++ (gcc) 0.053±0.001 0.054 0.054 0.053 0.052 0.002±0.000 0.055±0.001 1.81±0.02
C (clang) 0.055±0.001 0.057 0.057 0.055 0.055 0.001±0.000 0.057±0.001 1.14±0.31
C (gcc) 0.054±0.001 0.055 0.055 0.054 0.054 0.001±0.000 0.056±0.001 1.14±0.39
Fortran (gfortran) 0.054±0.000 0.055 0.055 0.054 0.054 0.001±0.000 0.056±0.001 1.29±0.45
Go 0.063±0.001 0.064 0.064 0.063 0.062 0.002±0.000 0.065±0.000 2.92±0.00
Java 0.069±0.003 0.076 0.074 0.069 0.067 0.040±0.003 0.108±0.003 40.45±0.79
Java (GraalVM) 0.075±0.002 0.079 0.078 0.075 0.074 0.080±0.011 0.159±0.013 80.09±3.77
JavaScript (Node) 0.067±0.003 0.073 0.071 0.067 0.062 0.028±0.001 0.095±0.004 44.05±1.05
JavaScript (GraalVM) 0.458±0.025 0.505 0.501 0.458 0.433 0.379±0.020 0.837±0.027 336.66±8.63
Kotlin (JVM) 0.062±0.004 0.070 0.070 0.062 0.059 0.047±0.003 0.110±0.005 41.68±0.86
Kotlin (Native) 0.065±0.003 0.068 0.068 0.065 0.059 0.003±0.002 0.068±0.003 4.28±0.11
Lua 0.423±0.016 0.453 0.449 0.423 0.409 0.002±0.001 0.424±0.016 1.56±0.46
Lua (LuaJIT) 0.051±0.000 0.052 0.052 0.051 0.051 0.001±0.001 0.052±0.001 2.28±0.05
Perl 3.297±0.023 3.342 3.332 3.297 3.269 0.014±0.015 3.315±0.019 7.30±0.08
PHP 0.506±0.044 0.613 0.599 0.506 0.481 0.021±0.003 0.526±0.046 23.10±0.17
PHP (JIT: tracing) 0.075±0.005 0.085 0.085 0.075 0.070 0.025±0.002 0.100±0.007 26.57±0.19
PHP (JIT: function) 0.103±0.013 0.127 0.124 0.103 0.089 0.023±0.001 0.126±0.013 26.39±0.11
Python (CPython) 1.739±0.036 1.823 1.817 1.739 1.721 0.017±0.001 1.757±0.036 8.96±0.05
Python (PyPy) 0.097±0.008 0.114 0.111 0.097 0.089 0.032±0.002 0.129±0.010 53.38±0.27
Python (Numba) 0.303±0.045 0.429 0.385 0.303 0.285 0.764±0.206 1.057±0.214 105.72±2.09
Ruby 5.347±0.143 5.672 5.587 5.347 5.215 0.056±0.030 5.430±0.139 15.68±0.12
Ruby (JIT) 5.031±0.121 5.379 5.277 5.031 5.004 0.052±0.005 5.084±0.119 16.25±0.09
Ruby (JRuby) 4.533±0.103 4.672 4.666 4.533 4.375 2.162±0.125 6.671±0.126 359.57±19.06
Rust 0.053±0.001 0.054 0.054 0.053 0.052 0.002±0.001 0.055±0.001 1.75±0.07
Swift 2.938±0.019 2.971 2.961 2.938 2.912 0.254±0.573 3.190±0.469 165.90±14.32
Swift (Optimized) 0.055±0.002 0.061 0.061 0.055 0.054 0.309±0.216 0.362±0.177 172.12±14.75
Swift (Compiled) 0.056±0.004 0.066 0.065 0.056 0.054 0.006±0.001 0.062±0.005 11.08±1.42

primes/Atkin

Language Time, s %99 Time, s %95 Time, s %50 Time, s %5 Time, s Startup time, s Total time, s Memory, MiB
C++ (clang) 0.244±0.208 0.841 0.620 0.244 0.213 0.012±0.001 0.256±0.208 89.09±0.03
C++ (gcc) 0.217±0.020 0.254 0.250 0.217 0.194 0.013±0.001 0.230±0.021 89.09±0.06
Go 0.180±0.012 0.208 0.202 0.180 0.172 0.003±0.000 0.183±0.012 79.45±0.66
Java 0.221±0.011 0.238 0.238 0.221 0.209 0.051±0.003 0.272±0.014 187.36±1.75
Java (GraalVM) 0.347±0.029 0.388 0.388 0.347 0.306 0.091±0.007 0.440±0.032 244.36±13.99
JavaScript (Node) 0.366±0.029 0.409 0.405 0.366 0.324 0.072±0.004 0.438±0.034 226.77±0.99
JavaScript (GraalVM) 2.896±0.200 3.250 3.167 2.896 2.657 0.412±0.023 3.316±0.194 797.01±38.81
PHP 2.051±0.051 2.151 2.134 2.051 1.993 0.021±0.002 2.072±0.051 245.12±0.15
PHP (JIT: tracing) 1.117±0.061 1.218 1.211 1.117 1.062 0.024±0.002 1.140±0.061 248.59±0.18
PHP (JIT: function) 1.148±0.036 1.243 1.225 1.148 1.130 0.025±0.002 1.174±0.037 248.50±0.09
Python (CPython) 4.375±0.071 4.450 4.438 4.375 4.246 0.018±0.001 4.394±0.072 192.65±0.13
Python (PyPy) 1.287±0.034 1.376 1.358 1.287 1.271 0.054±0.002 1.340±0.035 303.95±0.26
Ruby 2.867±0.057 2.963 2.961 2.867 2.807 0.075±0.004 2.943±0.057 158.21±0.11
Ruby (JIT) 2.165±0.053 2.228 2.225 2.165 2.088 0.074±0.005 2.237±0.056 158.79±0.11
Ruby (JRuby) 3.323±0.111 3.414 3.410 3.323 3.120 2.497±0.324 5.699±0.343 602.69±29.44
Rust 0.171±0.006 0.183 0.181 0.171 0.164 0.009±0.001 0.180±0.006 77.52±0.08

collatz/MaxSequence

Language Time, s %99 Time, s %95 Time, s %50 Time, s %5 Time, s Startup time, s Total time, s Memory, MiB
C++ (clang) 0.060±0.001 0.063 0.063 0.060 0.059 0.002±0.000 0.063±0.001 1.80±0.48
Go 0.098±0.006 0.105 0.103 0.098 0.088 0.002±0.000 0.100±0.006 2.92±0.00
Java 0.099±0.006 0.117 0.112 0.099 0.097 0.051±0.003 0.150±0.009 41.71±1.08
Java (GraalVM) 0.107±0.010 0.129 0.124 0.107 0.098 0.100±0.009 0.202±0.017 83.68±3.11
JavaScript (Node) 0.661±0.010 0.676 0.675 0.661 0.647 0.026±0.002 0.687±0.011 42.68±0.97
JavaScript (GraalVM) 1.010±0.029 1.044 1.042 1.010 0.968 0.368±0.019 1.369±0.035 333.56±7.96
PHP 1.480±0.037 1.568 1.549 1.480 1.449 0.019±0.001 1.499±0.037 23.02±0.10
PHP (JIT: tracing) 0.498±0.015 0.522 0.521 0.498 0.481 0.023±0.001 0.522±0.015 26.52±0.12
PHP (JIT: function) 0.583±0.019 0.623 0.619 0.583 0.571 0.023±0.001 0.605±0.018 26.51±0.16
Python (CPython) 5.712±0.037 5.778 5.770 5.712 5.675 0.017±0.001 5.729±0.037 8.91±0.05
Python (PyPy) 0.131±0.005 0.142 0.142 0.131 0.129 0.033±0.003 0.164±0.005 52.92±0.17
Python (Numba) 0.333±0.032 0.416 0.399 0.333 0.320 0.774±0.036 1.113±0.067 106.71±0.97
Ruby 2.767±0.057 2.883 2.873 2.767 2.722 0.057±0.004 2.826±0.057 15.64±0.15
Ruby (JIT) 1.008±0.016 1.029 1.024 1.008 0.983 0.049±0.001 1.058±0.016 16.12±0.10
Ruby (JRuby) 1.219±0.073 1.379 1.368 1.219 1.173 2.171±0.066 3.432±0.101 517.49±53.41
Rust 0.051±0.002 0.056 0.055 0.051 0.050 0.002±0.001 0.053±0.002 1.81±0.08

mandelbrot/Simple

Language Time, s %99 Time, s %95 Time, s %50 Time, s %5 Time, s Startup time, s Total time, s Memory, MiB
C++ (clang) 0.033±0.000 0.034 0.034 0.033 0.033 0.002±0.000 0.035±0.001 1.82±0.77
C++ (gcc) 0.034±0.001 0.035 0.035 0.034 0.033 0.002±0.000 0.036±0.001 1.82±0.75
C# (csc) 0.108±0.001 0.110 0.109 0.108 0.106 0.012±0.001 0.120±0.002 25.29±1.00
C# (mcs) 0.111±0.003 0.114 0.114 0.111 0.106 0.012±0.001 0.123±0.003 25.31±0.86
Go 0.035±0.001 0.036 0.036 0.035 0.034 0.002±0.000 0.037±0.001 2.92±0.14
Java 0.057±0.001 0.060 0.060 0.057 0.056 0.049±0.005 0.106±0.005 44.40±1.85
Java (GraalVM) 0.052±0.003 0.060 0.060 0.052 0.051 0.096±0.005 0.149±0.005 84.26±3.50
JavaScript (Node) 0.051±0.002 0.056 0.055 0.051 0.049 0.028±0.004 0.080±0.006 47.56±1.01
JavaScript (GraalVM) 0.254±0.018 0.285 0.282 0.254 0.233 0.386±0.020 0.643±0.034 335.32±7.59
Lua 0.551±0.014 0.571 0.565 0.551 0.525 0.002±0.001 0.553±0.014 1.57±0.53
Lua (LuaJIT) 0.031±0.000 0.032 0.032 0.031 0.031 0.001±0.000 0.032±0.001 2.34±0.04
PHP 0.734±0.014 0.761 0.757 0.734 0.721 0.019±0.001 0.755±0.014 23.07±0.10
PHP (JIT: tracing) 0.122±0.003 0.128 0.128 0.122 0.120 0.022±0.001 0.145±0.004 26.51±0.11
PHP (JIT: function) 0.173±0.020 0.218 0.214 0.173 0.161 0.025±0.003 0.199±0.021 26.46±0.11
Python (CPython) 3.449±0.040 3.533 3.519 3.449 3.410 0.017±0.002 3.466±0.040 9.11±0.03
Python (PyPy) 0.050±0.001 0.052 0.052 0.050 0.048 0.032±0.002 0.081±0.003 54.64±0.23
Python (Numba) 0.322±0.017 0.365 0.357 0.322 0.314 0.715±0.072 1.046±0.085 105.40±1.52
Ruby 1.953±0.042 2.033 2.031 1.953 1.925 0.052±0.004 2.006±0.040 15.79±0.12
Ruby (JIT) 1.429±0.043 1.523 1.505 1.429 1.387 0.051±0.004 1.479±0.044 16.16±0.10
Ruby (JRuby) 2.357±0.076 2.488 2.455 2.357 2.239 2.154±0.158 4.605±0.169 549.95±62.82
Rust 0.032±0.000 0.033 0.033 0.032 0.032 0.002±0.001 0.034±0.001 1.79±0.09

treap/Naive

Language Time, s %99 Time, s %95 Time, s %50 Time, s %5 Time, s Startup time, s Total time, s Memory, MiB
C++ (clang) 0.227±0.007 0.241 0.239 0.227 0.222 0.002±0.000 0.229±0.007 3.41±0.86
C++ (gcc) 0.199±0.005 0.204 0.204 0.199 0.191 0.002±0.000 0.201±0.005 2.64±0.89
Go 0.325±0.010 0.335 0.334 0.325 0.308 0.002±0.000 0.327±0.009 7.64±0.87
Java 0.564±0.016 0.594 0.592 0.564 0.551 0.052±0.002 0.617±0.017 155.96±18.74
Java (GraalVM) 0.590±0.119 0.825 0.822 0.590 0.515 0.098±0.011 0.690±0.121 229.96±54.75
JavaScript (Node) 0.970±0.023 1.015 1.010 0.970 0.947 0.036±0.001 1.007±0.024 83.42±0.93
JavaScript (GraalVM) 2.433±0.081 2.507 2.505 2.433 2.282 0.403±0.026 2.846±0.090 545.30±18.72
Kotlin (JVM) 0.595±0.036 0.677 0.657 0.595 0.560 0.048±0.005 0.644±0.040 157.74±20.11
Kotlin (Native) 0.989±0.014 1.004 1.004 0.989 0.967 0.009±0.001 0.999±0.014 23.91±0.99
Lua 4.410±0.164 4.752 4.706 4.410 4.271 0.004±0.005 4.422±0.164 3.16±0.21
Lua (LuaJIT) 1.672±0.111 1.927 1.863 1.672 1.556 0.002±0.001 1.673±0.111 4.14±0.08
PHP 5.072±0.044 5.177 5.152 5.072 5.036 0.020±0.001 5.091±0.044 23.17±0.12
PHP (JIT: tracing) 3.124±0.035 3.156 3.152 3.124 3.059 0.024±0.002 3.149±0.034 26.72±0.13
PHP (JIT: function) 3.272±0.065 3.455 3.404 3.272 3.247 0.024±0.001 3.297±0.065 26.53±0.12
Python (CPython) 7.335±0.030 7.384 7.382 7.335 7.306 0.018±0.001 7.354±0.030 9.83±0.08
Python (PyPy) 2.809±0.067 2.935 2.909 2.809 2.728 0.037±0.011 2.844±0.066 62.16±0.59
Ruby 6.104±0.158 6.486 6.451 6.104 6.052 0.054±0.005 6.164±0.157 17.46±0.10
Ruby (JIT) 3.210±0.058 3.343 3.329 3.210 3.182 0.051±0.002 3.260±0.057 18.12±0.10
Ruby (JRuby) 5.521±0.273 5.791 5.789 5.521 5.028 2.227±0.064 7.715±0.280 236.45±21.72

recursion/Tak

Language Time, s %99 Time, s %95 Time, s %50 Time, s %5 Time, s Startup time, s Total time, s Memory, MiB
C++ (clang) 0.044±0.004 0.054 0.052 0.044 0.043 0.002±0.000 0.046±0.004 1.82±0.65
C++ (gcc) 0.026±0.004 0.037 0.035 0.026 0.026 0.002±0.000 0.028±0.004 2.56±0.82
Go 0.058±0.002 0.063 0.062 0.058 0.056 0.002±0.000 0.060±0.002 2.92±0.20
Java 0.043±0.001 0.045 0.045 0.043 0.042 0.050±0.002 0.094±0.002 40.74±0.96
Java (GraalVM) 0.059±0.011 0.087 0.083 0.059 0.056 0.093±0.009 0.157±0.019 78.40±2.93
JavaScript (Node) 0.168±0.011 0.183 0.181 0.168 0.152 0.028±0.002 0.194±0.013 42.51±1.05
JavaScript (GraalVM) 0.810±0.072 0.945 0.923 0.810 0.726 0.414±0.037 1.215±0.098 419.66±9.09
Lua 1.033±0.036 1.128 1.099 1.033 1.015 0.002±0.000 1.035±0.036 1.55±0.45
Lua (LuaJIT) 0.164±0.006 0.173 0.171 0.164 0.155 0.001±0.000 0.166±0.006 2.27±0.06
Perl 9.509±0.065 9.607 9.605 9.509 9.429 0.007±0.001 9.516±0.066 5.86±0.15
PHP 1.236±0.024 1.285 1.277 1.236 1.211 0.019±0.001 1.254±0.024 23.13±0.18
PHP (JIT: tracing) 0.413±0.010 0.433 0.429 0.413 0.403 0.022±0.001 0.436±0.011 26.54±0.16
PHP (JIT: function) 0.454±0.013 0.465 0.465 0.454 0.432 0.025±0.002 0.479±0.014 26.44±0.20
Python (CPython) 2.867±0.047 2.928 2.925 2.867 2.802 0.018±0.001 2.884±0.048 8.87±0.05
Python (PyPy) 0.800±0.013 0.820 0.817 0.800 0.781 0.032±0.002 0.832±0.012 59.72±0.22
Python (Numba) 0.329±0.015 0.351 0.349 0.329 0.305 0.740±0.036 1.060±0.050 105.33±1.47
Ruby 1.551±0.027 1.619 1.605 1.551 1.534 0.052±0.003 1.604±0.028 15.71±0.09
Ruby (JIT) 0.300±0.008 0.316 0.314 0.300 0.292 0.052±0.001 0.351±0.008 15.99±0.09
Ruby (JRuby) 0.682±0.056 0.726 0.718 0.682 0.577 2.134±0.029 2.821±0.070 181.99±4.79

linpack/Linpack

Language Time, s %99 Time, s %95 Time, s %50 Time, s %5 Time, s Startup time, s Total time, s Memory, MiB
C++ (clang) 2.114±0.051 2.172 2.161 2.114 2.026 0.006±0.001 2.119±0.051 33.53±0.33
C++ (gcc) 2.144±0.050 2.231 2.220 2.144 2.087 0.005±0.001 2.149±0.050 33.84±0.36
Go 2.759±0.191 3.063 3.029 2.759 2.557 0.002±0.000 2.761±0.191 35.96±0.16
Java 1.886±0.125 2.203 2.122 1.886 1.810 0.069±0.003 1.955±0.125 95.72±0.53
Java (GraalVM) 4.553±0.148 4.955 4.820 4.553 4.480 0.081±0.008 4.636±0.148 147.55±1.76
JavaScript (Node) 9.541±0.050 9.640 9.606 9.541 9.475 0.044±0.003 9.583±0.051 140.05±0.81
JavaScript (GraalVM) 4.450±0.075 4.621 4.575 4.450 4.374 0.393±0.137 4.872±0.136 407.62±14.23
PHP 89.654±1.538 94.070 92.846 89.654 89.293 0.021±0.002 89.678±1.537 95.04±0.14
PHP (JIT: tracing) 24.875±0.140 25.000 24.998 24.875 24.657 0.025±0.005 24.902±0.137 98.57±0.09
PHP (JIT: function) 32.051±0.181 32.304 32.292 32.051 31.781 0.027±0.001 32.078±0.181 98.38±0.18
Python (CPython) 491.429±21.018 502.447 500.310 491.429 453.944 0.021±0.001 491.451±21.018 163.44±0.89
Python (PyPy) 6.791±0.215 7.093 7.034 6.791 6.480 0.042±0.057 6.832±0.231 101.99±2.28

Legend

Field Description
Time Time spent in the algorithm itself, reported by the program itself.
Total time Total time spent from the start of the program to the end of the algorithm, measured by the benchmark.
Startup time Time spent from the start of the program to the start of the algorithm, measured by the benchmark (Total time - Time).
Memory Peak memory usage during the algorithm, measured by the benchmark.