Skip to content

Latest commit

 

History

History
213 lines (189 loc) · 40.6 KB

bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687-vs-base.md

File metadata and controls

213 lines (189 loc) · 40.6 KB

Results vs. base

  • fork: python
  • ref: bb5c6875d6e84bf2b4e1
  • machine: linux-x86_64
  • commit hash: bb5c687
  • commit date: 2025-02-03
  • overall geometric mean: 1.130x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.11x slower
  • Memory change: 1.20x

Benchmarks with tag 'apps':

Benchmark results/bm-20250203-3.14.0a4+-bb5c687/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json results/bm-20250203-3.14.0a4+-bb5c687-NOGIL/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json
2to3 254 ms 302 ms: 1.19x slower
docutils 2.55 sec 2.80 sec: 1.10x slower
sphinx 975 ms 1.11 sec: 1.14x slower
Geometric mean (ref) 1.14x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250203-3.14.0a4+-bb5c687/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json results/bm-20250203-3.14.0a4+-bb5c687-NOGIL/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json
async_tree_io_tg 620 ms 573 ms: 1.08x faster
async_tree_none_tg 260 ms 249 ms: 1.04x faster
async_tree_io 619 ms 604 ms: 1.02x faster
async_tree_memoization_tg 316 ms 321 ms: 1.02x slower
async_tree_cpu_io_mixed_tg 483 ms 499 ms: 1.03x slower
coroutines 22.3 ms 23.3 ms: 1.05x slower
async_tree_cpu_io_mixed 497 ms 530 ms: 1.07x slower
async_tree_none 268 ms 286 ms: 1.07x slower
async_tree_memoization 323 ms 348 ms: 1.08x slower
async_generators 325 ms 375 ms: 1.15x slower
Geometric mean (ref) 1.03x slower

Benchmark hidden because not significant (1): asyncio_websockets

Benchmarks with tag 'math':

Benchmark results/bm-20250203-3.14.0a4+-bb5c687/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json results/bm-20250203-3.14.0a4+-bb5c687-NOGIL/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json
pidigits 202 ms 192 ms: 1.05x faster
float 71.6 ms 76.7 ms: 1.07x slower
nbody 88.3 ms 129 ms: 1.47x slower
Geometric mean (ref) 1.14x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20250203-3.14.0a4+-bb5c687/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json results/bm-20250203-3.14.0a4+-bb5c687-NOGIL/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json
regex_effbot 2.71 ms 2.76 ms: 1.02x slower
regex_dna 167 ms 182 ms: 1.09x slower
regex_compile 125 ms 151 ms: 1.21x slower
Geometric mean (ref) 1.08x slower

Benchmark hidden because not significant (1): regex_v8

Benchmarks with tag 'serialize':

Benchmark results/bm-20250203-3.14.0a4+-bb5c687/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json results/bm-20250203-3.14.0a4+-bb5c687-NOGIL/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json
xml_etree_iterparse 91.2 ms 87.9 ms: 1.04x faster
xml_etree_parse 129 ms 128 ms: 1.01x faster
json_loads 28.7 us 31.3 us: 1.09x slower
json_dumps 11.5 ms 12.8 ms: 1.12x slower
xml_etree_generate 82.7 ms 96.9 ms: 1.17x slower
unpickle_pure_python 208 us 245 us: 1.18x slower
xml_etree_process 57.6 ms 68.9 ms: 1.20x slower
pickle_pure_python 304 us 370 us: 1.21x slower
tomli_loads 1.91 sec 2.35 sec: 1.23x slower
Geometric mean (ref) 1.12x slower

Benchmarks with tag 'startup':

Benchmark results/bm-20250203-3.14.0a4+-bb5c687/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json results/bm-20250203-3.14.0a4+-bb5c687-NOGIL/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json
python_startup 14.8 ms 15.3 ms: 1.04x slower
python_startup_no_site 7.51 ms 9.62 ms: 1.28x slower
Geometric mean (ref) 1.15x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250203-3.14.0a4+-bb5c687/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json results/bm-20250203-3.14.0a4+-bb5c687-NOGIL/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json
genshi_xml 48.8 ms 58.2 ms: 1.19x slower
django_template 34.5 ms 41.6 ms: 1.20x slower
genshi_text 21.2 ms 27.5 ms: 1.30x slower
mako 11.8 ms 15.9 ms: 1.34x slower
Geometric mean (ref) 1.26x slower

All benchmarks:

Benchmark results/bm-20250203-3.14.0a4+-bb5c687/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json results/bm-20250203-3.14.0a4+-bb5c687-NOGIL/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json
gc_traversal 4.33 ms 1.73 ms: 2.50x faster
create_gc_cycles 1.86 ms 1.36 ms: 1.37x faster
async_tree_io_tg 620 ms 573 ms: 1.08x faster
sqlite_synth 2.15 us 2.00 us: 1.08x faster
pidigits 202 ms 192 ms: 1.05x faster
async_tree_none_tg 260 ms 249 ms: 1.04x faster
xml_etree_iterparse 91.2 ms 87.9 ms: 1.04x faster
async_tree_io 619 ms 604 ms: 1.02x faster
xml_etree_parse 129 ms 128 ms: 1.01x faster
async_tree_memoization_tg 316 ms 321 ms: 1.02x slower
regex_effbot 2.71 ms 2.76 ms: 1.02x slower
async_tree_cpu_io_mixed_tg 483 ms 499 ms: 1.03x slower
pathlib 18.3 ms 18.9 ms: 1.03x slower
python_startup 14.8 ms 15.3 ms: 1.04x slower
json 5.12 ms 5.36 ms: 1.05x slower
coroutines 22.3 ms 23.3 ms: 1.05x slower
pycparser 1.12 sec 1.18 sec: 1.06x slower
bench_mp_pool 88.6 ms 93.7 ms: 1.06x slower
async_tree_cpu_io_mixed 497 ms 530 ms: 1.07x slower
async_tree_none 268 ms 286 ms: 1.07x slower
float 71.6 ms 76.7 ms: 1.07x slower
async_tree_memoization 323 ms 348 ms: 1.08x slower
regex_dna 167 ms 182 ms: 1.09x slower
json_loads 28.7 us 31.3 us: 1.09x slower
dulwich_log 75.2 ms 82.4 ms: 1.10x slower
logging_silent 101 ns 111 ns: 1.10x slower
docutils 2.55 sec 2.80 sec: 1.10x slower
generators 28.9 ms 31.8 ms: 1.10x slower
bpe_tokeniser 4.15 sec 4.63 sec: 1.11x slower
json_dumps 11.5 ms 12.8 ms: 1.12x slower
k_core 2.04 sec 2.30 sec: 1.13x slower
pylint 277 ms 314 ms: 1.14x slower
sphinx 975 ms 1.11 sec: 1.14x slower
async_generators 325 ms 375 ms: 1.15x slower
mdp 2.30 sec 2.66 sec: 1.16x slower
many_optionals 1.01 ms 1.18 ms: 1.17x slower
xml_etree_generate 82.7 ms 96.9 ms: 1.17x slower
subparsers 22.0 ms 25.8 ms: 1.17x slower
unpickle_pure_python 208 us 245 us: 1.18x slower
scimark_sor 111 ms 131 ms: 1.18x slower
sqlglot_normalize 101 ms 119 ms: 1.18x slower
spectral_norm 90.9 ms 108 ms: 1.18x slower
pprint_safe_repr 681 ms 808 ms: 1.19x slower
sqlglot_optimize 51.1 ms 60.7 ms: 1.19x slower
2to3 254 ms 302 ms: 1.19x slower
genshi_xml 48.8 ms 58.2 ms: 1.19x slower
xml_etree_process 57.6 ms 68.9 ms: 1.20x slower
pprint_pformat 1.39 sec 1.66 sec: 1.20x slower
sympy_expand 456 ms 548 ms: 1.20x slower
coverage 79.7 ms 95.8 ms: 1.20x slower
django_template 34.5 ms 41.6 ms: 1.20x slower
go 115 ms 138 ms: 1.21x slower
telco 7.16 ms 8.64 ms: 1.21x slower
pyflate 407 ms 493 ms: 1.21x slower
regex_compile 125 ms 151 ms: 1.21x slower
sympy_sum 153 ms 185 ms: 1.21x slower
nqueens 77.9 ms 94.4 ms: 1.21x slower
scimark_fft 317 ms 385 ms: 1.21x slower
comprehensions 16.2 us 19.7 us: 1.21x slower
pickle_pure_python 304 us 370 us: 1.21x slower
logging_simple 5.98 us 7.30 us: 1.22x slower
sympy_integrate 19.6 ms 24.0 ms: 1.23x slower
tomli_loads 1.91 sec 2.35 sec: 1.23x slower
deepcopy 248 us 306 us: 1.23x slower
scimark_lu 111 ms 138 ms: 1.24x slower
sqlglot_transpile 1.54 ms 1.90 ms: 1.24x slower
sqlalchemy_declarative 126 ms 157 ms: 1.24x slower
raytrace 259 ms 323 ms: 1.25x slower
deepcopy_reduce 2.55 us 3.18 us: 1.25x slower
sympy_str 269 ms 335 ms: 1.25x slower
logging_format 6.67 us 8.34 us: 1.25x slower
thrift 728 us 916 us: 1.26x slower
connected_components 392 ms 493 ms: 1.26x slower
hexiom 5.80 ms 7.33 ms: 1.26x slower
sqlalchemy_imperative 19.2 ms 24.4 ms: 1.27x slower
chaos 55.2 ms 70.0 ms: 1.27x slower
shortest_path 429 ms 545 ms: 1.27x slower
sqlglot_parse 1.24 ms 1.57 ms: 1.27x slower
python_startup_no_site 7.51 ms 9.62 ms: 1.28x slower
deepcopy_memo 29.0 us 37.3 us: 1.29x slower
scimark_sparse_mat_mult 4.24 ms 5.48 ms: 1.29x slower
genshi_text 21.2 ms 27.5 ms: 1.30x slower
fannkuch 370 ms 484 ms: 1.31x slower
typing_runtime_protocols 149 us 198 us: 1.33x slower
crypto_pyaes 66.8 ms 88.6 ms: 1.33x slower
scimark_monte_carlo 61.3 ms 81.4 ms: 1.33x slower
meteor_contest 97.1 ms 130 ms: 1.33x slower
mako 11.8 ms 15.9 ms: 1.34x slower
richards 41.7 ms 56.4 ms: 1.35x slower
richards_super 47.6 ms 65.2 ms: 1.37x slower
nbody 88.3 ms 129 ms: 1.47x slower
deltablue 3.13 ms 4.66 ms: 1.49x slower
bench_thread_pool 1.02 ms 3.31 ms: 3.24x slower
Geometric mean (ref) 1.16x slower

Benchmark hidden because not significant (2): asyncio_websockets, regex_v8 Ignored benchmarks (1) of results/bm-20250203-3.14.0a4+-bb5c687-NOGIL/bm-20250203-vultr-x86_64-python-bb5c6875d6e84bf2b4e1-3.14.0a4+-bb5c687.json: html5lib

  • Geometric mean (including insignificant results): 1.130x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.15x
  • 95% likely to have a slowdown of 1.13x
  • 99% likely to have a slowdown of 1.11x

Memory

  • memory change: 1.20x