Skip to content

Latest commit

 

History

History
207 lines (180 loc) · 37.8 KB

bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888-vs-base.md

File metadata and controls

207 lines (180 loc) · 37.8 KB

Results vs. base

  • fork: python
  • ref: ae4788809d674f8e27fa
  • machine: linux-x86_64
  • commit hash: ae47888
  • commit date: 2025-02-02
  • overall geometric mean: 1.123x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.10x slower
  • Memory change: 1.19x

Benchmarks with tag 'apps':

Benchmark results/bm-20250202-3.14.0a4+-ae47888/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json results/bm-20250202-3.14.0a4+-ae47888-NOGIL/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json
2to3 454 ms 535 ms: 1.18x slower
docutils 3.79 sec 3.99 sec: 1.05x slower
sphinx 1.41 sec 1.59 sec: 1.13x slower
Geometric mean (ref) 1.09x slower

Benchmark hidden because not significant (1): html5lib

Benchmarks with tag 'asyncio':

Benchmark results/bm-20250202-3.14.0a4+-ae47888/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json results/bm-20250202-3.14.0a4+-ae47888-NOGIL/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json
async_tree_none_tg 409 ms 352 ms: 1.16x faster
async_tree_io_tg 904 ms 833 ms: 1.09x faster
coroutines 31.3 ms 32.3 ms: 1.03x slower
asyncio_websockets 741 ms 776 ms: 1.05x slower
async_tree_cpu_io_mixed 724 ms 774 ms: 1.07x slower
async_tree_memoization_tg 444 ms 477 ms: 1.07x slower
async_generators 527 ms 576 ms: 1.09x slower
async_tree_none 391 ms 448 ms: 1.15x slower
async_tree_memoization 455 ms 598 ms: 1.31x slower
Geometric mean (ref) 1.04x slower

Benchmark hidden because not significant (2): async_tree_io, async_tree_cpu_io_mixed_tg

Benchmarks with tag 'math':

Benchmark results/bm-20250202-3.14.0a4+-ae47888/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json results/bm-20250202-3.14.0a4+-ae47888-NOGIL/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json
float 105 ms 114 ms: 1.09x slower
nbody 118 ms 178 ms: 1.51x slower
Geometric mean (ref) 1.18x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark results/bm-20250202-3.14.0a4+-ae47888/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json results/bm-20250202-3.14.0a4+-ae47888-NOGIL/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json
regex_dna 280 ms 289 ms: 1.03x slower
regex_compile 170 ms 187 ms: 1.10x slower
regex_effbot 4.30 ms 4.73 ms: 1.10x slower
Geometric mean (ref) 1.07x slower

Benchmark hidden because not significant (1): regex_v8

Benchmarks with tag 'serialize':

Benchmark results/bm-20250202-3.14.0a4+-ae47888/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json results/bm-20250202-3.14.0a4+-ae47888-NOGIL/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json
xml_etree_parse 203 ms 216 ms: 1.06x slower
xml_etree_generate 117 ms 129 ms: 1.10x slower
json_dumps 15.3 ms 17.0 ms: 1.11x slower
json_loads 39.2 us 43.9 us: 1.12x slower
tomli_loads 2.48 sec 3.04 sec: 1.22x slower
xml_etree_process 80.4 ms 99.6 ms: 1.24x slower
unpickle_pure_python 277 us 343 us: 1.24x slower
pickle_pure_python 404 us 538 us: 1.33x slower
Geometric mean (ref) 1.15x slower

Benchmark hidden because not significant (1): xml_etree_iterparse

Benchmarks with tag 'startup':

Benchmark results/bm-20250202-3.14.0a4+-ae47888/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json results/bm-20250202-3.14.0a4+-ae47888-NOGIL/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json
python_startup 27.1 ms 31.8 ms: 1.17x slower
python_startup_no_site 15.3 ms 20.7 ms: 1.35x slower
Geometric mean (ref) 1.26x slower

Benchmarks with tag 'template':

Benchmark results/bm-20250202-3.14.0a4+-ae47888/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json results/bm-20250202-3.14.0a4+-ae47888-NOGIL/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json
django_template 51.4 ms 58.1 ms: 1.13x slower
genshi_xml 69.6 ms 85.0 ms: 1.22x slower
genshi_text 31.1 ms 39.1 ms: 1.26x slower
mako 17.5 ms 23.9 ms: 1.37x slower
Geometric mean (ref) 1.24x slower

All benchmarks:

Benchmark results/bm-20250202-3.14.0a4+-ae47888/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json results/bm-20250202-3.14.0a4+-ae47888-NOGIL/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json
gc_traversal 8.59 ms 3.62 ms: 2.38x faster
create_gc_cycles 3.78 ms 2.69 ms: 1.40x faster
async_tree_none_tg 409 ms 352 ms: 1.16x faster
bench_mp_pool 92.9 ms 81.5 ms: 1.14x faster
async_tree_io_tg 904 ms 833 ms: 1.09x faster
sqlite_synth 3.82 us 3.57 us: 1.07x faster
regex_dna 280 ms 289 ms: 1.03x slower
coroutines 31.3 ms 32.3 ms: 1.03x slower
asyncio_websockets 741 ms 776 ms: 1.05x slower
docutils 3.79 sec 3.99 sec: 1.05x slower
xml_etree_parse 203 ms 216 ms: 1.06x slower
sqlglot_normalize 140 ms 150 ms: 1.06x slower
async_tree_cpu_io_mixed 724 ms 774 ms: 1.07x slower
async_tree_memoization_tg 444 ms 477 ms: 1.07x slower
pathlib 28.7 ms 31.0 ms: 1.08x slower
float 105 ms 114 ms: 1.09x slower
k_core 4.06 sec 4.43 sec: 1.09x slower
async_generators 527 ms 576 ms: 1.09x slower
xml_etree_generate 117 ms 129 ms: 1.10x slower
regex_compile 170 ms 187 ms: 1.10x slower
regex_effbot 4.30 ms 4.73 ms: 1.10x slower
sqlglot_optimize 74.6 ms 82.2 ms: 1.10x slower
json_dumps 15.3 ms 17.0 ms: 1.11x slower
connected_components 812 ms 904 ms: 1.11x slower
json 7.11 ms 7.95 ms: 1.12x slower
json_loads 39.2 us 43.9 us: 1.12x slower
dulwich_log 96.2 ms 108 ms: 1.12x slower
spectral_norm 136 ms 153 ms: 1.13x slower
sphinx 1.41 sec 1.59 sec: 1.13x slower
django_template 51.4 ms 58.1 ms: 1.13x slower
pprint_safe_repr 961 ms 1.09 sec: 1.13x slower
shortest_path 901 ms 1.02 sec: 1.13x slower
mdp 3.52 sec 4.02 sec: 1.14x slower
pylint 382 ms 436 ms: 1.14x slower
async_tree_none 391 ms 448 ms: 1.15x slower
sqlalchemy_imperative 25.8 ms 29.6 ms: 1.15x slower
scimark_sor 164 ms 189 ms: 1.15x slower
deepcopy_reduce 3.65 us 4.27 us: 1.17x slower
python_startup 27.1 ms 31.8 ms: 1.17x slower
sympy_expand 568 ms 668 ms: 1.18x slower
2to3 454 ms 535 ms: 1.18x slower
thrift 1.03 ms 1.21 ms: 1.18x slower
typing_runtime_protocols 214 us 253 us: 1.18x slower
meteor_contest 149 ms 178 ms: 1.19x slower
scimark_fft 447 ms 531 ms: 1.19x slower
sympy_integrate 27.8 ms 33.1 ms: 1.19x slower
logging_simple 9.01 us 10.7 us: 1.19x slower
go 159 ms 190 ms: 1.19x slower
comprehensions 21.9 us 26.2 us: 1.20x slower
crypto_pyaes 99.5 ms 119 ms: 1.20x slower
sympy_str 356 ms 427 ms: 1.20x slower
coverage 119 ms 144 ms: 1.21x slower
genshi_xml 69.6 ms 85.0 ms: 1.22x slower
tomli_loads 2.48 sec 3.04 sec: 1.22x slower
pprint_pformat 1.86 sec 2.29 sec: 1.23x slower
scimark_lu 149 ms 184 ms: 1.23x slower
xml_etree_process 80.4 ms 99.6 ms: 1.24x slower
generators 39.8 ms 49.4 ms: 1.24x slower
unpickle_pure_python 277 us 343 us: 1.24x slower
deepcopy_memo 44.2 us 54.9 us: 1.24x slower
genshi_text 31.1 ms 39.1 ms: 1.26x slower
sqlglot_parse 1.84 ms 2.32 ms: 1.26x slower
telco 9.64 ms 12.2 ms: 1.26x slower
hexiom 8.72 ms 11.1 ms: 1.27x slower
pyflate 610 ms 785 ms: 1.29x slower
richards 56.6 ms 73.2 ms: 1.30x slower
fannkuch 513 ms 666 ms: 1.30x slower
bpe_tokeniser 5.79 sec 7.55 sec: 1.30x slower
richards_super 71.5 ms 93.3 ms: 1.30x slower
sqlglot_transpile 2.16 ms 2.83 ms: 1.31x slower
async_tree_memoization 455 ms 598 ms: 1.31x slower
pickle_pure_python 404 us 538 us: 1.33x slower
sqlalchemy_declarative 165 ms 221 ms: 1.34x slower
raytrace 350 ms 471 ms: 1.35x slower
many_optionals 1.07 ms 1.45 ms: 1.35x slower
python_startup_no_site 15.3 ms 20.7 ms: 1.35x slower
scimark_monte_carlo 89.4 ms 121 ms: 1.36x slower
mako 17.5 ms 23.9 ms: 1.37x slower
sympy_sum 193 ms 267 ms: 1.38x slower
chaos 75.4 ms 105 ms: 1.39x slower
logging_format 8.82 us 12.3 us: 1.40x slower
scimark_sparse_mat_mult 5.83 ms 8.37 ms: 1.44x slower
bench_thread_pool 3.30 ms 4.85 ms: 1.47x slower
nbody 118 ms 178 ms: 1.51x slower
deltablue 4.40 ms 6.97 ms: 1.58x slower
Geometric mean (ref) 1.15x slower

Benchmark hidden because not significant (11): async_tree_io, xml_etree_iterparse, deepcopy, pycparser, html5lib, nqueens, logging_silent, pidigits, async_tree_cpu_io_mixed_tg, regex_v8, subparsers

  • Geometric mean (including insignificant results): 1.123x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.12x
  • 95% likely to have a slowdown of 1.11x
  • 99% likely to have a slowdown of 1.10x

Memory

  • memory change: 1.19x