- fork: python
- ref: ae4788809d674f8e27fa
- machine: linux-x86_64
- commit hash: ae47888
- commit date: 2025-02-02
- overall geometric mean: 1.057x faster
- HPT reliability: 100.00%
- HPT 99th percentile: 1.03x faster
- Memory change: 1.12x
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888 |
|---|---|---|
| docutils | 4.01 sec | 3.79 sec: 1.06x faster |
| html5lib | 92.6 ms | 99.0 ms: 1.07x slower |
| Geometric mean | (ref) | 1.01x slower |
Benchmark hidden because not significant (1): 2to3
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888 |
|---|---|---|
| async_tree_memoization | 709 ms | 455 ms: 1.56x faster |
| async_tree_io_tg | 1.40 sec | 904 ms: 1.55x faster |
| async_tree_memoization_tg | 670 ms | 444 ms: 1.51x faster |
| async_tree_io | 1.39 sec | 940 ms: 1.48x faster |
| async_tree_none | 572 ms | 391 ms: 1.46x faster |
| async_tree_cpu_io_mixed_tg | 852 ms | 669 ms: 1.27x faster |
| async_tree_none_tg | 504 ms | 409 ms: 1.23x faster |
| async_tree_cpu_io_mixed | 889 ms | 724 ms: 1.23x faster |
| async_generators | 567 ms | 527 ms: 1.08x faster |
| Geometric mean | (ref) | 1.29x faster |
Benchmark hidden because not significant (2): asyncio_websockets, coroutines
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888 |
|---|---|---|
| float | 116 ms | 105 ms: 1.11x faster |
| pidigits | 251 ms | 236 ms: 1.06x faster |
| Geometric mean | (ref) | 1.06x faster |
Benchmark hidden because not significant (1): nbody
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888 |
|---|---|---|
| regex_effbot | 4.74 ms | 4.30 ms: 1.10x faster |
| regex_compile | 182 ms | 170 ms: 1.07x faster |
| Geometric mean | (ref) | 1.05x faster |
Benchmark hidden because not significant (2): regex_v8, regex_dna
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888 |
|---|---|---|
| xml_etree_iterparse | 177 ms | 144 ms: 1.23x faster |
| xml_etree_parse | 231 ms | 203 ms: 1.14x faster |
| tomli_loads | 2.78 sec | 2.48 sec: 1.12x faster |
| xml_etree_process | 85.9 ms | 80.4 ms: 1.07x faster |
| unpickle_pure_python | 290 us | 277 us: 1.05x faster |
| json_dumps | 14.1 ms | 15.3 ms: 1.09x slower |
| json_loads | 34.3 us | 39.2 us: 1.14x slower |
| Geometric mean | (ref) | 1.05x faster |
Benchmark hidden because not significant (2): xml_etree_generate, pickle_pure_python
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888 |
|---|---|---|
| python_startup | 22.4 ms | 27.1 ms: 1.21x slower |
| Geometric mean | (ref) | 1.10x slower |
Benchmark hidden because not significant (1): python_startup_no_site
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888 |
|---|---|---|
| mako | 15.9 ms | 17.5 ms: 1.10x slower |
| django_template | 44.3 ms | 51.4 ms: 1.16x slower |
| Geometric mean | (ref) | 1.05x slower |
Benchmark hidden because not significant (2): genshi_xml, genshi_text
| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888 |
|---|---|---|
| async_tree_memoization | 709 ms | 455 ms: 1.56x faster |
| async_tree_io_tg | 1.40 sec | 904 ms: 1.55x faster |
| async_tree_memoization_tg | 670 ms | 444 ms: 1.51x faster |
| async_tree_io | 1.39 sec | 940 ms: 1.48x faster |
| async_tree_none | 572 ms | 391 ms: 1.46x faster |
| deepcopy | 498 us | 384 us: 1.30x faster |
| async_tree_cpu_io_mixed_tg | 852 ms | 669 ms: 1.27x faster |
| telco | 12.2 ms | 9.64 ms: 1.26x faster |
| xml_etree_iterparse | 177 ms | 144 ms: 1.23x faster |
| pylint | 470 ms | 382 ms: 1.23x faster |
| async_tree_none_tg | 504 ms | 409 ms: 1.23x faster |
| async_tree_cpu_io_mixed | 889 ms | 724 ms: 1.23x faster |
| go | 191 ms | 159 ms: 1.20x faster |
| scimark_sparse_mat_mult | 6.76 ms | 5.83 ms: 1.16x faster |
| richards | 65.5 ms | 56.6 ms: 1.16x faster |
| spectral_norm | 157 ms | 136 ms: 1.15x faster |
| xml_etree_parse | 231 ms | 203 ms: 1.14x faster |
| deepcopy_memo | 50.1 us | 44.2 us: 1.13x faster |
| tomli_loads | 2.78 sec | 2.48 sec: 1.12x faster |
| deepcopy_reduce | 4.10 us | 3.65 us: 1.12x faster |
| chaos | 83.6 ms | 75.4 ms: 1.11x faster |
| float | 116 ms | 105 ms: 1.11x faster |
| regex_effbot | 4.74 ms | 4.30 ms: 1.10x faster |
| sympy_sum | 210 ms | 193 ms: 1.09x faster |
| scimark_sor | 179 ms | 164 ms: 1.09x faster |
| sympy_integrate | 30.2 ms | 27.8 ms: 1.09x faster |
| pyflate | 664 ms | 610 ms: 1.09x faster |
| bpe_tokeniser | 6.28 sec | 5.79 sec: 1.08x faster |
| mdp | 3.80 sec | 3.52 sec: 1.08x faster |
| async_generators | 567 ms | 527 ms: 1.08x faster |
| thrift | 1.10 ms | 1.03 ms: 1.07x faster |
| regex_compile | 182 ms | 170 ms: 1.07x faster |
| xml_etree_process | 85.9 ms | 80.4 ms: 1.07x faster |
| fannkuch | 547 ms | 513 ms: 1.07x faster |
| sympy_str | 379 ms | 356 ms: 1.07x faster |
| pidigits | 251 ms | 236 ms: 1.06x faster |
| scimark_fft | 473 ms | 447 ms: 1.06x faster |
| docutils | 4.01 sec | 3.79 sec: 1.06x faster |
| sympy_expand | 601 ms | 568 ms: 1.06x faster |
| typing_runtime_protocols | 226 us | 214 us: 1.05x faster |
| unpickle_pure_python | 290 us | 277 us: 1.05x faster |
| pprint_pformat | 1.94 sec | 1.86 sec: 1.05x faster |
| sqlite_synth | 3.99 us | 3.82 us: 1.04x faster |
| pycparser | 1.57 sec | 1.52 sec: 1.03x faster |
| nqueens | 112 ms | 119 ms: 1.06x slower |
| html5lib | 92.6 ms | 99.0 ms: 1.07x slower |
| hexiom | 8.11 ms | 8.72 ms: 1.08x slower |
| json_dumps | 14.1 ms | 15.3 ms: 1.09x slower |
| json | 6.51 ms | 7.11 ms: 1.09x slower |
| mako | 15.9 ms | 17.5 ms: 1.10x slower |
| coverage | 107 ms | 119 ms: 1.11x slower |
| logging_silent | 130 ns | 148 ns: 1.13x slower |
| json_loads | 34.3 us | 39.2 us: 1.14x slower |
| bench_thread_pool | 2.89 ms | 3.30 ms: 1.14x slower |
| django_template | 44.3 ms | 51.4 ms: 1.16x slower |
| python_startup | 22.4 ms | 27.1 ms: 1.21x slower |
| gc_traversal | 5.70 ms | 8.59 ms: 1.51x slower |
| create_gc_cycles | 2.41 ms | 3.78 ms: 1.57x slower |
| bench_mp_pool | 18.7 ms | 92.9 ms: 4.97x slower |
| Geometric mean | (ref) | 1.03x faster |
Benchmark hidden because not significant (29): logging_format, pathlib, xml_etree_generate, genshi_xml, asyncio_websockets, pickle_pure_python, pprint_safe_repr, richards_super, comprehensions, genshi_text, sqlglot_transpile, scimark_monte_carlo, nbody, deltablue, regex_v8, crypto_pyaes, meteor_contest, regex_dna, generators, python_startup_no_site, sqlglot_optimize, sqlglot_normalize, coroutines, raytrace, scimark_lu, 2to3, dulwich_log, sqlglot_parse, logging_simple Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (8) of results/bm-20250202-3.14.0a4+-ae47888/bm-20250202-linux-x86_64-python-ae4788809d674f8e27fa-3.14.0a4+-ae47888.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers
- Geometric mean (including insignificant results): 1.057x faster
- Reliability score: 100.00% likely to be faster
- 90% likely to have a speedup of 1.05x
- 95% likely to have a speedup of 1.04x
- 99% likely to have a speedup of 1.03x
- memory change: 1.12x