Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf: add script loading benchmark #411

Merged
merged 2 commits into from
Apr 6, 2025
Merged

Conversation

makspll
Copy link
Owner

@makspll makspll commented Apr 6, 2025

Summary

Adds benchmarks for the CreateOrUpdate script loading command.
The benchmarks run 50% updates to 50% initial loads ratios

Copy link
Contributor

github-actions bot commented Apr 6, 2025

🐰 Bencher Report

Branchperf/add-loading-benchmark
Testbedlinux-gha
Click to view all benchmark results
BenchmarkLatencyBenchmark Result
nanoseconds (ns)
(Result Δ%)
Upper Boundary
nanoseconds (ns)
(Limit %)
component/access Lua📈 view plot
🚷 view threshold
3,380.30 ns
(-30.73%)Baseline: 4,880.06 ns
6,382.25 ns
(52.96%)
component/access Rhai📈 view plot
🚷 view threshold
5,809.00 ns
(-13.86%)Baseline: 6,743.96 ns
8,019.98 ns
(72.43%)
component/get Lua📈 view plot
🚷 view threshold
2,043.50 ns
(-28.75%)Baseline: 2,868.10 ns
3,591.76 ns
(56.89%)
component/get Rhai📈 view plot
🚷 view threshold
4,596.70 ns
(-6.97%)Baseline: 4,940.88 ns
6,001.89 ns
(76.59%)
conversions/Mut::from📈 view plot
🚷 view threshold
76.89 ns
(-42.92%)Baseline: 134.71 ns
245.48 ns
(31.32%)
conversions/Ref::from📈 view plot
🚷 view threshold
76.60 ns
(-42.22%)Baseline: 132.56 ns
243.11 ns
(31.51%)
conversions/ScriptValue::List📈 view plot
🚷 view threshold
264.95 ns
(-57.10%)Baseline: 617.62 ns
1,112.99 ns
(23.81%)
conversions/ScriptValue::Map📈 view plot
🚷 view threshold
1,172.70 ns
(-28.80%)Baseline: 1,647.00 ns
2,221.94 ns
(52.78%)
conversions/ScriptValue::Reference::from_into📈 view plot
🚷 view threshold
24.67 ns
(-40.29%)Baseline: 41.32 ns
60.37 ns
(40.87%)
conversions/Val::from_into📈 view plot
🚷 view threshold
227.68 ns
(-32.83%)Baseline: 338.96 ns
459.34 ns
(49.57%)
function/call 4 args Lua📈 view plot
🚷 view threshold
1,587.10 ns
(-24.04%)Baseline: 2,089.29 ns
2,521.75 ns
(62.94%)
function/call 4 args Rhai📈 view plot
🚷 view threshold
1,370.20 ns
(-24.22%)Baseline: 1,808.17 ns
2,223.78 ns
(61.62%)
function/call Lua📈 view plot
🚷 view threshold
223.54 ns
(-19.93%)Baseline: 279.17 ns
336.52 ns
(66.43%)
function/call Rhai📈 view plot
🚷 view threshold
442.01 ns
(-16.24%)Baseline: 527.72 ns
663.64 ns
(66.60%)
loading/empty Lua📈 view plot
🚷 view threshold
91,041.00 ns
loading/empty Rhai📈 view plot
🚷 view threshold
1,178,500.00 ns
math/vec mat ops Lua📈 view plot
🚷 view threshold
6,891.20 ns
(-11.61%)Baseline: 7,796.49 ns
9,161.37 ns
(75.22%)
math/vec mat ops Rhai📈 view plot
🚷 view threshold
6,112.40 ns
(-17.86%)Baseline: 7,441.83 ns
8,576.46 ns
(71.27%)
query/10 entities Lua📈 view plot
🚷 view threshold
17,349.00 ns
(-29.39%)Baseline: 24,570.77 ns
30,861.42 ns
(56.22%)
query/10 entities Rhai📈 view plot
🚷 view threshold
20,157.00 ns
(-17.08%)Baseline: 24,308.97 ns
28,730.53 ns
(70.16%)
query/100 entities Lua📈 view plot
🚷 view threshold
38,938.00 ns
(-21.85%)Baseline: 49,824.69 ns
61,273.86 ns
(63.55%)
query/100 entities Rhai📈 view plot
🚷 view threshold
32,861.00 ns
(-15.97%)Baseline: 39,108.54 ns
47,689.47 ns
(68.91%)
query/1000 entities Lua📈 view plot
🚷 view threshold
261,110.00 ns
(-16.64%)Baseline: 313,235.43 ns
383,943.85 ns
(68.01%)
query/1000 entities Rhai📈 view plot
🚷 view threshold
164,170.00 ns
(-25.26%)Baseline: 219,649.43 ns
298,835.18 ns
(54.94%)
reflection/10 Lua📈 view plot
🚷 view threshold
5,497.80 ns
(-16.07%)Baseline: 6,550.54 ns
7,562.46 ns
(72.70%)
reflection/10 Rhai📈 view plot
🚷 view threshold
14,648.00 ns
(-10.75%)Baseline: 16,412.60 ns
18,052.47 ns
(81.14%)
reflection/100 Lua📈 view plot
🚷 view threshold
48,472.00 ns
(-9.54%)Baseline: 53,582.03 ns
60,204.97 ns
(80.51%)
reflection/100 Rhai📈 view plot
🚷 view threshold
639,540.00 ns
(-13.26%)Baseline: 737,347.71 ns
876,096.57 ns
(73.00%)
resource/access Lua📈 view plot
🚷 view threshold
3,027.50 ns
(-29.51%)Baseline: 4,294.73 ns
5,543.94 ns
(54.61%)
resource/access Rhai📈 view plot
🚷 view threshold
5,192.90 ns
(-13.85%)Baseline: 6,027.86 ns
7,433.90 ns
(69.85%)
resource/get Lua📈 view plot
🚷 view threshold
1,691.60 ns
(-29.20%)Baseline: 2,389.27 ns
3,031.83 ns
(55.79%)
resource/get Rhai📈 view plot
🚷 view threshold
3,988.10 ns
(-6.93%)Baseline: 4,285.24 ns
5,318.74 ns
(74.98%)
🐰 View full continuous benchmarking report in Bencher

@makspll makspll merged commit dbb1c49 into main Apr 6, 2025
6 checks passed
@makspll makspll deleted the perf/add-loading-benchmark branch April 6, 2025 13:24
@github-actions github-actions bot mentioned this pull request Apr 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant