Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: benchmark #153

Closed
wants to merge 30 commits into from
Closed

ci: benchmark #153

wants to merge 30 commits into from

Conversation

d-roak
Copy link
Contributor

@d-roak d-roak commented Sep 10, 2024

No description provided.

@d-roak d-roak marked this pull request as draft September 10, 2024 07:04
Copy link

[email protected] bench /home/runner/work/ts-topology/ts-topology
vitest bench "--outputJson" "benchmark.json"

�[7m�[1m�[36m RUN �[39m�[22m�[27m �[36mv2.0.5�[39m �[90m/home/runner/work/ts-topology/ts-topology�[39m

�[32m✓�[39m packages/object/bench/causallyrelated.bench.ts�[2m > �[22mAreCausallyDependent benchmark�[33m 1379�[2mms�[22m�[39m
�[1mname �[22m �[1m hz�[22m �[1m min�[22m �[1m max�[22m �[1m mean�[22m �[1m p75�[22m �[1m p99�[22m �[1m p995�[22m �[1m p999�[22m �[1m rme�[22m �[1msamples�[22m
�[32m·�[39m Causality check using BFS �[34m26.1260�[39m �[36m38.0065�[39m �[36m38.8091�[39m �[36m38.2761�[39m �[36m38.3110�[39m �[36m38.8091�[39m �[36m38.8091�[39m �[36m38.8091�[39m �[2m±0.32%�[22m �[2m 14�[22m
�[32m·�[39m Causality check using Bitsets �[34m 202.93�[39m �[36m 4.9005�[39m �[36m 5.0265�[39m �[36m 4.9279�[39m �[36m 4.9373�[39m �[36m 4.9948�[39m �[36m 5.0265�[39m �[36m 5.0265�[39m �[2m±0.08%�[22m �[2m 102�[22m �[1m�[32m fastest�[39m�[22m

�[36m�[7m�[1m BENCH �[22m�[27m�[39m �[36mSummary�[39m

Causality check using Bitsets�[2m - packages/object/bench/causallyrelated.bench.ts�[2m > �[22m�[2mAreCausallyDependent benchmark�[22m
�[32m7.77x�[39m �[90mfaster than�[39m Causality check using BFS

Benchmark report written to /home/runner/work/ts-topology/ts-topology/benchmark.json

Copy link

${process.env.BENCHMARK_RESULT}

Copy link

[email protected] bench /home/runner/work/ts-topology/ts-topology
vitest bench "--run" "--outputJson" "benchmark.json"

�[7m�[1m�[36m RUN �[39m�[22m�[27m �[36mv2.0.5�[39m �[90m/home/runner/work/ts-topology/ts-topology�[39m

�[32m✓�[39m packages/object/bench/causallyrelated.bench.ts�[2m > �[22mAreCausallyDependent benchmark�[33m 1364�[2mms�[22m�[39m
�[1mname �[22m �[1m hz�[22m �[1m min�[22m �[1m max�[22m �[1m mean�[22m �[1m p75�[22m �[1m p99�[22m �[1m p995�[22m �[1m p999�[22m �[1m rme�[22m �[1msamples�[22m
�[32m·�[39m Causality check using BFS �[34m26.9144�[39m �[36m36.9839�[39m �[36m37.4351�[39m �[36m37.1548�[39m �[36m37.2258�[39m �[36m37.4351�[39m �[36m37.4351�[39m �[36m37.4351�[39m �[2m±0.20%�[22m �[2m 14�[22m
�[32m·�[39m Causality check using Bitsets �[34m 163.05�[39m �[36m 6.0825�[39m �[36m 6.8152�[39m �[36m 6.1330�[39m �[36m 6.1293�[39m �[36m 6.8152�[39m �[36m 6.8152�[39m �[36m 6.8152�[39m �[2m±0.34%�[22m �[2m 82�[22m �[1m�[32m fastest�[39m�[22m

�[36m�[7m�[1m BENCH �[22m�[27m�[39m �[36mSummary�[39m

Causality check using Bitsets�[2m - packages/object/bench/causallyrelated.bench.ts�[2m > �[22m�[2mAreCausallyDependent benchmark�[22m
�[32m6.06x�[39m �[90mfaster than�[39m Causality check using BFS

Benchmark report written to /home/runner/work/ts-topology/ts-topology/benchmark.json

Copy link

[email protected] bench /home/runner/work/ts-topology/ts-topology
vitest bench "--run" "--outputJson" "benchmark.json"

RUN v2.0.5 /home/runner/work/ts-topology/ts-topology

✓ packages/object/bench/causallyrelated.bench.ts > AreCausallyDependent benchmark 1363ms
name hz min max mean p75 p99 p995 p999 rme samples
· Causality check using BFS 26.8848 36.8977 37.7355 37.1958 37.3091 37.7355 37.7355 37.7355 ±0.36% 14
· Causality check using Bitsets 195.02 5.1048 5.2337 5.1276 5.1346 5.2337 5.2337 5.2337 ±0.09% 98 fastest

BENCH Summary

Causality check using Bitsets - packages/object/bench/causallyrelated.bench.ts > AreCausallyDependent benchmark
7.25x faster than Causality check using BFS

Benchmark report written to /home/runner/work/ts-topology/ts-topology/benchmark.json

Copy link

[email protected] bench /home/runner/work/ts-topology/ts-topology
vitest bench "--run" "--outputJson" "benchmark.json"

�[7m�[1m�[36m RUN �[39m�[22m�[27m �[36mv2.0.5�[39m �[90m/home/runner/work/ts-topology/ts-topology�[39m

�[32m✓�[39m packages/object/bench/causallyrelated.bench.ts�[2m > �[22mAreCausallyDependent benchmark�[33m 1358�[2mms�[22m�[39m
�[1mname �[22m �[1m hz�[22m �[1m min�[22m �[1m max�[22m �[1m mean�[22m �[1m p75�[22m �[1m p99�[22m �[1m p995�[22m �[1m p999�[22m �[1m rme�[22m �[1msamples�[22m
�[32m·�[39m Causality check using BFS �[34m25.9985�[39m �[36m38.2315�[39m �[36m39.1389�[39m �[36m38.4637�[39m �[36m38.5549�[39m �[36m39.1389�[39m �[36m39.1389�[39m �[36m39.1389�[39m �[2m±0.38%�[22m �[2m 13�[22m
�[32m·�[39m Causality check using Bitsets �[34m 155.66�[39m �[36m 6.3894�[39m �[36m 6.5381�[39m �[36m 6.4243�[39m �[36m 6.4373�[39m �[36m 6.5381�[39m �[36m 6.5381�[39m �[36m 6.5381�[39m �[2m±0.10%�[22m �[2m 78�[22m �[1m�[32m fastest�[39m�[22m

�[36m�[7m�[1m BENCH �[22m�[27m�[39m �[36mSummary�[39m

Causality check using Bitsets�[2m - packages/object/bench/causallyrelated.bench.ts�[2m > �[22m�[2mAreCausallyDependent benchmark�[22m
�[32m5.99x�[39m �[90mfaster than�[39m Causality check using BFS

Benchmark report written to /home/runner/work/ts-topology/ts-topology/benchmark.json

@d-roak d-roak closed this Sep 11, 2024
@d-roak d-roak deleted the ci/bench branch September 11, 2024 15:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant