Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about hyperfine benchmark results #665

Open
Pavel-Durov opened this issue Jul 13, 2023 · 3 comments
Open

Question about hyperfine benchmark results #665

Pavel-Durov opened this issue Jul 13, 2023 · 3 comments

Comments

@Pavel-Durov
Copy link

I was looking at hyperfine documentation but I couldn't find anything related to the the output format.

How do I read hyperfine benchmark results?

Example:

  Time (mean ± σ):      14.9 ms ±   0.7 ms    [User: 12.5 ms, System: 2.3 ms]
  Range (min … max):    14.0 ms …  21.3 ms    187 runs

min .. max - minimum and maximum running times
User - time spent in user space, amount of time spent on the program itself
System - time spent in system space, amount of time spent on OS functions related to the program
runs - total count of benchmark runs

What's mean ± σ? Standard deviation?

@Pavel-Durov
Copy link
Author

The way I interpret it:

mean - is the average execution time of the benchmarks
± σ - is the standard deviation representing the amount of variation from the mean

Is it somehow correct?

@sharkdp
Copy link
Owner

sharkdp commented Jul 15, 2023

Please see #443

@sharkdp
Copy link
Owner

sharkdp commented Jul 23, 2023

@Pavel-Durov does this help?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants