-
-
Notifications
You must be signed in to change notification settings - Fork 376
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
seperate parameters per command #637
Comments
Thank you for this feature request. We considered this mode of combining parameters ("zip" as opposed to "cross product") back then when we designed the "parameter matrix" feature, see #253 (comment) I argued that it would be a less common use case, but to be honest, I didn't think of your scenario where multiple commands take parameters. I don't think it would be difficult to implement this, but the challenge is to design the command-line interface for this, ideally in a backwards-compatible way. I don't think that adding Another choice could be to have something like a What other choices do we have, assuming we want to implement this? Could we even auto-detect those cases somehow (because nobody wants to run partially related: #575 |
i do think auto-detection makes sense, since adding an option might complicate the interface and as you said, could produce ambiguity. i suggest the following: for every command identify what parameters are unused. in outputs which don't show the parameters, like markdown, this would look exactly like executing the command once. for example with
EDIT: incidentally, detecting unused parameters is also needed for #600 so that synergizes nicely. |
given two distinct commands
cmd1
andcmd2
, which take the parameters A and B respectively (which can have different values).i want to be able to compare the two commands with hyperfine.
without parameters i would do
hyperfine "cmd1 A" "cmd2 B"
but when i add parameters:
hyperfine -L A A_values -L B B_values "cmd1 {A}" "cmd2 {B}"
i get a product of A and B for both commands, meaning that
cmd2
is measured with identical parameters multiple times per value of B.is there a way to only benchmark one instance of each command (after substituting the parameters)?
if not i would like to request that as a feature.
The text was updated successfully, but these errors were encountered: