You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We would like to add a summary table breaking down the benchmarks into the number we have from each model and categories from the metadata. For example, here is what we had in the Q3 slides:
The idea is to calculate this info automatically from results/metadata.yaml and generate this table in the Benchmark details dashboard.
Some suggestions:
Again, we don't have a design for this, so please prototype it by quickly adding this new summary table above the filters and existing table of benchmarks, and we can test it and then design it appropriately
This summary table should not be affected by the filters -- it is a summary of the entire benchmark set
@danielelerede-oet please can you support Jacek with any questions he might have on how to generate the table, and if you want to add/remove any info from it?
Daniele, could you also suggest any graphs/plots we can make to summarize benchmarks? E.g. we could have a bar chart breaking down the number of benchmark instances from each model framework, or by size category. Thank you both!
The text was updated successfully, but these errors were encountered:
We would like to add a summary table breaking down the benchmarks into the number we have from each model and categories from the metadata. For example, here is what we had in the Q3 slides:
The idea is to calculate this info automatically from
results/metadata.yaml
and generate this table in theBenchmark details
dashboard.Some suggestions:
The text was updated successfully, but these errors were encountered: