Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmark summary table from slides (or nice graphs) #119

Open
Tracked by #95
siddharth-krishna opened this issue Feb 25, 2025 · 1 comment
Open
Tracked by #95

Benchmark summary table from slides (or nice graphs) #119

siddharth-krishna opened this issue Feb 25, 2025 · 1 comment
Assignees

Comments

@siddharth-krishna
Copy link
Contributor

siddharth-krishna commented Feb 25, 2025

We would like to add a summary table breaking down the benchmarks into the number we have from each model and categories from the metadata. For example, here is what we had in the Q3 slides:

Image

The idea is to calculate this info automatically from results/metadata.yaml and generate this table in the Benchmark details dashboard.

Some suggestions:

  • Again, we don't have a design for this, so please prototype it by quickly adding this new summary table above the filters and existing table of benchmarks, and we can test it and then design it appropriately
  • This summary table should not be affected by the filters -- it is a summary of the entire benchmark set
  • @danielelerede-oet please can you support Jacek with any questions he might have on how to generate the table, and if you want to add/remove any info from it?
  • Daniele, could you also suggest any graphs/plots we can make to summarize benchmarks? E.g. we could have a bar chart breaking down the number of benchmark instances from each model framework, or by size category. Thank you both!
@jacek-oet
Copy link
Collaborator

Question 1:
N. of problems

Image

Eg: for info about N. of problems of PyPSA

  • Total n. of different problems: Is this the count of problems in the PyPSA model?
  • Multiple size instances: Is this the total size of the problem in the PyPSA model?

Question 2:
Time horizon

Image

Do "single stage" and "single period" refer to a "single-period" or a "multi-period"?
Also, what does "N/A" mean?

Question 3:
Size

Image

What does Size Real(MILP) mean?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants