Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmarks: more "real" and MILP benchmarks for Q3 #92

Open
siddharth-krishna opened this issue Feb 3, 2025 · 0 comments
Open

Benchmarks: more "real" and MILP benchmarks for Q3 #92

siddharth-krishna opened this issue Feb 3, 2025 · 0 comments
Assignees

Comments

@siddharth-krishna
Copy link
Contributor

siddharth-krishna commented Feb 3, 2025

We're adding new benchmarks from the following energy models:

For each new benchmark, let's ensure that we add:

  • Metadata to benchmarks/<model-framework>/metadata.yaml
  • The LP/MPS file to GCP buckets
  • The GCP URL, name, and size to benchmarks/benchmark_config.yaml the metadata file
  • Run python benchmarks/merge_metadata.py before opening a PR to ensure metadata is synced
  • If possible, the configuration file and instructions on how to generate the benchmark to benchmarks/<model-framework>/. Large data files should not be checked into this repo, but hosted on another site and the URLs can be added to the benchmark generation instructions instead.
  • Let's also try to maintain the convention that benchmark names are prefixed with the model framework's name, e.g. pyspa-... or temoa-...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants