Skip to content

Commit accf551

Browse files
Update small_grants.md: Add 2 new benchmark sets and Param completion
This PR certifies the completion of the two bnechmark sets by @ParamThakkar123 with the following PRs: * SciML/SciMLBenchmarks.jl#1148 * SciML/SciMLBenchmarks.jl#1160 * SciML/SciMLBenchmarks.jl#1159 It also adds two new benchmark sets that are in dire need of updates. As a monetary decision, requires 3 approvals. I approve.
1 parent 574346f commit accf551

File tree

1 file changed

+61
-17
lines changed

1 file changed

+61
-17
lines changed

small_grants.md

Lines changed: 61 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -230,24 +230,17 @@ is to start the update process, bump the project and manifest tomls, and start d
230230

231231
These bumps are done in subsets. The currently identified subsets are:
232232

233-
#### ParameterEstimation
233+
#### BayesianInference
234234

235-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/799](https://github.com/SciML/SciMLBenchmarks.jl/pull/799)
236-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1063](https://github.com/SciML/SciMLBenchmarks.jl/pull/1063)
237-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1064](https://github.com/SciML/SciMLBenchmarks.jl/pull/1064)
238-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1065](https://github.com/SciML/SciMLBenchmarks.jl/pull/1065)
235+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1182](https://github.com/SciML/SciMLBenchmarks.jl/pull/1182)
236+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1106](https://github.com/SciML/SciMLBenchmarks.jl/pull/1106)
237+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1105](https://github.com/SciML/SciMLBenchmarks.jl/pull/1105)
239238

240-
#### PINNs
239+
#### AutomaticDifferentiationSparse
241240

242-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1062](https://github.com/SciML/SciMLBenchmarks.jl/pull/1062)
243-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1061](https://github.com/SciML/SciMLBenchmarks.jl/pull/1061)
244-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1044](https://github.com/SciML/SciMLBenchmarks.jl/pull/1044)
245-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/877](https://github.com/SciML/SciMLBenchmarks.jl/pull/877)
246-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1060](https://github.com/SciML/SciMLBenchmarks.jl/pull/1060)
247-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1059](https://github.com/SciML/SciMLBenchmarks.jl/pull/1059)
248-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1043](https://github.com/SciML/SciMLBenchmarks.jl/pull/1043)
249-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/876](https://github.com/SciML/SciMLBenchmarks.jl/pull/876)
250-
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/605](https://github.com/SciML/SciMLBenchmarks.jl/pull/605)
241+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1023](https://github.com/SciML/SciMLBenchmarks.jl/pull/1023)
242+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1033](https://github.com/SciML/SciMLBenchmarks.jl/pull/1033)
243+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1069](https://github.com/SciML/SciMLBenchmarks.jl/pull/1069)
251244

252245
**Information to Get Started**: The
253246
[Contributing Section of the SciMLBenchmarks README](https://github.com/SciML/SciMLBenchmarks.jl?tab=readme-ov-file#contributing)
@@ -421,15 +414,19 @@ which SciML will help administer through the small grants program.
421414

422415
**Reviewers**: Chris Elrod
423416

417+
418+
424419
# Successful Projects Archive
425420

421+
422+
426423
These are the previous SciML small grants projects which have successfully concluded and payed out.
427424

428425
## Refactor OrdinaryDiffEq.jl to use Sub-Packages of Solvers (\$600)
429426

430427
#### Note: Bounty increase to \$600 from \$300 (7/20/2024)
431428

432-
**In Progress**: Claimed by Param Umesh Thakkar for the time period of June 18th, 2024 - August 18th 2024. Extended due to scope and cost extension.
429+
** Completed by Param Umesh Thakkar for the time period of June 18th, 2024 - August 18th 2024. Extended due to scope and cost extension. **
433430

434431
It's no surprise to anyone to hear that DifferentialEquations.jl, in particular the
435432
OrdinaryDiffEq.jl solver package, is very large and takes a long time to precompile.
@@ -459,6 +456,53 @@ development skills and test-driven development of a large code base is required.
459456

460457
## DAE Problem Benchmarks (\$100 / Benchmark)
461458

462-
**In Progress**: Completed by Marko Polic in the time period of June 18th, 2024 - July 18th 2024.
459+
**Completed by Marko Polic in the time period of June 18th, 2024 - July 18th 2024.**
463460
The transistor amplifier benchmark was added [https://github.com/SciML/SciMLBenchmarks.jl/pull/1007](https://github.com/SciML/SciMLBenchmarks.jl/pull/1007).
464461
Project is kept open for other benchmarks.
462+
463+
## SciMLBenchmarks Compatability Bump for Benchmark Sets (\100 each set)
464+
465+
**Completed by Param Umesh Thakkar for the time period of January 21st - February 21st. Extended from February 21st to March 21st. Extended due to the project's complexity and final refinements. **
466+
467+
The [SciMLBenchmarks](https://github.com/SciML/SciMLBenchmarks.jl) are a large set of benchmarks maintained
468+
by the SciML organization. As such, keeping these benchmarks up-to-date can be a time-consuming task.
469+
In many cases, we can end up in a situation where there are many package bumps that need to happen. Sometimes
470+
no code needs to be updated, in other cases the benchmark code does need to be updated. The only way to tell
471+
is to start the update process, bump the project and manifest tomls, and start digging into the results.
472+
473+
These bumps are done in subsets. The currently identified subsets are:
474+
475+
#### ParameterEstimation
476+
477+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/799](https://github.com/SciML/SciMLBenchmarks.jl/pull/799)
478+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1063](https://github.com/SciML/SciMLBenchmarks.jl/pull/1063)
479+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1064](https://github.com/SciML/SciMLBenchmarks.jl/pull/1064)
480+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1065](https://github.com/SciML/SciMLBenchmarks.jl/pull/1065)
481+
482+
#### PINNs
483+
484+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1062](https://github.com/SciML/SciMLBenchmarks.jl/pull/1062)
485+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1061](https://github.com/SciML/SciMLBenchmarks.jl/pull/1061)
486+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1044](https://github.com/SciML/SciMLBenchmarks.jl/pull/1044)
487+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/877](https://github.com/SciML/SciMLBenchmarks.jl/pull/877)
488+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1060](https://github.com/SciML/SciMLBenchmarks.jl/pull/1060)
489+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1059](https://github.com/SciML/SciMLBenchmarks.jl/pull/1059)
490+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/1043](https://github.com/SciML/SciMLBenchmarks.jl/pull/1043)
491+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/876](https://github.com/SciML/SciMLBenchmarks.jl/pull/876)
492+
* [https://github.com/SciML/SciMLBenchmarks.jl/pull/605](https://github.com/SciML/SciMLBenchmarks.jl/pull/605)
493+
494+
**Information to Get Started**: The
495+
[Contributing Section of the SciMLBenchmarks README](https://github.com/SciML/SciMLBenchmarks.jl?tab=readme-ov-file#contributing)
496+
describes how to contribute to the benchmarks. The benchmark results are
497+
generated using the benchmark server. It is expected that the developer checks that the benchmarks
498+
are appropriately ran and generating correct graphs when updated, and highlight any performance
499+
regressions found through the update process.
500+
501+
**Related Issues**: See the linked pull requests.
502+
503+
**Success Criteria**: The benchmarks should run and give similar results to the pre-updated benchmarks,
504+
and any regressions should be identified with an issue opened in the appropriate repository.
505+
506+
**Recommended Skills**: Willingness to roll up some sleaves and figure out what changed in breaking updates.
507+
508+
**Reviewers**: Chris Rackauckas

0 commit comments

Comments
 (0)