Developing a system for benchmarking

[TomDonoghue]

There has been some discussion of developing more of a consistent setup / approach for profiling the module / models, and using this as we go forward.

Recent optimizations (#299) spurred this discussion including the following comment (to keep in mind) about further work on benchmarking: #299 (comment)

For some basic record keeping, in terms of model fitting, we currently spend basically all of our time in curve_fit, with there not being much obvious opportunity to speed things up beyond what was already done in #299. See this comment (#299 (comment)) for some comments on potentially exploring different fitting approaches.

In terms of some basic / benchmarking sims / tests, there are some starting points:

• from Ryan: https://github.com/ryanhammonds/specparam-rs/blob/master/examples/01_performance_test.ipynb
• from Tom: https://gist.github.com/TomDonoghue/44d09697fe6b7f9a5b2eadf5fb695148

I think the general idea would be to develop anything like this with or after the 2.0 release - so for now we can use this issue for any further discussion, and keep this in mind as we move towards 2.0 and beyond.