[OLD] M3SA - Multi-Meta-Model Simulation Analyzer #240

Rq1 multi model

…ent window size - time to generate analysis (description + implementation)

…ement-and-experiments #7 feat opendc analyze enhancement and experiments

…ation files can be found on the branch dedicated for experiments

…lotted individually and in the same plot

…d 1000, plotted individually and in the same plot

…oved in their own folder

# Conflicts: # .gitignore # experiments/experiment-1-window-visual-analysis/inputs/carbon_intensity.parquet # experiments/experiment-1-window-visual-analysis/inputs/scenario.json # experiments/experiment-1-window-visual-analysis/inputs/surf-lisa/trace/carbon_2022.parquet # experiments/experiment-1-window-visual-analysis/inputs/surf-lisa/trace/energy.parquet # experiments/experiment-1-window-visual-analysis/inputs/surf-lisa/trace/meta.parquet # experiments/experiment-1-window-visual-analysis/inputs/surf-lisa/trace/readme.txt # experiments/experiment-1-window-visual-analysis/inputs/surf-lisa/trace/server.parquet # experiments/experiment-1-window-visual-analysis/inputs/surf-lisa/trace/trace.parquet # experiments/experiment-1-window-visual-analysis/inputs/topologies/topology_sqrt.json # experiments/experiment-1-window-visual-analysis/outputs/window_size_comparison_same_plot/raw-output/0/seed=0/host.parquet # experiments/experiment-1-window-visual-analysis/outputs/window_size_comparison_same_plot/simulation-analysis/in_paper_plots/all_models_by_window_horizontal.pdf # experiments/experiment-1-window-visual-analysis/outputs/window_size_comparison_same_plot/simulation-analysis/in_paper_plots/window=1.pdf # experiments/experiment-1-window-visual-analysis/outputs/window_size_comparison_same_plot/simulation-analysis/in_paper_plots/window=10.pdf # experiments/experiment-1-window-visual-analysis/outputs/window_size_comparison_same_plot/simulation-analysis/in_paper_plots/window=100.pdf # experiments/experiment-1-window-visual-analysis/outputs/window_size_comparison_same_plot/simulation-analysis/in_paper_plots/window=1000.pdf # experiments/experiment-1-window-visual-analysis/outputs/window_size_comparison_same_plot/simulation-analysis/power_draw/analysis.txt # experiments/experiment-1-window-visual-analysis/outputs/window_size_comparison_same_plot/simulation-analysis/power_draw/pdf/window=1000.pdf # experiments/experiment-1-window-visual-analysis/outputs/window_size_comparison_same_plot/trackr.json # opendc-analyze/src/main/python/experiments/window_size_time_analysis.py # resources/bitbrains-small/interference-model.json # resources/bitbrains-small/readme.txt # resources/bitbrains-small/trace/carbon_2012.parquet # resources/bitbrains-small/trace/meta.parquet # resources/bitbrains-small/trace/trace.parquet # resources/carbon_intensity.parquet # resources/surf-lisa/trace/carbon_2022.parquet # resources/surf-lisa/trace/energy.parquet # resources/surf-lisa/trace/meta.parquet # resources/surf-lisa/trace/readme.txt # resources/surf-lisa/trace/server.parquet # resources/surf-lisa/trace/trace.parquet # resources/surf-sara/surf-sara-scenario.json # resources/surf-sara/trace/energy.parquet # resources/surf-sara/trace/meta.parquet # resources/surf-sara/trace/trace.parquet

… interface

…for outputFolderPath, one for multiModelSetup

…ing, it works

…mentation

…long side its main functionalities

…itted (larger than 100mb limit)

…es and cumulative plots

# Conflicts: # opendc-analyze/src/main/python/main.py # opendc-analyze/src/main/python/models/MultiModel.py

…ut, window accuracy was improved, useless content deleted

…r Multi-Model plots refined; demo for the Multi-Model

…updated, efficiency improved

…ltiple types of plots, many plots + multimodel towards the end of iteration 2

Multi model iteration 2

initialization, computation with only one function (mean), multi-model appending and linking, plotting tested (and works) fot time series graph yet

…ature and allow meta-model to function

…tion of the MVP is complete

3 functions handled, integrated with multimodel, able to plot all the types of graphs the multimodel plots, the code is in a relatively good shape, still requires documentation. up next: iteration 2!

14 meta model mvp

(feat) experiment 5, accuracy, currently setting up

future elements: have a better output, save into a file, with specific details per model / metamodel

+ some accuracy analysis for individual models, metamodel with mean, and metamodel with median

…an (still searching)

16 meta model iteration 2

…mputation made."

…icks can now be selected by the user; metamodel more proeminent in the plots

16 meta model iteration 2

16 meta model iteration 2 + RQ1 & RQ2 experiments

16 meta model iteration 2

Updating universality branch with local-master minor updates

…tiModel also handles seed every variable name containing the word host, and the corresponding documentation, we rename to "sim" (simulation). for example raw-host-data -> raw-sim-data. Also, the Multi-Model now handles the seed, which can be given by user, or is 0 by default.

…or testing

this "feature" does not limit anymore the multimodel to "only" 100 models (hence clashing when the id increases to 100)

21 universality and integration

M3SA - the short of Multi-Meta-Model Simulation Analysis

21 universality and integration

M3SA - the short of Multi-Meta-Model Simulation Analysis

(feat) new branding - Multi-Meta-Model is now "M3SA"

27 m3sa usability evaluation

(fix) removed unused files

downlaoding dependencies for the website may take more time than initially allowed

… CI.

* metamodel & multimodel integrated in the failure branch * untracked demo * .gitignore updated to untrack demo * code improved towards better readability * metamodel functional for scenarios with the same configurations * docstring added * code structure improved * demo folder moved in opendc/demo * an unnecessarily commed removed from Radu's tests * demo removed (temporarily) from gitignore * demo files added to git * towards a margin-of-error-capable Multi-Model * [RQ1] simulation data; RQ1 first draft finished * Multi-Model and Meta-Model are now clean * expriment folder setup, Experiment 1 update, add in a folder, Experiment window size - time to generate analysis (description + implementation) * expriment folder setup, Experiment 1 update, add in a folder, Experiment window size - time to generate analysis (description + implementation) * use case experiment 1 results * use case experiment 1 - code base * multimodel now handles cpu_utilization and outputs statistics * rq1 multi-model analysis by window_size, experiments and plots * gitignore updated to ignore the experiment-related files - experimentation files can be found on the branch dedicated for experiments * gitignore updated to ignore the experiment-related files - experimentation files can be found on the branch dedicated for experiments * experiment 1 data, windows analyed by size of 1, 10, 100, and 1000, plotted individually and in the same plot * experiment 1 functionality, windows analyed by size of 1, 10, 100, and 1000, plotted individually and in the same plot * renamings for better in-paper linkings * branch test 1 * branch test 2 * demo folder untracked * resources (currently only traces, soon also others e.g., prebuilts) moved in their own folder * experiment 1 renamed more specifically, experiment 2 coming soon * gitignore updated to ignore demo * demo.zip removed... * resources folder, with traces (for now) * raw linking between the python backend, and then opendc-analyzer json interface * (feat) kotlin backend gives 2-parameter input to python backend, one for outputFolderPath, one for multiModelSetup * (feat) user-input parser file * (feat) multi-model linked with user provided configuration/input * (testing) input provided for testing the program - after a brief testing, it works * (documentation) input doc for MultiMetaModel * (documentation) scenario doc updated to match the MultiMetaModel documentation * (documentation) added export rate in MultiMetaModel input * (feat) MultiModel is now capable of reading and parsing user input, along side its main functionalities * (fix) experiment python scripts rescued * experiment 2 simulation files added, files for sample-rate=3s were omitted (larger than 100mb limit) * sample-rate=3s simulation files added via GIT LFS * (feat) counted the number of samples in experiment 2, per sampling rate * (feat) .gitattributes updated accordingly * Update .gitattributes and remove certain files from Git LFS * Committing local changes before merging * test * gittest * gittest * Remove LFS tracking from files * gittest * gittest * order of the arguments repaired * (fix) order of the arguments (only now) repaired * (feat) Multi-Model now handles, based on user's input, both time-series and cumulative plots * (misc) commit before temporarily changing the branch * (fix) experiment file names improved * (fix) multi-model window outputting problem solved * (documentation) updated to match user input * (fix) updated to match user input * (fix) experiment 2 - user-experience improved * demo setup for meeting * (feat&fix) MultiModel handles vertical and horizontal limits from input, window accuracy was improved, useless content deleted * (feat) Multi-Model cumulative time series plot almost developed; other Multi-Model plots refined; demo for the Multi-Model * (feat) Multi-Model, almost reaching final of iteration 2, user input updated, efficiency improved * (feat) documentation updated, experiment 2 updated, and re-ran for multiple types of plots, many plots + multimodel towards the end of iteration 2 * (feat) towards finishing rq1 * (feat) experiment 4 and misc * (fix) opendc-analyzer folder cleaned * (feat) parser updated to match the meta-model input * (feat) plotting integration of the metamodel * (feat) MetaModel very-basic functionality initialization, computation with only one function (mean), multi-model appending and linking, plotting tested (and works) fot time series graph yet * (feat) better naming and little, temporary, ducktape, to disable a feature and allow meta-model to function * (misc) output results, files -- with this commit, the first sub-iteration of the MVP is complete * (feat) meta-model handles also cumulative * (feat) last commit before major refactoring * (feat) MVP of metamodel done 3 functions handled, integrated with multimodel, able to plot all the types of graphs the multimodel plots, the code is in a relatively good shape, still requires documentation. up next: iteration 2! * (feat) Meta-Model outputs the meta-model simulation results (feat) experiment 5, accuracy, currently setting up * (feat) bitbrains small analysis * (feat) surf-sara and carbon-trace workloads analyzed * (feat) accuracy evaluator setup * (doc) code documentation * (fix) removed use_cases (not used anymore) * (doc) following the industry standards * (feat) accuracy evaluator, part of experiment 5, implemented MVP future elements: have a better output, save into a file, with specific details per model / metamodel * (feat) accuracy_evaluator outputs in an external file + some accuracy analysis for individual models, metamodel with mean, and metamodel with median * experiment 5 addded * (feat) seeking meta_equations with lower error rate(s) than mean/median (still searching) * (feat) Warning: Cannot have a Meta-Model without a Multi-Model. No computation made." * experiment 6 added * (fix) clarified: aggregation_function changed to window_function * (fix) sample rate added in the reproducibility.md file for exp 6 * (feat) aggregation_function -> window_function; vertical&horizontal ticks can now be selected by the user; metamodel more proeminent in the plots * (feat) fr6 plots * (feat) experiment 7 report files * (feat) gitignore ignores large files * (feat) gitignore * (feat) experiment 7 results * Experiment 5 adjusted for RMSLE in %age * experiment 7 and experiment 8 data * (feat) experiment data updated * (feat) data plots for the experiment * (feat) large data files ignored * . * (feat) documentation update * (feat) documenting code * (fix) demo folder removed * (fix) meta_model now outputs straight after computation * (feat) md file setup, folder setup * (feat) host renamed to "sim". this makes the tool more inclusive. MultiModel also handles seed every variable name containing the word host, and the corresponding documentation, we rename to "sim" (simulation). for example raw-host-data -> raw-sim-data. Also, the Multi-Model now handles the seed, which can be given by user, or is 0 by default. * (feat) added the seed, as a non-mandatory value, defaulting to 0 * (feat) added the seed, as a non-mandatory value, defaulting to 0 * (feat) host -> sim (refactoring consequences) * (feat) multi-meta-model integration file, started, linked with main for testing * (feat) corresponding integration & analysis (testing) files * (feat) multi-meta-model-integration file - towards draft 1 * (feat) multi-meta-model-integration file - draft 1 * (feature) multimodel has now ID -101 (instead of 101) this "feature" does not limit anymore the multimodel to "only" 100 models (hence clashing when the id increases to 100) * (fix) exit codes no more relevant * (feat) simulation data files * (feat) minor change * (feat) Simulator Specifics * accuracy and performance validation for RQ3 * (feat) new branding - Multi-Meta-Model is now "M3SA" M3SA - the short of Multi-Meta-Model Simulation Analysis * (feat) new branding - Multi-Meta-Model is now "M3SA" M3SA - the short of Multi-Meta-Model Simulation Analysis * (fix) universality simulation folder removed from local-master * (feat) experiment being set up * (feat) experiment being set up * (feat) analyzr now is M3SA * (feat) use case - usability evaluation * (feat) use case - usability evaluation * (fix) removed unused files * (fix) analyzer renamed to "m3sa" * (fix) analyzer renamed to "m3sa" * (fix) m3sa linked with opendc * (fix) splotless applied * (fix) preparing PR * (fix) preparing PR - updating website * (feat) PR template nicer * (feat) CI: Add disk cleanup and usage checks to github actions * (feat) CI: increased timeout time for documentation downlaoding dependencies for the website may take more time than initially allowed * (feat) CI: Enhance GitHub Pages setup and optimize Node.js caching in CI. * testing website workflow without m3sa documentation * build workflow reverted to initial * website files back here * (fix) <br> now as <br /> * (fix) docusaurus 'broken links' solved * (fix) experimental components removed from the master branch * gitignore removes pyc and pycache * removed all pyc and pycache

monitor does not have anymore serversPending attribute which causes test (hence workflows) failures

Commits on Jun 5, 2024

demo folder moved in opendc/demo

Radu-Nicolae committed Jun 5, 2024

Configuration menu

View commit details

Copy full SHA for 5f5b2f9

Browse repository at this point

Copy the full SHA

5f5b2f9 View commit details

Browse the repository at this point in the history

[OLD] M3SA - Multi-Meta-Model Simulation Analyzer #240

[OLD] M3SA - Multi-Meta-Model Simulation Analyzer #240

Commits on May 8, 2024

Commits on May 15, 2024

Commits on May 16, 2024

Commits on Jun 5, 2024

Commits on Jun 10, 2024

Commits on Jun 11, 2024

Commits on Jun 18, 2024

Commits on Jun 22, 2024

Commits on Jun 23, 2024

Commits on Jun 28, 2024

Commits on Jul 4, 2024

Commits on Jul 6, 2024

Commits on Jul 7, 2024

Commits on Jul 8, 2024

Commits on Jul 9, 2024

Commits on Jul 10, 2024

Commits on Jul 11, 2024

Commits on Jul 13, 2024

Commits on Jul 14, 2024

Commits on Jul 16, 2024

Commits on Jul 17, 2024

Commits on Jul 20, 2024

Commits on Jul 21, 2024

Commits on Jul 22, 2024

Commits on Jul 23, 2024

Commits on Jul 24, 2024

Commits on Jul 25, 2024

Commits on Jul 26, 2024

Commits on Jul 27, 2024

Commits on Jul 28, 2024

Commits on Jul 30, 2024

Commits on Aug 3, 2024

Commits on Aug 4, 2024

Commits on Aug 6, 2024

Commits on Aug 7, 2024

Commits on Aug 8, 2024

Commits on Aug 28, 2024