Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR has three main changes:
(1) fixing a legacy typo in the word from
INLCUDE
toINCLUDE
across the repo's files for MLPerf Tiny Workloads(2) updating the way profiling is done of the Embench workloads to be correct and consistent with the TFLM workloads
(3) adding the ability to change the workload in the dse framework as well as verify the Embench and TFLM benchmarks are still passing during design space exploration.
All changes have been tested in the following way to ensure correctness:
(1) Do a clean build to make sure typo changes to
INCLUDE
picked up and run golden tests(2) Run profiling of embench workloads to make sure still working
(3) Run
python dse_framework.py
with workload (line 195 of new dse_framework.py version) set tomicro_speech
andprimecount
. I have included the output when runningmicro_speech
to show that the dse framework is able to take a different workload and run successfully to completion (previously only supportedpdti8
by default) :To test if the workload verification is working, I simply changed the
primecount
workload to return the wrong value and you can see the following output below shows that the dse framework detects that the benchmark is no longer passing: ```Simulation completed but program test failed! Modifications need to be made to CFU HW or SW.
NUMBER OF CYCLES: inf
NUMBER OF CELLS: inf
EXITING DSE...