Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This commit adds nox-based tests for MLCube and its runners in multiple versions of python environments. Some of the tests are:
Introduction
Run various MLCube and MLCube runner tests. Some tests run for multiple python versions, others just for one. Some do not take too much time (e.g., unit test), others require some time (e.g., MLCube examples or minified benchmarks). This is based on
nox
(https://nox.thea.codes/).Prerequisites
No need to use MLCube python environment - nox will be creating new environments for each test session installing all required dependencies. Only nox package needs to be installed. In addition, python versions specified in this file or on a command line needs to be discoverable by NOX. One option is to ensure they are all in
PATH
environment variable.Example NOX commands
Default sessions
Only three test suits are executed by default -
mlcube_unit
,runner_unit
andtest_versions
. All other test sessions need to be explicitly specified on a command line.Environment variables
MLCUBE_PYTHON_VERSIONS
: Comma-separated list of python versions to run nox sessions with (e.g., "3.8,3.9,3.10").