v0.5.1 (30 January 2025)

This is a bug fix release of the EESSI test-suite

Other updates:

• Update to release workflow instructions (#232)
• Document how to use a different version of the config files when using CI/run_reframe.sh (#235)
• Bump the use of the default ReFrame version for period tests that use CI/run_reframe.sh to ReFrame 4.7.3 (#236)
• Make CI/run_reframe.sh use the latest release of the test suite as default version (#237)

EESSI test suite v0.5.0

v0.5.0 (23 January 2025)

This is a minor release of the EESSI test-suite

New tests:

• MetalWalls (#164) (N.B. requires ReFrame >=4.7.0)

New features:

• Created eessi_mixin class for tests to inherit from. This class makes it easier to create portable tests, and also keeps the structure of those tests more uniform. (#177)
• Automatic versioning with setuptools_scm (#185)
• Ported tests to use the eessi_mixin class: CP2K (#193), MPI4py (#203), QuantumESPRESSO (#212), PyTorch (#213), TensorFlow (#221), OSU (#222)
• Improved support for doing periodic test suite runs on a local software stack using CI/run_reframe.sh (#200)
• Support for setting the exact required memory (#214)
• For periodic tests using CI/run_reframe.sh, allow using a different version of the test-suite repository for the ReFrame config files (#226)

Bug fixes:

• Fixed failing mktemp command in CI/run_reframe.sh when EESSI_CI_TEMPROOT isn't set (#227)
• Make tests that don't use eessi_mixin always request GPUs if this is specified in the test.

Other updates:

• Update lammps hook name to be more descriptive (#177)
• Add empty init files to allow auto-generating API docs (#192)
• Updates to ReFrame configs (#195, #198, #199, #202, #215, #216, #223, #225)
• Log if the CI tag gets set (#204)
• Reduce the amount of data that gets copied during ReFrame staging (#205, #220)
• Log CVMFS_REPO_NAME, CVMFS_SOFTWARE_SUBDIR, MODULEPATH and EESSI test-suite version (#206)
• Clarify error messages from EESSI mixin that warn test developers if certain variables aren't set on time in the child class (#208)
• For periodic tests using CI/run_reframe.sh, avoid cloning the full history (#218)
• Update release instructions (#230)

EESSI test suite v0.4.0

Release date: 26 September 2024

This is a minor release of the EESSI test-suite

New tests:

• PyTorch (with torchvision) (#130)
• LAMMPS (#131, #169)
• CP2K (#133)

Bug fixes:

• Find and report duplicate modules (#167)
• Specify memory as an extra resource in all ReFrame configs (#180)
• Make req_memory_per_node hook print a warning if memory resource is not configured in ReFrame config (#182)
• No longer test import of eessi.testsuite.utils directly in CI, as it fails (by design) for the ReFrame 4.6.2 version deployed in EESSI (#183)

Other updates:

• mpi4py reduction test for tutorial (#149, #172), to accompany documentation on writing portable tests for the EESSI test suite
• Various updates to Snellius ReFrame config (#165, #168, #187, #188)
• Make the use of EESSI optional in common_eessi_init, to better support testing of local software stacks (#166)
• Remove hard-coded SLURM account from karolina and hortense configs in favour of using the $SBATCH_ACCOUNT environment variable (#171)
• Add ReFrame config and CI config for EESSI Azure build cluster (#173, #176, #186)
• Add hook for measuring memory usage in a job (#174)
• Bump default ReFrame version used in CI config to 4.6.2 (#175)
• Use ReFrame warning's to print warnings, amking them easier to spot (#178)
• Limit runtime of ReFrame command in in CI config (#179)
• Add release notes and bump versions (#189)

EESSI test suite v0.3.2

Release date: 29 June 2024

This is a bugfix release of the EESSI test-suite

What's Changed

• Add config for Deucalion (#162)

Full Changelog: v0.3.1...v0.3.2

EESSI test suite v0.3.1

Release date: 28 June 2024

This is a bugfix release of the EESSI test-suite

What's Changed

• correct required memory per node to MiB in ESPResSo test by @satishskamath in #158
• Change behavior for assign_tasks_per_compute_unit(test, COMPUTE_UNIT[CPU]) on hyperthreading-enabled systems + use compact process binding in ESPResSo test by @casparvl in #160
• bump version to 0.3.1 + update release notes by @boegel in #159

Full Changelog: v0.3.0...v0.3.1

EESSI test suite v0.3.0

Release date: 27 June 2024

This is a minor release of the EESSI test-suite

It includes:

• Update config AWS MC cluster to use software.eessi.io (#126)
• Add test for QuantumESPRESSO (pw.x) (#128)
• Fix compact process binding for OpenMPI mpirun (#137)
• Use compact process binding for GROMACS (#139)
• Rename scale tags 1_cpn_2_nodes and 1_cpn_4_nodes (#140)
• Set SRUN_CPUS_PER_TASK for srun launcher (#141)
• Fix for "Failed to modify UD QP to INIT on mlx5_0" on Karolina CI runs (#142)
• Reduce the iteration count to make the OSU tests run faster, especially on slower interconnects (#143)
• Add test for ESPResSo (P3M) (#144)
• Use software.eessi.io repo in CI (#146)
• Add notes on release management to README (#148)
• Fix memory_per_node for Hortense (#151)
• Use MiB units for memory per node (#152)
• Added / updated memory for various systems in MiB units (#153)
• Add additional test for ESPRESSO (LJ) (#155)
• Bump default version used in CI (#157)

EESSI test suite v0.2.0

Release date: 7 march 2024

This is a minor release of the EESSI test-suite

It includes:

• Implement the CI for regular runs on a system (#93)
• Add OSU tests and update the hooks and configs to make the tests portable (#54, #95, #96, #97, #110, #116, #117, #118, #121)
• Add extra scales to filter tests(#94)
• add new hook to filter out invalid scales based on features in the config (#111)
• unify test names (#108)
• updates to CI workflow ((#102, #103, #104, #105)
• Update common_config (#114)
• Add common config item to redirect the report file to the same directory as e.g. the perflog (#122)
• Fix code formatting + enforce it in CI workflow (#120)

Bug fixes:

• Fix hook _assign_num_tasks_per_node (#98)
• fix import common-config vsc_hortense (#99)
• fix typo in partition names in configuration file for vsc_hortense (#106)

For documentation, see https://eessi.io/docs/test-suite .

EESSI test suite v0.1.0

This is the first release of the EESSI test suite.

It includes:

• A well-structured eessi.testsuite Python package that provides constants, utilities, hooks, and tests, which can be installed with "pip install".
• Tests for GROMACS and TensorFlow in eessi.testsuite.tests.apps that leverage the functionality provided by eessi.testsuite.*.
• Examples of ReFrame configuration files for various systems in the config subdirectory.
• A common_logging_config() function to facilitate the ReFrame logging configuration.
• A set of standard device types and features that can be used in the partitions section of the ReFrame configuration file.
• A set of tags (CI + scale) that can be used to filter checks.
• Scripts that show how to run the test suite.

For documentation, see https://eessi.io/docs/test-suite .