Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests: reduce number of nodes to run tests #446

Open
adammoody opened this issue Oct 18, 2021 · 2 comments
Open

tests: reduce number of nodes to run tests #446

adammoody opened this issue Oct 18, 2021 · 2 comments
Labels

Comments

@adammoody
Copy link
Contributor

Some tests in SCR and the components currently require multiple compute nodes. While these do need multiple processes, many of these could be modified to run with multiple processes on a single compute node. That should be done so as to reduce the number of resources needed to run the tests.

A common requirement from some tests is to use the hostname to split procs into groups or to define directories. That would need to be modified to perhaps use process ranks instead.

@adammoody
Copy link
Contributor Author

adammoody commented Oct 27, 2021

@kosinovsky , I've created separate issues for each component. It actually looks like we may be able to change all of them. We can use the issue on the component page to discuss details about each component in turn if needed.

These tests do typically require multiple processes, like 2 or 3. Our goal is to change things so that the test can run with all of its processes on a single node. So we want to avoid commands like srun -N3 -n3 and use srun -n3 where we allocate one node instead. Similarly, we want to change from jsrun -r 1 to something like jsrun -r 3 again where we allocate one node.

The redset and er tests will be more involved, as those will require some changes to the test code itself to avoid using hostname.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant