Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix: Make Test Suite Parallelizable #1273

Open
wants to merge 4 commits into
base: dev
Choose a base branch
from

Conversation

fpjentzsch
Copy link
Collaborator

For the FINN+ CI we want to speed up the test suite.

Previously, the test suite was parallelizable only with the pytest-xdist --dist loadfile scheduler, because some tests assume all tests within the same file are run in-order or at least not in parallel.

This refactors the offending tests that I found (except end2end tests for now, which really depend on each other) so that we can use a better scheduler (--dist worksteal) for most of the test suite.

@fpjentzsch fpjentzsch changed the title Fix: Make Brevitas tests parallelism-safe Fix: Make more tests parallelism-safe Feb 7, 2025
@fpjentzsch
Copy link
Collaborator Author

fpjentzsch commented Feb 7, 2025

I also made the notebook tests and end2end tests parallelizable while keeping dependent tests grouped together using the --dist loadgroup scheduler.

For bnn_pynq, different scenarios (board, topology, wbit, abit combination) can be run in parallel.

@fpjentzsch fpjentzsch changed the title Fix: Make more tests parallelism-safe Fix: Make Test Suite Parallelizable Feb 7, 2025
@auphelia auphelia self-requested a review February 7, 2025 16:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant