Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Overhaul the Jenkin's test pipeline #341

Open
FinnWilkinson opened this issue Nov 2, 2023 · 1 comment · Fixed by #437
Open

Overhaul the Jenkin's test pipeline #341

FinnWilkinson opened this issue Nov 2, 2023 · 1 comment · Fixed by #437
Assignees
Labels
enhancement New feature or request tests Testing and CI

Comments

@FinnWilkinson
Copy link
Contributor

Additional to the current regression testing and performance testing that the Jenkin's pipeline does, it needs to be updated to a) test more benchmakrs, b) ensure said benchmarks are functionally correct, and c) ensure that the pass/fail criteria of performance tests are robust and consistent.

We have also seen unexpected errors and behaviour when running SimEng on different Linux distributions / Operating systems. Hence, the testing that a new PR undergoes should include running tests on multiple operating systems - perhaps via docker instances

@FinnWilkinson FinnWilkinson self-assigned this Nov 2, 2023
@FinnWilkinson FinnWilkinson converted this from a draft issue Nov 2, 2023
@FinnWilkinson FinnWilkinson added enhancement New feature or request tests Testing and CI labels Nov 2, 2023
@FinnWilkinson
Copy link
Contributor Author

This should address issue #36

@ABenC377 ABenC377 moved this from Planning to In Development in SimEng Development Nov 30, 2023
@ABenC377 ABenC377 linked a pull request Oct 16, 2024 that will close this issue
@FinnWilkinson FinnWilkinson mentioned this issue Oct 24, 2024
@FinnWilkinson FinnWilkinson removed a link to a pull request Oct 24, 2024
@FinnWilkinson FinnWilkinson linked a pull request Oct 24, 2024 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request tests Testing and CI
Projects
Status: In Development
Development

Successfully merging a pull request may close this issue.

2 participants