Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance tests are inconsistent #36

Open
ScottG489 opened this issue May 7, 2021 · 0 comments
Open

Performance tests are inconsistent #36

ScottG489 opened this issue May 7, 2021 · 0 comments
Labels
build Build related tech debt Code refactoring

Comments

@ScottG489
Copy link
Owner

The performance test stability seems to be somewhat improved by warming up the endpoints. However, they can still be inconsistent and lead to flaky tests.

Determine a way to make the tests less flaky or perhaps even find an alternative for what we're trying to accomplish with having the tests around (which is at least to prevent a performance degradation when making changes).

Another promising option might be to spread the tests out over a longer period of time. Right now all the tests are fairly short mainly to keep the build time low. However, spreading them out over a longer period of time could even out the results.

I think right now the performance tests are still on the quick side so we have some leeway to make them longer without it being much of an impact. It might also be an option to remove them from the main build and have them run nightly if they are going to run for an extended period of time.

@ScottG489 ScottG489 added build Build related tech debt Code refactoring labels May 7, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Build related tech debt Code refactoring
Projects
None yet
Development

No branches or pull requests

1 participant