Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Configuration-dependent regression testing #11

Open
sim642 opened this issue Dec 16, 2021 · 0 comments
Open

Configuration-dependent regression testing #11

sim642 opened this issue Dec 16, 2021 · 0 comments
Labels

Comments

@sim642
Copy link
Member

sim642 commented Dec 16, 2021

Currently we use a very crude hack (update_suite.rb runs SKIP tests when running by group name) to execute apron analysis tests. This is inconvenient, because that's not included in the default run (and hence is easy to forget). In the CI those are explicitly specified in a separate step.

Also regtest.sh ignores SKIP and allows running those tests, so the hack is quite usable, but confusing. And there's no way to truly skip an apron analysis test then.

This could be supported in a nicer way.

@sim642 sim642 added the test label Nov 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant