Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Existing update_suite.rb features #1

Open
17 tasks
sim642 opened this issue Dec 16, 2021 · 0 comments
Open
17 tasks

Existing update_suite.rb features #1

sim642 opened this issue Dec 16, 2021 · 0 comments
Labels

Comments

@sim642
Copy link
Member

sim642 commented Dec 16, 2021

  • Expected verdict checking for assertions.
  • Expected verdict checking for races.
  • Expected verdict checking for any warning.
  • Expected verdict checking for termination.
  • Fixpoint not reached output checking.
  • Parallel execution.
  • Marshaling testing: save_run, load_run.
  • Basic incremental testing: incremental.save, patch, incremental.load.
  • Execute all non-skipped tests.
  • Execute all tests in group (including skipped, a non-feature).
  • Execute test by test name (must be unique across groups!).
  • Test number duplication checking.
  • Skipping tests with SKIP.
  • Adding arguments with PARAM.
  • Skipping tests from marshaling with NOMARSHAL.
  • Download linux-headers using Goblint makefile for Linux kernel tests.
  • Some HTML generation (not sure if used by anyone).

May be incomplete. To be decided, which we maybe want to exclude.

@sim642 sim642 added the test label Nov 15, 2022
sim642 pushed a commit that referenced this issue Apr 29, 2024
Added update_bench_concrat.py script
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant