Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DRAFT: restore various application test suites #230

Draft
wants to merge 11 commits into
base: develop
Choose a base branch
from

Conversation

tcooper
Copy link
Member

@tcooper tcooper commented Nov 3, 2024

This DRAFT PR contains initial changes to templates.fif.json to restore multiple application install test suites to the Rocky openQA that were removed after initial upstream fork to limit the scope of work to migrate openQA to support Rocky.

These tests require a large number of needles to be captured in order for them to be supported in Rocky Linux. While it is useful to compare upstream tests to understand test suite flow care needs to be taken because there may be substantial differences between Rocky 8 and 9 for these tests. I suggest we focus on adding these for Rocky 9 (and shortly 10) and do not spend significant effort making these work for Rocky 8.

Applying this branch to dev openqa instances will allow the needles to be captured and tests modified without increasing the number of failure in the production openQA instance needlessly.

@tcooper tcooper added priority: medium This issue or pull request is of medium priority type: test suite This issue or pull request is for test suite changes type: needles This issue or pull request is for needle changes type: templates.fif.json Improvements or change to templates.fif.json labels Nov 3, 2024
From upstream:
 support functions added to lib/utils.pm
 clocks functions directory added in tests/applications/
 minor correction in ...evince/aaa_setup.pm
@AlanMarshall
Copy link
Contributor

Now working on clocks and evince needles capture.

@AlanMarshall AlanMarshall self-assigned this Nov 9, 2024
@AlanMarshall
Copy link
Contributor

Evince tests now passing, clocks has install problem but well on the way.

@AlanMarshall
Copy link
Contributor

disks app tested:

./fifloader.py -c -l templates.fif.json
openqa-cli api -X POST isos ISO=Rocky-9.5-x86_64-dvd.iso ARCH=x86_64 DISTRI=rocky FLAVOR=dvd-iso VERSION=9.5 CURRREL=9 LOCATION=https://dl.rockylinux.org/pub/rocky/9.5 BUILD=-"$(date +%Y%m%d.%H%M%S).0"-dvd-iso-9.5 TEST=disks

Result: Pass

@AlanMarshall
Copy link
Contributor

@tcooper
Calculator tests are complete so the above 4 tests are now ready for review and, when convenient, merge.
Tested:

./fifloader.py -c -l templates.fif.json
openqa-cli api -X POST isos ISO=Rocky-9.5-x86_64-dvd.iso ARCH=x86_64 DISTRI=rocky FLAVOR=dvd-iso VERSION=9.5 CURRREL=9 LOCATION=https://dl.rockylinux.org/pub/rocky/9.5 BUILD=-"$(date +%Y%m%d.%H%M%S).0"-dvd-iso-9.5 TEST=evince,disks,clocks,calculator

Result: Pass
Screenshot 2025-01-26 at 14-13-34 openQA Test results

All needles added are Rocky based and none are superfluous.
Filenames are the same as the test tag and all needles include the tag ENV-DISTRI-rocky

There are 17 Gnome applications remaining to be set up and their needles captured which I will continue to work on using whatever ongoing PR arrangement that we agree on.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
priority: medium This issue or pull request is of medium priority type: needles This issue or pull request is for needle changes type: templates.fif.json Improvements or change to templates.fif.json type: test suite This issue or pull request is for test suite changes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants