Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Testing different site SXL versions #426

Open
emiltin opened this issue Sep 5, 2024 · 1 comment
Open

Testing different site SXL versions #426

emiltin opened this issue Sep 5, 2024 · 1 comment
Labels
enhancement New feature or request tooling GitHub Actions, deployment and other internal tooling

Comments

@emiltin
Copy link
Contributor

emiltin commented Sep 5, 2024

Running on a matrix of core version is possible after #422, and is used for the gem tlc and supervisor tests.

Testing sites with differnt SXL version is not easy since we can't control the SXL from the supervisor (validator) side.

One option might be to just report results for the SXL version that the site uses. The site can then use differnt SXL version on different runs, to build up a set of results for different SXL versions. If we want to to this route, perhaps we should think of increasing the test frequence. e.g. to hourly. In any case it could be a benefit to run more frequently just to get more data.

@emiltin emiltin added enhancement New feature or request tooling GitHub Actions, deployment and other internal tooling labels Sep 5, 2024
@emiltin emiltin changed the title Testing differnt site SXL versions Testing different site SXL versions Sep 5, 2024
@emiltin
Copy link
Contributor Author

emiltin commented Feb 5, 2025

Ideas:

  • we modify the Version message so that the site sends a list of supported SXL version, and the supervisor chooses the version and returns it in the Version message it sends. (similar to how the core version is negotiated.)
  • the site uses a picks supported SXLs at random when connecting, over time results for all SXLs are collected.
  • the supervisor could reject the initial Version message if the SXL is not what it would like to test. The rejection could mention the desired SXL. The site would then re-connect with the desired SXL.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request tooling GitHub Actions, deployment and other internal tooling
Projects
None yet
Development

No branches or pull requests

1 participant