Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding information by at the test level #1

Open
luisleon90 opened this issue Jul 26, 2022 · 2 comments
Open

Adding information by at the test level #1

luisleon90 opened this issue Jul 26, 2022 · 2 comments

Comments

@luisleon90
Copy link

Currently all metadata is searchable at the model level. It would be very valuable to be able to toggle to see metadata at the test level as well. Some questions this would help me answer include:

  1. Which tests failed in the latest run?
  2. Which tests fail most often? Least often?
  3. Can I see a list of models with out any tests applied?
@b-per
Copy link
Owner

b-per commented Jul 27, 2022

Thanks Luis for the comments! Considering the UX/UI of Raycast, do you have an idea already of how you would see users navigating the different pages to arrive to those details?

e.g for case 1, would it be:

  1. select an environment from a list
  2. select a job from a list
  3. select a previous run from a list of x previous runs
  4. see details of all the tests for that run

@luisleon90
Copy link
Author

Benoit,

I think we are imagining the navigation pretty similar. Here is how I see it.

  1. User selects the environment
  2. User selects either Tests or Models (if selecting Models follow same flow as today)
  3. User selects a job from the list of active jobs
  4. User selects between "Most Recent Run Results" "Previous Run Results"
  5. If User selects Most Recent Run show a list of failing tests from most recent run and a list of models without tests from the most recent run (could show failing and passing test separately here but the failing tests seem like the more valuable information)
  6. Is User selects Previous Run show a chart by run of # of failing tests per run for last 10 runs, show a chart by test showing the # of failures of the test over the last 10 runs

Let me know what you think!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants