Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement helper functions for (un)selecting an editor in the integration tests #19344

Merged

Conversation

timvandermeij
Copy link
Contributor

The commit messages contain more details about the individual changes.

Fixes a part of #19065.

@timvandermeij timvandermeij changed the title Implement a helper function for (un)selecting an editor in the integration tests Implement helper functions for (un)selecting an editor in the integration tests Jan 18, 2025
@timvandermeij timvandermeij force-pushed the integration-tests-editor-helpers branch from 4c524ee to 2c1431a Compare January 18, 2025 19:32
The `selectorEditor` name is used 57 times, but only in the freetext
editor integration tests file. The `editorSelector` name on the other
hand is used 241 times in all editor integration test files, so this
commit renames the former name to the latter name to achieve consistency
in variable names across all editor integration test files, which also
simplifies upcoming changes.
@timvandermeij timvandermeij force-pushed the integration-tests-editor-helpers branch from 2c1431a to 111368e Compare January 18, 2025 19:35
@timvandermeij
Copy link
Contributor Author

/botio integrationtest

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Linux m4)


Received

Command cmd_integrationtest from @timvandermeij received. Current queue size: 0

Live output at: http://54.241.84.105:8877/5a9d5d355bb31d0/output.txt

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Windows)


Received

Command cmd_integrationtest from @timvandermeij received. Current queue size: 0

Live output at: http://54.193.163.58:8877/ff2de2410ef95e9/output.txt

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Linux m4)


Failed

Full output at http://54.241.84.105:8877/5a9d5d355bb31d0/output.txt

Total script time: 11.38 mins

  • Integration Tests: FAILED

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Windows)


Failed

Full output at http://54.193.163.58:8877/ff2de2410ef95e9/output.txt

Total script time: 27.94 mins

  • Integration Tests: FAILED

Copy link
Collaborator

@Snuffleupagus Snuffleupagus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

r=me, thank you.

@timvandermeij timvandermeij force-pushed the integration-tests-editor-helpers branch 2 times, most recently from c6b934a to 3b13e44 Compare January 19, 2025 11:19
@timvandermeij
Copy link
Contributor Author

/botio integrationtest

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Linux m4)


Received

Command cmd_integrationtest from @timvandermeij received. Current queue size: 0

Live output at: http://54.241.84.105:8877/46b2de0b78eda90/output.txt

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Windows)


Received

Command cmd_integrationtest from @timvandermeij received. Current queue size: 0

Live output at: http://54.193.163.58:8877/190b13f1301f5e2/output.txt

…n tests

This has multiple advantages:

- it improves consistency between the various editor integration tests;
- it makes the code easier to read/understand;
- it reduces code duplication;
- it reduces the number of `getEditorSelector` calls that contained
  hardcoded IDs, which helps to isolate the tests and to simplify
  follow-up patches.
…ion tests

This has multiple advantages:

- it improves consistency between the various editor integration tests;
- it makes the code easier to read/understand;
- it reduces code duplication.
@timvandermeij timvandermeij force-pushed the integration-tests-editor-helpers branch from 3b13e44 to 895edaf Compare January 19, 2025 11:28
@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Linux m4)


Success

Full output at http://54.241.84.105:8877/46b2de0b78eda90/output.txt

Total script time: 10.36 mins

  • Integration Tests: Passed

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Windows)


Failed

Full output at http://54.193.163.58:8877/190b13f1301f5e2/output.txt

Total script time: 26.30 mins

  • Integration Tests: FAILED

@timvandermeij
Copy link
Contributor Author

I just realized that the Linux failures were actually caused by a change in this patch because I could reproduce the issue locally. Initially I thought they were intermittents we had seen before, which shows that it's sadly still a bit easy to miss the introduction of new issues due to noise in the test results. Sorry for the oversight; with the upcoming patches and test isolation I hope to get that more under control and simplify the code to reduce room for error.

Let's run the tests once more with the fixes applied, for good measure:

/botio integrationtest

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Linux m4)


Received

Command cmd_integrationtest from @timvandermeij received. Current queue size: 0

Live output at: http://54.241.84.105:8877/678a1d8c55f3e46/output.txt

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Windows)


Received

Command cmd_integrationtest from @timvandermeij received. Current queue size: 1

Live output at: http://54.193.163.58:8877/36969269f697138/output.txt

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Linux m4)


Success

Full output at http://54.241.84.105:8877/678a1d8c55f3e46/output.txt

Total script time: 10.38 mins

  • Integration Tests: Passed

@moz-tools-bot
Copy link
Collaborator

From: Bot.io (Windows)


Failed

Full output at http://54.193.163.58:8877/36969269f697138/output.txt

Total script time: 26.20 mins

  • Integration Tests: FAILED

@timvandermeij timvandermeij merged commit ac57939 into mozilla:master Jan 19, 2025
7 checks passed
@timvandermeij timvandermeij deleted the integration-tests-editor-helpers branch January 19, 2025 17:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants