Switch to mailpit for Playwright tests #4496
Annotations
12 errors, 25 warnings, and 6 notices
[Chrome] › timeline/timeline.spec.ts:487:13 › Timeline › message displaying › should render EventTiles on IRC:
playwright/e2e/timeline/timeline.spec.ts#L567
1) [Chrome] › timeline/timeline.spec.ts:487:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout @screenshot
Error: expect(locator).toHaveScreenshot(expected)
33706 pixels (ratio 0.06 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tiles-compact-modern-layout-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout-Chrome/event-tiles-compact-modern-layout-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout-Chrome/event-tiles-compact-modern-layout-diff.png
Call log:
- expect.toHaveScreenshot(event-tiles-compact-modern-layout.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 33706 pixels (ratio 0.06 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_MainSplit')
- locator resolved to <div class="mx_MainSplit">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 33706 pixels (ratio 0.06 of all image pixels) are different.
565 | page.locator(".mx_RoomView").getByText("This message has an inline emoji 👒"),
566 | ).toBeInViewport();
> 567 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot(
| ^
568 | "event-tiles-compact-modern-layout.png",
569 | screenshotOptions,
570 | );
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:567:61
|
[Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default:
playwright/e2e/crypto/backups-mas.spec.ts#L1
1) [Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default
Test timeout of 30000ms exceeded while setting up "mas".
|
[Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default:
playwright/e2e/crypto/backups-mas.spec.ts#L1
1) [Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded while setting up "mas".
|
[Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default:
playwright/e2e/crypto/backups-mas.spec.ts#L1
1) [Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded while setting up "mas".
|
[Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery:
playwright/e2e/crypto/backups-mas.spec.ts#L1
2) [Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery
Test timeout of 30000ms exceeded while setting up "mas".
|
[Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery:
playwright/e2e/crypto/backups-mas.spec.ts#L1
2) [Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded while setting up "mas".
|
[Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery:
playwright/e2e/crypto/backups-mas.spec.ts#L1
2) [Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded while setting up "mas".
|
[Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere:
playwright/e2e/crypto/backups-mas.spec.ts#L1
3) [Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere
Test timeout of 30000ms exceeded while setting up "mas".
|
[Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere:
playwright/e2e/crypto/backups-mas.spec.ts#L1
3) [Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded while setting up "mas".
|
[Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere:
playwright/e2e/crypto/backups-mas.spec.ts#L1
3) [Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded while setting up "mas".
|
[Chrome] › oidc/oidc-native.spec.ts:18:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit:
playwright/testcontainers/mas.ts#L220
4) [Chrome] › oidc/oidc-native.spec.ts:18:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit
Error: URL /health not accessible after 60000ms
at ../testcontainers/mas.ts:220
218 |
219 | return new StartedMatrixAuthenticationServiceContainer(
> 220 | await super.start(),
| ^
221 | `http://localhost:${port}`,
222 | this.args,
223 | );
at /home/runner/work/element-web/element-web/node_modules/testcontainers/src/wait-strategies/http-wait-strategy.ts:131:15
at IntervalRetry.retryUntil (/home/runner/work/element-web/element-web/node_modules/testcontainers/src/common/retry.ts:49:16)
at HttpWaitStrategy.waitUntilReady (/home/runner/work/element-web/element-web/node_modules/testcontainers/src/wait-strategies/http-wait-strategy.ts:82:5)
at waitForContainer (/home/runner/work/element-web/element-web/node_modules/testcontainers/src/wait-strategies/wait-for-container.ts:17:5)
at MatrixAuthenticationServiceContainer.startContainer (/home/runner/work/element-web/element-web/node_modules/testcontainers/src/generic-container/generic-container.ts:216:5)
at MatrixAuthenticationServiceContainer.start (/home/runner/work/element-web/element-web/playwright/testcontainers/mas.ts:220:13)
at Object.exports.masHomeserver.mas.scope (/home/runner/work/element-web/element-web/playwright/plugins/homeserver/synapse/masHomeserver.ts:30:31)
|
end-to-end-tests
Process completed with exit code 1.
|
Slow Test:
[Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 57.4s
|
Slow Test:
[Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 24.0s
|
Slow Test:
[Chrome] › right-panel/file-panel.spec.ts#L1
[Chrome] › right-panel/file-panel.spec.ts took 19.0s
|
Slow Test:
[Chrome] › polls/polls.spec.ts#L1
[Chrome] › polls/polls.spec.ts took 18.6s
|
Slow Test:
[Chrome] › one-to-one-chat/one-to-one-chat.spec.ts#L1
[Chrome] › one-to-one-chat/one-to-one-chat.spec.ts took 17.0s
|
Slow Test:
[Chrome] › sliding-sync/sliding-sync.spec.ts#L1
[Chrome] › sliding-sync/sliding-sync.spec.ts took 54.7s
|
Slow Test:
[Chrome] › room/room.spec.ts#L1
[Chrome] › room/room.spec.ts took 29.0s
|
Slow Test:
[Chrome] › settings/encryption-user-tab/recovery.spec.ts#L1
[Chrome] › settings/encryption-user-tab/recovery.spec.ts took 27.7s
|
Slow Test:
[Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 16.9s
|
Slow Test:
[Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 57.7s
|
Slow Test:
[Chrome] › integration-manager/kick.spec.ts#L1
[Chrome] › integration-manager/kick.spec.ts took 24.3s
|
Slow Test:
[Chrome] › crypto/invisible-crypto.spec.ts#L1
[Chrome] › crypto/invisible-crypto.spec.ts took 24.0s
|
Slow Test:
[Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 19.1s
|
Slow Test:
[Chrome] › lazy-loading/lazy-loading.spec.ts#L1
[Chrome] › lazy-loading/lazy-loading.spec.ts took 17.9s
|
Slow Test:
[Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 50.8s
|
Slow Test:
[Chrome] › audio-player/audio-player.spec.ts#L1
[Chrome] › audio-player/audio-player.spec.ts took 38.5s
|
Slow Test:
[Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 35.6s
|
Slow Test:
[Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 33.5s
|
Slow Test:
[Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 28.4s
|
Slow Test:
[Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.0m
|
Slow Test:
[Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 48.3s
|
Slow Test:
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 48.2s
|
Slow Test:
[Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 25.8s
|
Slow Test:
[Chrome] › login/login-consent.spec.ts#L1
[Chrome] › login/login-consent.spec.ts took 1.1m
|
Slow Test:
[Chrome] › app-loading/guest-registration.spec.ts#L1
[Chrome] › app-loading/guest-registration.spec.ts took 24.0s
|
🎭 Playwright Run Summary
1 skipped
39 passed (3.0m)
|
🎭 Playwright Run Summary
1 skipped
53 passed (3.8m)
|
🎭 Playwright Run Summary
1 skipped
65 passed (4.7m)
|
🎭 Playwright Run Summary
56 passed (4.7m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › timeline/timeline.spec.ts:487:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout @screenshot
1 skipped
58 passed (5.7m)
|
🎭 Playwright Run Summary
5 failed
[Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default
[Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery
[Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere
[Chrome] › oidc/oidc-native.spec.ts:18:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit
[Chrome] › register/email.spec.ts:34:9 › Email Registration › registers an account and lands on the home page @screenshot
36 passed (12.5m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-Chrome-1
Expired
|
197 KB |
|
all-blob-reports-Chrome-2
Expired
|
584 KB |
|
all-blob-reports-Chrome-3
Expired
|
136 KB |
|
all-blob-reports-Chrome-4
Expired
|
170 KB |
|
all-blob-reports-Chrome-5
Expired
|
4.74 MB |
|
all-blob-reports-Chrome-6
Expired
|
6.27 MB |
|
html-report
|
11.5 MB |
|
webapp
Expired
|
27.2 MB |
|