Skip to content

Switch to mailpit for Playwright tests #4496

Switch to mailpit for Playwright tests

Switch to mailpit for Playwright tests #4496

Triggered via pull request January 27, 2025 12:14
Status Failure
Total duration 16m 41s
Artifacts 8

end-to-end-tests.yaml

on: pull_request
Build Element-Web
2m 15s
Build Element-Web
Matrix: playwright
end-to-end-tests
35s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

12 errors, 25 warnings, and 6 notices
[Chrome] › timeline/timeline.spec.ts:487:13 › Timeline › message displaying › should render EventTiles on IRC: playwright/e2e/timeline/timeline.spec.ts#L567
1) [Chrome] › timeline/timeline.spec.ts:487:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout @screenshot Error: expect(locator).toHaveScreenshot(expected) 33706 pixels (ratio 0.06 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/timeline/timeline.spec.ts/event-tiles-compact-modern-layout-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout-Chrome/event-tiles-compact-modern-layout-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/timeline-timeline-Timeline-1502b-ern-group-and-bubble-layout-Chrome/event-tiles-compact-modern-layout-diff.png Call log: - expect.toHaveScreenshot(event-tiles-compact-modern-layout.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 33706 pixels (ratio 0.06 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('.mx_MainSplit') - locator resolved to <div class="mx_MainSplit">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 33706 pixels (ratio 0.06 of all image pixels) are different. 565 | page.locator(".mx_RoomView").getByText("This message has an inline emoji 👒"), 566 | ).toBeInViewport(); > 567 | await expect(page.locator(".mx_MainSplit")).toMatchScreenshot( | ^ 568 | "event-tiles-compact-modern-layout.png", 569 | screenshotOptions, 570 | ); at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:567:61
[Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default: playwright/e2e/crypto/backups-mas.spec.ts#L1
1) [Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default Test timeout of 30000ms exceeded while setting up "mas".
[Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default: playwright/e2e/crypto/backups-mas.spec.ts#L1
1) [Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded while setting up "mas".
[Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default: playwright/e2e/crypto/backups-mas.spec.ts#L1
1) [Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded while setting up "mas".
[Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery: playwright/e2e/crypto/backups-mas.spec.ts#L1
2) [Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery Test timeout of 30000ms exceeded while setting up "mas".
[Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery: playwright/e2e/crypto/backups-mas.spec.ts#L1
2) [Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded while setting up "mas".
[Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery: playwright/e2e/crypto/backups-mas.spec.ts#L1
2) [Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded while setting up "mas".
[Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere: playwright/e2e/crypto/backups-mas.spec.ts#L1
3) [Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere Test timeout of 30000ms exceeded while setting up "mas".
[Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere: playwright/e2e/crypto/backups-mas.spec.ts#L1
3) [Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded while setting up "mas".
[Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere: playwright/e2e/crypto/backups-mas.spec.ts#L1
3) [Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded while setting up "mas".
[Chrome] › oidc/oidc-native.spec.ts:18:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit: playwright/testcontainers/mas.ts#L220
4) [Chrome] › oidc/oidc-native.spec.ts:18:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit Error: URL /health not accessible after 60000ms at ../testcontainers/mas.ts:220 218 | 219 | return new StartedMatrixAuthenticationServiceContainer( > 220 | await super.start(), | ^ 221 | `http://localhost:${port}`, 222 | this.args, 223 | ); at /home/runner/work/element-web/element-web/node_modules/testcontainers/src/wait-strategies/http-wait-strategy.ts:131:15 at IntervalRetry.retryUntil (/home/runner/work/element-web/element-web/node_modules/testcontainers/src/common/retry.ts:49:16) at HttpWaitStrategy.waitUntilReady (/home/runner/work/element-web/element-web/node_modules/testcontainers/src/wait-strategies/http-wait-strategy.ts:82:5) at waitForContainer (/home/runner/work/element-web/element-web/node_modules/testcontainers/src/wait-strategies/wait-for-container.ts:17:5) at MatrixAuthenticationServiceContainer.startContainer (/home/runner/work/element-web/element-web/node_modules/testcontainers/src/generic-container/generic-container.ts:216:5) at MatrixAuthenticationServiceContainer.start (/home/runner/work/element-web/element-web/playwright/testcontainers/mas.ts:220:13) at Object.exports.masHomeserver.mas.scope (/home/runner/work/element-web/element-web/playwright/plugins/homeserver/synapse/masHomeserver.ts:30:31)
end-to-end-tests
Process completed with exit code 1.
Slow Test: [Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 57.4s
Slow Test: [Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 24.0s
Slow Test: [Chrome] › right-panel/file-panel.spec.ts#L1
[Chrome] › right-panel/file-panel.spec.ts took 19.0s
Slow Test: [Chrome] › polls/polls.spec.ts#L1
[Chrome] › polls/polls.spec.ts took 18.6s
Slow Test: [Chrome] › one-to-one-chat/one-to-one-chat.spec.ts#L1
[Chrome] › one-to-one-chat/one-to-one-chat.spec.ts took 17.0s
Slow Test: [Chrome] › sliding-sync/sliding-sync.spec.ts#L1
[Chrome] › sliding-sync/sliding-sync.spec.ts took 54.7s
Slow Test: [Chrome] › room/room.spec.ts#L1
[Chrome] › room/room.spec.ts took 29.0s
Slow Test: [Chrome] › settings/encryption-user-tab/recovery.spec.ts#L1
[Chrome] › settings/encryption-user-tab/recovery.spec.ts took 27.7s
Slow Test: [Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 16.9s
Slow Test: [Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 57.7s
Slow Test: [Chrome] › integration-manager/kick.spec.ts#L1
[Chrome] › integration-manager/kick.spec.ts took 24.3s
Slow Test: [Chrome] › crypto/invisible-crypto.spec.ts#L1
[Chrome] › crypto/invisible-crypto.spec.ts took 24.0s
Slow Test: [Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 19.1s
Slow Test: [Chrome] › lazy-loading/lazy-loading.spec.ts#L1
[Chrome] › lazy-loading/lazy-loading.spec.ts took 17.9s
Slow Test: [Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 50.8s
Slow Test: [Chrome] › audio-player/audio-player.spec.ts#L1
[Chrome] › audio-player/audio-player.spec.ts took 38.5s
Slow Test: [Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 35.6s
Slow Test: [Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 33.5s
Slow Test: [Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 28.4s
Slow Test: [Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.0m
Slow Test: [Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 48.3s
Slow Test: [Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 48.2s
Slow Test: [Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 25.8s
Slow Test: [Chrome] › login/login-consent.spec.ts#L1
[Chrome] › login/login-consent.spec.ts took 1.1m
Slow Test: [Chrome] › app-loading/guest-registration.spec.ts#L1
[Chrome] › app-loading/guest-registration.spec.ts took 24.0s
🎭 Playwright Run Summary
1 skipped 39 passed (3.0m)
🎭 Playwright Run Summary
1 skipped 53 passed (3.8m)
🎭 Playwright Run Summary
1 skipped 65 passed (4.7m)
🎭 Playwright Run Summary
56 passed (4.7m)
🎭 Playwright Run Summary
1 flaky [Chrome] › timeline/timeline.spec.ts:487:13 › Timeline › message displaying › should render EventTiles on IRC, modern (group), and bubble layout @screenshot 1 skipped 58 passed (5.7m)
🎭 Playwright Run Summary
5 failed [Chrome] › crypto/backups-mas.spec.ts:22:9 › Encryption state after registration › Key backup is enabled by default [Chrome] › crypto/backups-mas.spec.ts:31:9 › Encryption state after registration › user is prompted to set up recovery [Chrome] › crypto/backups-mas.spec.ts:48:9 › Key backup reset from elsewhere › Key backup is disabled when reset from elsewhere [Chrome] › oidc/oidc-native.spec.ts:18:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit [Chrome] › register/email.spec.ts:34:9 › Email Registration › registers an account and lands on the home page @screenshot 36 passed (12.5m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-Chrome-1 Expired
197 KB
all-blob-reports-Chrome-2 Expired
584 KB
all-blob-reports-Chrome-3 Expired
136 KB
all-blob-reports-Chrome-4 Expired
170 KB
all-blob-reports-Chrome-5 Expired
4.74 MB
all-blob-reports-Chrome-6 Expired
6.27 MB
html-report
11.5 MB
webapp Expired
27.2 MB