element-web-notify #4092
end-to-end-tests.yaml
on: repository_dispatch
Build Element-Web
2m 1s
Matrix: playwright
end-to-end-tests
1m 8s
Annotations
14 errors, 27 warnings, and 6 notices
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts:50:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue:
playwright/e2e/read-receipts/index.ts#L488
1) [Chrome] › read-receipts/new-messages-main-timeline.spec.ts:50:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue
Error: expect(received).toBeLessThan(expected)
Expected: < 30
Received: 30
Call Log:
- Timeout 5000ms exceeded while waiting on the predicate
at read-receipts/index.ts:488
486 | // https://playwright.dev/docs/test-assertions#expectpoll
487 | // .toBeLessThan doesn't have a retry mechanism, so we use .poll
> 488 | await expect
| ^
489 | .poll(async () => {
490 | return parseInt(await tile.locator(".mx_NotificationBadge_count").textContent(), 10);
491 | })
at Helpers.assertUnreadLessThan (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:488:9)
at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/new-messages-main-timeline.spec.ts:65:17
|
[Chrome] › read-receipts/redactions-thread-roots.spec.ts:108:17 › Read receipts › redactions › thread roots › Reacting to a redacted thread root leaves the room read @mergequeue:
playwright/e2e/read-receipts/redactions-thread-roots.spec.ts#L1
1) [Chrome] › read-receipts/redactions-thread-roots.spec.ts:108:17 › Read receipts › redactions › thread roots › Reacting to a redacted thread root leaves the room read @mergequeue
Test timeout of 30000ms exceeded.
|
[Chrome] › read-receipts/redactions-thread-roots.spec.ts:108:17 › Read receipts › redactions › thread roots › Reacting to a redacted thread root leaves the room read @mergequeue:
playwright/e2e/read-receipts/index.ts#L88
1) [Chrome] › read-receipts/redactions-thread-roots.spec.ts:108:17 › Read receipts › redactions › thread roots › Reacting to a redacted thread root leaves the room read @mergequeue
Error: jsHandle.evaluateHandle: Test timeout of 30000ms exceeded.
at read-receipts/index.ts:88
86 | }
87 |
> 88 | const promise = room.evaluateHandle(
| ^
89 | async (room, { message, includeThreads }) => {
90 | let ev = room.timeline.find((e) => e.getContent().body === message);
91 | if (!ev && includeThreads) {
at MessageBuilder.getMessage (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:88:30)
at MessageContentSpec.getContent (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:187:53)
at Helpers.sendMessageAsClient (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:348:61)
at Helpers.receiveMessages (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:585:9)
at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/redactions-thread-roots.spec.ts:116:17
|
[Chrome] › timeline/timeline.spec.ts:589:13 › Timeline › message displaying › should set inline start padding to a hidden event line @screenshot:
playwright/e2e/timeline/timeline.spec.ts#L612
1) [Chrome] › timeline/timeline.spec.ts:589:13 › Timeline › message displaying › should set inline start padding to a hidden event line @screenshot
Error: Timed out 5000ms waiting for expect(locator).toHaveCSS(expected)
Locator: locator('.mx_EventTile[data-layout=irc].mx_EventTile_info .mx_EventTile_line').first()
Expected string: "0px"
Received: <element(s) not found>
Call log:
- expect.toHaveCSS with timeout 5000ms
- waiting for locator('.mx_EventTile[data-layout=irc].mx_EventTile_info .mx_EventTile_line').first()
610 | await expect(
611 | page.locator(".mx_EventTile[data-layout=irc].mx_EventTile_info .mx_EventTile_line").first(),
> 612 | ).toHaveCSS("padding-inline-start", "0px");
| ^
613 |
614 | // Exclude timestamp and read marker from snapshot
615 | const screenshotOptions = {
at /home/runner/work/element-web/element-web/playwright/e2e/timeline/timeline.spec.ts:612:19
|
[Chrome] › sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L1
1) [Chrome] › sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
Test timeout of 30000ms exceeded.
|
[Chrome] › sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L406
1) [Chrome] › sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
Error: page.waitForRequest: Test timeout of 30000ms exceeded.
404 | await Promise.all([
405 | page.waitForRequest(matchRoomSubRequest(roomOId)),
> 406 | page.waitForRequest(matchRoomUnsubRequest(roomPId)),
| ^
407 | page.getByRole("treeitem", { name: "Orange", exact: true }).click(),
408 | ]);
409 |
at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:406:18
|
[Chrome] › spotlight/spotlight.spec.ts:132:9 › Spotlight › should find known public rooms:
playwright/e2e/spotlight/spotlight.spec.ts#L138
2) [Chrome] › spotlight/spotlight.spec.ts:132:9 › Spotlight › should find known public rooms ─────
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 3
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 0 elements
- unexpected value "0"
7 × locator resolved to 3 elements
- unexpected value "3"
136 | await spotlight.search(room1Name);
137 | const resultLocator = spotlight.results;
> 138 | await expect(resultLocator).toHaveCount(1);
| ^
139 | await expect(resultLocator.first()).toContainText(room1Name);
140 | await expect(resultLocator.first()).toContainText("View");
141 | await resultLocator.first().click();
at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:138:37
|
[Chrome] › spotlight/spotlight.spec.ts:146:9 › Spotlight › should find unknown public rooms:
playwright/e2e/spotlight/spotlight.spec.ts#L152
3) [Chrome] › spotlight/spotlight.spec.ts:146:9 › Spotlight › should find unknown public rooms ───
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 2
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 0 elements
- unexpected value "0"
7 × locator resolved to 2 elements
- unexpected value "2"
150 | await spotlight.search(room2Name);
151 | const resultLocator = spotlight.results;
> 152 | await expect(resultLocator).toHaveCount(1);
| ^
153 | await expect(resultLocator.first()).toContainText(room2Name);
154 | await expect(resultLocator.first()).toContainText("Join");
155 | await resultLocator.first().click();
at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:152:37
|
[Chrome] › spotlight/spotlight.spec.ts:161:9 › Spotlight › should find unknown public world readable rooms:
playwright/e2e/spotlight/spotlight.spec.ts#L167
4) [Chrome] › spotlight/spotlight.spec.ts:161:9 › Spotlight › should find unknown public world readable rooms
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 2
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 0 elements
- unexpected value "0"
7 × locator resolved to 2 elements
- unexpected value "2"
165 | await spotlight.search(room3Name);
166 | const resultLocator = spotlight.results;
> 167 | await expect(resultLocator).toHaveCount(1);
| ^
168 | await expect(resultLocator.first()).toContainText(room3Name);
169 | await expect(resultLocator.first()).toContainText("View");
170 | await resultLocator.first().click();
at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:167:37
|
[Chrome] › spotlight/spotlight.spec.ts:220:9 › Spotlight › should find unknown people:
playwright/e2e/spotlight/spotlight.spec.ts#L226
5) [Chrome] › spotlight/spotlight.spec.ts:220:9 › Spotlight › should find unknown people ─────────
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 3
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 0 elements
- unexpected value "0"
7 × locator resolved to 3 elements
- unexpected value "3"
224 | await spotlight.search(bot2Name);
225 | const resultLocator = spotlight.results;
> 226 | await expect(resultLocator).toHaveCount(1);
| ^
227 | await expect(resultLocator.first()).toContainText(bot2Name);
228 | await resultLocator.first().click();
229 | await expect(roomHeaderName(page)).toHaveText(bot2Name);
at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:226:37
|
[Chrome] › spotlight/spotlight.spec.ts:321:9 › Spotlight › should allow opening group chat dialog:
playwright/e2e/spotlight/spotlight.spec.ts#L329
6) [Chrome] › spotlight/spotlight.spec.ts:321:9 › Spotlight › should allow opening group chat dialog
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 4
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
9 × locator resolved to 4 elements
- unexpected value "4"
327 |
328 | const resultLocator = spotlight.results;
> 329 | await expect(resultLocator).toHaveCount(1);
| ^
330 | await expect(resultLocator.first()).toContainText(bot2Name);
331 |
332 | await expect(spotlight.dialog.locator(".mx_SpotlightDialog_startGroupChat")).toContainText(
at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:329:37
|
[Chrome] › spotlight/spotlight.spec.ts:339:9 › Spotlight › should close spotlight after starting a DM:
playwright/e2e/spotlight/spotlight.spec.ts#L27
7) [Chrome] › spotlight/spotlight.spec.ts:339:9 › Spotlight › should close spotlight after starting a DM
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 2
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
9 × locator resolved to 2 elements
- unexpected value "2"
25 | await expect(spotlight.dialog.locator(".mx_Spinner")).not.toBeAttached();
26 | const result = spotlight.results;
> 27 | await expect(result).toHaveCount(1);
| ^
28 | await expect(result.first()).toContainText(name);
29 | await result.first().click();
30 |
at startDM (/home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:27:26)
at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:340:9
|
[Chrome] › spotlight/spotlight.spec.ts:344:9 › Spotlight › should show the same user only once:
playwright/e2e/spotlight/spotlight.spec.ts#L27
8) [Chrome] › spotlight/spotlight.spec.ts:344:9 › Spotlight › should show the same user only once
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 2
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
9 × locator resolved to 2 elements
- unexpected value "2"
25 | await expect(spotlight.dialog.locator(".mx_Spinner")).not.toBeAttached();
26 | const result = spotlight.results;
> 27 | await expect(result).toHaveCount(1);
| ^
28 | await expect(result.first()).toContainText(name);
29 | await result.first().click();
30 |
at startDM (/home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:27:26)
at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:345:9
|
[Chrome] › spotlight/spotlight.spec.ts:357:9 › Spotlight › should be able to navigate results via keyboard:
playwright/e2e/spotlight/spotlight.spec.ts#L364
9) [Chrome] › spotlight/spotlight.spec.ts:357:9 › Spotlight › should be able to navigate results via keyboard
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 2
Received: 4
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
3 × locator resolved to 1 element
- unexpected value "1"
6 × locator resolved to 4 elements
- unexpected value "4"
362 |
363 | let resultLocator = spotlight.results;
> 364 | await expect(resultLocator).toHaveCount(2);
| ^
365 | await expect(resultLocator.first()).toHaveAttribute("aria-selected", "true");
366 | await expect(resultLocator.last()).toHaveAttribute("aria-selected", "false");
367 |
at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:364:37
|
Slow Test:
[Chrome] › read-receipts/high-level.spec.ts#L1
[Chrome] › read-receipts/high-level.spec.ts took 3.0m
|
Slow Test:
[Chrome] › read-receipts/new-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/new-messages-in-threads.spec.ts took 58.5s
|
Slow Test:
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts took 28.0s
|
Slow Test:
[Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 58.1s
|
Slow Test:
[Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 57.6s
|
Slow Test:
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts took 38.7s
|
Slow Test:
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts took 38.4s
|
Slow Test:
[Chrome] › invite/invite-dialog.spec.ts#L1
[Chrome] › invite/invite-dialog.spec.ts took 30.7s
|
Slow Test:
[Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 52.9s
|
Slow Test:
[Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 42.4s
|
Slow Test:
[Chrome] › audio-player/audio-player.spec.ts#L1
[Chrome] › audio-player/audio-player.spec.ts took 38.8s
|
Slow Test:
[Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 36.1s
|
Slow Test:
[Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 34.1s
|
Slow Test:
[Chrome] › read-receipts/redactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/redactions-in-threads.spec.ts took 1.5m
|
Slow Test:
[Chrome] › read-receipts/redactions-main-timeline.spec.ts#L1
[Chrome] › read-receipts/redactions-main-timeline.spec.ts took 1.1m
|
Slow Test:
[Chrome] › read-receipts/reactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/reactions-in-threads.spec.ts took 57.1s
|
Slow Test:
[Chrome] › read-receipts/read-receipts.spec.ts#L1
[Chrome] › read-receipts/read-receipts.spec.ts took 46.2s
|
Slow Test:
[Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 24.1s
|
Slow Test:
[Chrome] › login/login-consent.spec.ts#L1
[Chrome] › login/login-consent.spec.ts took 1.1m
|
Slow Test:
[Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 31.7s
|
Slow Test:
[Chrome] › crypto/backups-mas.spec.ts#L1
[Chrome] › crypto/backups-mas.spec.ts took 28.1s
|
Slow Test:
[Chrome] › user-onboarding/user-onboarding-new.spec.ts#L1
[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 23.9s
|
Slow Test:
[Chrome] › app-loading/guest-registration.spec.ts#L1
[Chrome] › app-loading/guest-registration.spec.ts took 21.2s
|
Slow Test:
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 47.7s
|
Slow Test:
[Chrome] › room/room-header.spec.ts#L1
[Chrome] › room/room-header.spec.ts took 34.5s
|
Slow Test:
[Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 30.0s
|
Slow Test:
[Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 17.0s
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts:50:17 › Read receipts › new messages › in the main timeline › Reading an older message leaves the room unread @mergequeue
43 skipped
32 passed (5.6m)
|
🎭 Playwright Run Summary
2 skipped
79 passed (6.2m)
|
🎭 Playwright Run Summary
82 passed (6.9m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › read-receipts/redactions-thread-roots.spec.ts:108:17 › Read receipts › redactions › thread roots › Reacting to a redacted thread root leaves the room read @mergequeue
2 skipped
74 passed (7.3m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › timeline/timeline.spec.ts:589:13 › Timeline › message displaying › should set inline start padding to a hidden event line @screenshot
70 passed (7.2m)
|
🎭 Playwright Run Summary
9 flaky
[Chrome] › sliding-sync/sliding-sync.spec.ts:365:5 › Sliding Sync › should send unsubscribe_rooms for every room switch
[Chrome] › spotlight/spotlight.spec.ts:132:9 › Spotlight › should find known public rooms ──────
[Chrome] › spotlight/spotlight.spec.ts:146:9 › Spotlight › should find unknown public rooms ────
[Chrome] › spotlight/spotlight.spec.ts:161:9 › Spotlight › should find unknown public world readable rooms
[Chrome] › spotlight/spotlight.spec.ts:220:9 › Spotlight › should find unknown people ──────────
[Chrome] › spotlight/spotlight.spec.ts:321:9 › Spotlight › should allow opening group chat dialog
[Chrome] › spotlight/spotlight.spec.ts:339:9 › Spotlight › should close spotlight after starting a DM
[Chrome] › spotlight/spotlight.spec.ts:344:9 › Spotlight › should show the same user only once ─
[Chrome] › spotlight/spotlight.spec.ts:357:9 › Spotlight › should be able to navigate results via keyboard
2 skipped
72 passed (9.2m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-Chrome-1
Expired
|
651 KB |
|
all-blob-reports-Chrome-2
Expired
|
295 KB |
|
all-blob-reports-Chrome-3
Expired
|
5.66 MB |
|
all-blob-reports-Chrome-4
Expired
|
4.48 MB |
|
all-blob-reports-Chrome-5
Expired
|
39.3 MB |
|
all-blob-reports-Chrome-6
Expired
|
4.38 MB |
|
html-report
|
47.1 MB |
|
webapp
Expired
|
28.7 MB |
|