Skip to content

Support for client-side A/B testing #2807

Support for client-side A/B testing

Support for client-side A/B testing #2807

Triggered via pull request January 16, 2025 11:31
Status Failure
Total duration 6m 3s
Artifacts

checks.yml

on: pull_request
Matrix: build
Matrix: playwright-tests
Fit to window
Zoom out
Zoom in

Annotations

9 errors, 20 warnings, and 8 notices
lint
Process completed with exit code 2.
[chromium] › fire-button.spec.js:108:9 › Fire Button › getBurnOptions: integration-test/fire-button.spec.js#L151
1) [chromium] › fire-button.spec.js:108:9 › Fire Button › getBurnOptions ───────────────────────── Error: expect(received).toHaveLength(expected) Expected length: 5 Received length: 6 Received array: [{"descriptionStats": {"clearHistory": true, "cookies": 2, "duration": "hour", "openTabs": 6, "pinnedTabs": 0}, "name": "LastHour", "options": {"since": 1737023614604}}, {"descriptionStats": {"clearHistory": true, "cookies": 2, "duration": "day", "openTabs": 6, "pinnedTabs": 0}, "name": "Last24Hour", "options": {"since": 1736940814604}}, {"descriptionStats": {"clearHistory": true, "cookies": 2, "duration": "week", "openTabs": 6, "pinnedTabs": 0}, "name": "Last7days", "options": {"since": 1736422414604}}, {"descriptionStats": {"clearHistory": true, "cookies": 2, "duration": "month", "openTabs": 6, "pinnedTabs": 0}, "name": "Last4Weeks", "options": {"since": 1734608014604}}, {"descriptionStats": {"clearHistory": true, "cookies": 2, "duration": "all", "openTabs": 6, "pinnedTabs": 0}, "name": "AllTime", "options": {}}, {"descriptionStats": {"clearHistory": true, "cookies": 1, "duration": "all", "openTabs": 2, "pinnedTabs": 0, "site": "privacy-test-pages.site"}, "name": "CurrentSite", "options": {"origins": ["https://privacy-test-pages.site", "http://privacy-test-pages.site"]}, "selected": true}] 149 | { 150 | const { options } = await fireButton.evaluate((f) => f.getBurnOptions()); > 151 | expect(options).toHaveLength(5); // only 5 time frames | ^ 152 | } 153 | await pages[0].bringToFront(); 154 | at /home/runner/work/duckduckgo-privacy-extension/duckduckgo-privacy-extension/integration-test/fire-button.spec.js:151:29
[chromium] › request-blocking.spec.js:194:9 › Test request blocking › protection toggle disables blocking: integration-test/request-blocking.spec.js#L1
1) [chromium] › request-blocking.spec.js:194:9 › Test request blocking › protection toggle disables blocking Test timeout of 30000ms exceeded.
[chromium] › fire-button.spec.js:266:13 › Fire Button › burn › clears all browser storage: integration-test/fire-button.spec.js#L292
1) [chromium] › fire-button.spec.js:266:13 › Fire Button › burn › clears all browser storage ───── Error: localStorage data should be cleared expect(received).not.toBe(expected) // Object.is equality Expected: not "269" 290 | ]; 291 | for (const api of apis) { > 292 | expect(results.find((r) => r.id === api).value, `${api} data should be cleared`).not.toBe(storedValue); | ^ 293 | } 294 | }); 295 | at /home/runner/work/duckduckgo-privacy-extension/duckduckgo-privacy-extension/integration-test/fire-button.spec.js:292:102
[chromium] › gpc.spec.js:17:5 › Ensure GPC is injected into frames: integration-test/gpc.spec.js#L38
2) [chromium] › gpc.spec.js:17:5 › Ensure GPC is injected into frames ──────────────────────────── Error: expect(received).toEqual(expected) // deep equality Expected: true Received: undefined 36 | const gpc2 = await getGPCValueOfContext(iframeInstance); 37 | > 38 | expect(gpc).toEqual(true); | ^ 39 | expect(gpc).toEqual(gpc2); 40 | } 41 | at /home/runner/work/duckduckgo-privacy-extension/duckduckgo-privacy-extension/integration-test/gpc.spec.js:38:21
playwright-tests (playwright, 2/4)
RPC failed; curl 56 GnuTLS recv error (-9): Error decoding the received TLS packet.
playwright-tests (playwright, 2/4)
6282 bytes of body are still expected
playwright-tests (playwright, 2/4)
early EOF
playwright-tests (playwright, 2/4)
fetch-pack: invalid index-pack output
build (22, ubuntu-latest, release-firefox)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
lint
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
build (22, ubuntu-latest, release-chrome)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
playwright-tests (playwright, 3/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
playwright-tests (playwright, 3/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright-mv2, 4/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
playwright-tests (playwright-mv2, 4/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright, 4/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
playwright-tests (playwright, 4/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
Slow Test: [chromium] › storage-blocking.spec.js#L1
[chromium] › storage-blocking.spec.js took 39.9s
playwright-tests (playwright-mv2, 2/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
playwright-tests (playwright-mv2, 2/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright-mv2, 3/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
playwright-tests (playwright-mv2, 3/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright-mv2, 1/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
playwright-tests (playwright-mv2, 1/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright, 1/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
playwright-tests (playwright, 1/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
playwright-tests (playwright, 2/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
playwright-tests (playwright, 2/4)
No files were found with the provided path: playwright-report/. No artifacts will be uploaded.
🎭 Playwright Run Summary
1 flaky [chromium] › fire-button.spec.js:108:9 › Fire Button › getBurnOptions ────────────────────────── 14 passed (48.2s)
🎭 Playwright Run Summary
16 passed (50.4s)
🎭 Playwright Run Summary
1 flaky [chromium] › request-blocking.spec.js:194:9 › Test request blocking › protection toggle disables blocking 14 passed (1.0m)
🎭 Playwright Run Summary
3 skipped 14 passed (37.9s)
🎭 Playwright Run Summary
2 flaky [chromium] › fire-button.spec.js:266:13 › Fire Button › burn › clears all browser storage ────── [chromium] › gpc.spec.js:17:5 › Ensure GPC is injected into frames ───────────────────────────── 14 passed (58.5s)
🎭 Playwright Run Summary
2 skipped 15 passed (44.2s)
🎭 Playwright Run Summary
2 skipped 14 passed (42.9s)
🎭 Playwright Run Summary
3 skipped 12 passed (35.1s)