Skip to content

Milo Nala Daily Run #98

Milo Nala Daily Run

Milo Nala Daily Run #98

Triggered via schedule March 14, 2024 16:15
Status Failure
Total duration 8m 46s
Artifacts

milo.daily.yml

on: schedule
Matrix: Running tests
Fit to window
Zoom out
Zoom in

Annotations

16 errors, 6 warnings, and 3 notices
[milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @Table (highlight: tests/milo/table.block.test.js#L137
1) [milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @table (highlight, collapse, sticky),@table @smoke @regression @milo Error: expect(locator).toHaveAttribute(expected) Locator: locator('.table').first().locator('.row-highlight') Expected string: "top: 64px;" Received string: "" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('.table').first().locator('.row-highlight') - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" 135 | await expect(await table.collapseStickyTable).toBeVisible(); 136 | > 137 | expect(await table.highlightRow).toHaveAttribute('style', 'top: 64px;'); | ^ 138 | expect(await table.highlightRow).toHaveAttribute('class', 'row row-1 row-highlight top-border-transparent'); 139 | 140 | expect(await table.stickyRow).toHaveAttribute('style', 'top: 114px;'); at /home/runner/work/nala/nala/tests/milo/table.block.test.js:137:40 at /home/runner/work/nala/nala/tests/milo/table.block.test.js:133:5
[milo-live-firefox] › table.block.test.js:123:7 › Milo Table block feature test suite › @Table (highlight: tests/milo/table.block.test.js#L137
2) [milo-live-firefox] › table.block.test.js:123:7 › Milo Table block feature test suite › @table (highlight, collapse, sticky),@table @smoke @regression @milo Error: expect(locator).toHaveAttribute(expected) Locator: locator('.table').first().locator('.row-highlight') Expected string: "top: 64px;" Received string: "" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('.table').first().locator('.row-highlight') - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" 135 | await expect(await table.collapseStickyTable).toBeVisible(); 136 | > 137 | expect(await table.highlightRow).toHaveAttribute('style', 'top: 64px;'); | ^ 138 | expect(await table.highlightRow).toHaveAttribute('class', 'row row-1 row-highlight top-border-transparent'); 139 | 140 | expect(await table.stickyRow).toHaveAttribute('style', 'top: 114px;'); at /home/runner/work/nala/nala/tests/milo/table.block.test.js:137:40 at /home/runner/work/nala/nala/tests/milo/table.block.test.js:133:5
[milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @Table (highlight: tests\milo\table.block.test.js#L137
1) [milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @table (highlight, collapse, sticky),@table @smoke @regression @milo Error: expect(locator).toHaveAttribute(expected) Locator: locator('.table').first().locator('.row-highlight') Expected string: "top: 64px;" Received string: "" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('.table').first().locator('.row-highlight') - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" 135 | await expect(await table.collapseStickyTable).toBeVisible(); 136 | > 137 | expect(await table.highlightRow).toHaveAttribute('style', 'top: 64px;'); | ^ 138 | expect(await table.highlightRow).toHaveAttribute('class', 'row row-1 row-highlight top-border-transparent'); 139 | 140 | expect(await table.stickyRow).toHaveAttribute('style', 'top: 114px;'); at D:\a\nala\nala\tests\milo\table.block.test.js:137:40 at D:\a\nala\nala\tests\milo\table.block.test.js:133:5
[milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @Table (highlight: tests\milo\table.block.test.js#L137
1) [milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @table (highlight, collapse, sticky),@table @smoke @regression @milo Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveAttribute(expected) Locator: locator('.table').first().locator('.row-highlight') Expected string: "top: 64px;" Received string: "" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('.table').first().locator('.row-highlight') - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" 135 | await expect(await table.collapseStickyTable).toBeVisible(); 136 | > 137 | expect(await table.highlightRow).toHaveAttribute('style', 'top: 64px;'); | ^ 138 | expect(await table.highlightRow).toHaveAttribute('class', 'row row-1 row-highlight top-border-transparent'); 139 | 140 | expect(await table.stickyRow).toHaveAttribute('style', 'top: 114px;'); at D:\a\nala\nala\tests\milo\table.block.test.js:137:40 at D:\a\nala\nala\tests\milo\table.block.test.js:133:5
[milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @Table (highlight: tests\milo\table.block.test.js#L137
1) [milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @table (highlight, collapse, sticky),@table @smoke @regression @milo Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toHaveAttribute(expected) Locator: locator('.table').first().locator('.row-highlight') Expected string: "top: 64px;" Received string: "" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('.table').first().locator('.row-highlight') - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" 135 | await expect(await table.collapseStickyTable).toBeVisible(); 136 | > 137 | expect(await table.highlightRow).toHaveAttribute('style', 'top: 64px;'); | ^ 138 | expect(await table.highlightRow).toHaveAttribute('class', 'row row-1 row-highlight top-border-transparent'); 139 | 140 | expect(await table.stickyRow).toHaveAttribute('style', 'top: 114px;'); at D:\a\nala\nala\tests\milo\table.block.test.js:137:40 at D:\a\nala\nala\tests\milo\table.block.test.js:133:5
Running tests (windows-latest)
Process completed with exit code 1.
[milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @Table (highlight: tests/milo/table.block.test.js#L137
1) [milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @table (highlight, collapse, sticky),@table @smoke @regression @milo Error: expect(locator).toHaveAttribute(expected) Locator: locator('.table').first().locator('.row-highlight') Expected string: "top: 64px;" Received string: "" Call log: - expect.toHaveAttribute with timeout 5000ms - waiting for locator('.table').first().locator('.row-highlight') - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" - locator resolved to <div role="row" class="row row-1 row-highlight">…</div> - unexpected value "null" 135 | await expect(await table.collapseStickyTable).toBeVisible(); 136 | > 137 | expect(await table.highlightRow).toHaveAttribute('style', 'top: 64px;'); | ^ 138 | expect(await table.highlightRow).toHaveAttribute('class', 'row row-1 row-highlight top-border-transparent'); 139 | 140 | expect(await table.stickyRow).toHaveAttribute('style', 'top: 114px;'); at /Users/runner/work/nala/nala/tests/milo/table.block.test.js:137:40 at /Users/runner/work/nala/nala/tests/milo/table.block.test.js:133:5
[milo-live-chromium] › video.block.test.js:160:7 › Milo Video Block test suite › @MPC Video Autoplay Looping: tests/milo/video.block.test.js#L174
2) [milo-live-chromium] › video.block.test.js:160:7 › Milo Video Block test suite › @mpc Video Autoplay Looping,@video @smoke @regression @milo › step-2: Verify video block content/specs Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: frameLocator('iframe').first().locator('.mpc-player button[aria-label="Mute"]') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for frameLocator('iframe').first().locator('.mpc-player button[aria-label="Mute"]') 172 | await expect(await video.miloVideo).toBeVisible(); 173 | await expect(await video.iframe).toBeVisible(); > 174 | await expect(await video.mpcMutedButton).toBeVisible(); | ^ 175 | 176 | await expect(await video.iframe).toHaveAttribute('title', data.iframeTitle); 177 | await expect(await video.iframe).toHaveAttribute('src', data.source); at /Users/runner/work/nala/nala/tests/milo/video.block.test.js:174:48 at /Users/runner/work/nala/nala/tests/milo/video.block.test.js:171:5
[milo-live-chromium] › video.block.test.js:160:7 › Milo Video Block test suite › @MPC Video Autoplay Looping: tests/milo/video.block.test.js#L174
2) [milo-live-chromium] › video.block.test.js:160:7 › Milo Video Block test suite › @mpc Video Autoplay Looping,@video @smoke @regression @milo › step-2: Verify video block content/specs Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: frameLocator('iframe').first().locator('.mpc-player button[aria-label="Mute"]') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for frameLocator('iframe').first().locator('.mpc-player button[aria-label="Mute"]') 172 | await expect(await video.miloVideo).toBeVisible(); 173 | await expect(await video.iframe).toBeVisible(); > 174 | await expect(await video.mpcMutedButton).toBeVisible(); | ^ 175 | 176 | await expect(await video.iframe).toHaveAttribute('title', data.iframeTitle); 177 | await expect(await video.iframe).toHaveAttribute('src', data.source); at /Users/runner/work/nala/nala/tests/milo/video.block.test.js:174:48 at /Users/runner/work/nala/nala/tests/milo/video.block.test.js:171:5
[milo-live-firefox] › accordion.block.test.js:72:7 › Milo Accordion Block test suite › @Accordion (seo): tests/milo/accordion.block.test.js#L96
3) [milo-live-firefox] › accordion.block.test.js:72:7 › Milo Accordion Block test suite › @accordion (seo),@accordion @accordion-seo @smoke @regression @milo › step-3: Verify analytics attributes Error: expect(received).toBeTruthy() Received: false 94 | 95 | await test.step('step-3: Verify analytics attributes', async () => { > 96 | expect(await webUtil.verifyAttributes_(accordion.accordion, accordion.attributes['analytics']['accordion.daa-lh'])).toBeTruthy(); | ^ 97 | }); 98 | 99 | await test.step('step-4: Verify browser console errors', async () => { at /Users/runner/work/nala/nala/tests/milo/accordion.block.test.js:96:123 at /Users/runner/work/nala/nala/tests/milo/accordion.block.test.js:95:5
[milo-live-firefox] › accordion.block.test.js:106:7 › Milo Accordion Block test suite › @Accordion (quiet: tests/milo/accordion.block.test.js#L133
4) [milo-live-firefox] › accordion.block.test.js:106:7 › Milo Accordion Block test suite › @accordion (quiet, max-width-12-desktop-large),@accordion @accordion-quiet-max @smoke @regression @milo › step-3: Verify analytics attributes Error: expect(received).toBeTruthy() Received: false 131 | 132 | await test.step('step-3: Verify analytics attributes', async () => { > 133 | expect(await webUtil.verifyAttributes_(accordion.accordion, accordion.attributes['analytics']['accordion.daa-lh'])).toBeTruthy(); | ^ 134 | }); 135 | 136 | await test.step('step-4: Verify browser console errors', async () => { at /Users/runner/work/nala/nala/tests/milo/accordion.block.test.js:133:123 at /Users/runner/work/nala/nala/tests/milo/accordion.block.test.js:132:5
[milo-live-firefox] › marketo.block.test.js:92:7 › Marketo block test suite › @marketo evaluate template: tests/milo/marketo.block.test.js#L1
5) [milo-live-firefox] › marketo.block.test.js:92:7 › Marketo block test suite › @Marketo evaluate template,@Marketo @marketoEvaluateTemplate @milo @smoke @regression › step-3: Verify the form submission redirect Test timeout of 30000ms exceeded.
[milo-live-firefox] › marketo.block.test.js:92:7 › Marketo block test suite › @marketo evaluate template: tests/milo/marketo.block.test.js#L107
5) [milo-live-firefox] › marketo.block.test.js:92:7 › Marketo block test suite › @Marketo evaluate template,@Marketo @marketoEvaluateTemplate @milo @smoke @regression › step-3: Verify the form submission redirect Error: expect(locator).not.toHaveURL(expected) Locator: locator(':root') Expected string: not "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-evaluate-template" Received string: "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-evaluate-template" Call log: - expect.not.toHaveURL with timeout 15000ms - waiting for locator(':root') - locator resolved to <html dir="ltr" lang="en-US">…</html> - unexpected value "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-evaluate-template" - locator resolved to <html dir="ltr" lang="en-US">…</html> - unexpected value "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-evaluate-template" - locator resolved to <html dir="ltr" lang="en-US">…</html> - unexpected value "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-evaluate-template" - locator resolved to <html dir="ltr" lang="en-US">…</html> - unexpected value "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-evaluate-template" 105 | 106 | await test.step('step-3: Verify the form submission redirect', async () => { > 107 | await expect(page).not.toHaveURL(testPage, { timeout: 15000 }); | ^ 108 | }); 109 | }); 110 | at /Users/runner/work/nala/nala/tests/milo/marketo.block.test.js:107:30 at /Users/runner/work/nala/nala/tests/milo/marketo.block.test.js:106:16
[milo-live-firefox] › marketo.block.test.js:111:7 › Marketo block test suite › @marketo webinar template: tests/milo/marketo.block.test.js#L1
6) [milo-live-firefox] › marketo.block.test.js:111:7 › Marketo block test suite › @Marketo webinar template,@Marketo @marketoWebinarTemplate @milo @smoke @regression › step-3: Verify the form submission redirect Test timeout of 30000ms exceeded.
[milo-live-firefox] › marketo.block.test.js:111:7 › Marketo block test suite › @marketo webinar template: tests/milo/marketo.block.test.js#L126
6) [milo-live-firefox] › marketo.block.test.js:111:7 › Marketo block test suite › @Marketo webinar template,@Marketo @marketoWebinarTemplate @milo @smoke @regression › step-3: Verify the form submission redirect Error: expect(locator).not.toHaveURL(expected) Locator: locator(':root') Expected string: not "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-webinar-template" Received string: "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-webinar-template" Call log: - expect.not.toHaveURL with timeout 15000ms - waiting for locator(':root') - locator resolved to <html dir="ltr" lang="en-US">…</html> - unexpected value "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-webinar-template" - locator resolved to <html dir="ltr" lang="en-US">…</html> - unexpected value "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-webinar-template" - locator resolved to <html dir="ltr" lang="en-US">…</html> - unexpected value "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-webinar-template" - locator resolved to <html dir="ltr" lang="en-US">…</html> - unexpected value "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-webinar-template" - locator resolved to <html dir="ltr" lang="en-US">…</html> - unexpected value "https://main--milo--adobecom.hlx.live/drafts/nala/blocks/marketo/content-webinar-template" 124 | 125 | await test.step('step-3: Verify the form submission redirect', async () => { > 126 | await expect(page).not.toHaveURL(testPage, { timeout: 15000 }); | ^ 127 | }); 128 | }); 129 | at /Users/runner/work/nala/nala/tests/milo/marketo.block.test.js:126:30 at /Users/runner/work/nala/nala/tests/milo/marketo.block.test.js:125:16
[milo-live-firefox] › marketo.block.test.js:130:7 › Marketo block test suite › @marketo trial template: tests/milo/marketo.block.test.js#L1
7) [milo-live-firefox] › marketo.block.test.js:130:7 › Marketo block test suite › @Marketo trial template,@Marketo @marketoTrialTemplate @milo @smoke @regression › step-3: Verify the form submission redirect Test timeout of 30000ms exceeded.
Running tests (ubuntu-latest)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-node@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Running tests (ubuntu-latest)
No files were found with the provided path: nala-results.json. No artifacts will be uploaded.
Running tests (windows-latest)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-node@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Running tests (windows-latest)
No files were found with the provided path: nala-results.json. No artifacts will be uploaded.
Running tests (macos-latest)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-node@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Running tests (macos-latest)
No files were found with the provided path: nala-results.json. No artifacts will be uploaded.
🎭 Playwright Run Summary
2 flaky [milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @table (highlight, collapse, sticky),@table @smoke @regression @milo [milo-live-firefox] › table.block.test.js:123:7 › Milo Table block feature test suite › @table (highlight, collapse, sticky),@table @smoke @regression @milo 30 skipped 304 passed (2.3m)
🎭 Playwright Run Summary
1 failed [milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @table (highlight, collapse, sticky),@table @smoke @regression @milo 30 skipped 305 passed (3.2m)
🎭 Playwright Run Summary
8 flaky [milo-live-chromium] › table.block.test.js:123:7 › Milo Table block feature test suite › @table (highlight, collapse, sticky),@table @smoke @regression @milo [milo-live-chromium] › video.block.test.js:160:7 › Milo Video Block test suite › @mpc Video Autoplay Looping,@video @smoke @regression @milo [milo-live-firefox] › accordion.block.test.js:72:7 › Milo Accordion Block test suite › @accordion (seo),@accordion @accordion-seo @smoke @regression @milo [milo-live-firefox] › accordion.block.test.js:106:7 › Milo Accordion Block test suite › @accordion (quiet, max-width-12-desktop-large),@accordion @accordion-quiet-max @smoke @regression @milo [milo-live-firefox] › marketo.block.test.js:92:7 › Marketo block test suite › @Marketo evaluate template,@Marketo @marketoEvaluateTemplate @milo @smoke @regression [milo-live-firefox] › marketo.block.test.js:111:7 › Marketo block test suite › @Marketo webinar template,@Marketo @marketoWebinarTemplate @milo @smoke @regression [milo-live-firefox] › marketo.block.test.js:130:7 › Marketo block test suite › @Marketo trial template,@Marketo @marketoTrialTemplate @milo @smoke @regression [milo-live-firefox] › table.block.test.js:123:7 › Milo Table block feature test suite › @table (highlight, collapse, sticky),@table @smoke @regression @milo 30 skipped 298 passed (7.2m)