Skip to content

feat(context-agent): tool status callbacks and process support (#6451) #24909

feat(context-agent): tool status callbacks and process support (#6451)

feat(context-agent): tool status callbacks and process support (#6451) #24909

Triggered via push December 27, 2024 19:44
Status Failure
Total duration 16m 19s
Artifacts 1

ci.yml

on: push
fast_tests_matrix_prep
0s
fast_tests_matrix_prep
slow_tests_matrix_prep
0s
slow_tests_matrix_prep
Matrix: test-integration
Matrix: test-unit
Matrix: test-e2e
Fit to window
Zoom out
Zoom in

Annotations

16 errors, 18 warnings, and 2 notices
test-e2e (windows)
npm failed with exit code 1
test-e2e (windows)
Process completed with exit code 1.
src/autocomplete.test.ts > Autocomplete: agent/src/TestClient.ts#L890
Error: PollyError: [Polly] [adapter:node-http] Recording for the following request is not found and `recordIfMissing` is `false`.. To fix this problem, run the following commands to update the HTTP recordings: source agent/scripts/export-cody-http-recording-tokens.sh pnpm update-agent-recordings ❯ TestClient.shutdownAndExit src/TestClient.ts:890:23 ❯ TestClient.afterAll src/TestClient.ts:877:9 ❯ src/autocomplete.test.ts:23:9
test-unit (windows, 20)
Process completed with exit code 1.
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection: vscode/test/e2e/chat-keyboard-shortcuts.test.ts#L1
1) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ───────────────────────── Test timeout of 30000ms exceeded.
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection: vscode/test/e2e/common.ts#L198
1) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ───────────────────────── Error: locator.fill: Target page, context or browser has been closed Call log: - waiting for getByPlaceholder('Type the name of a command to run.') - locator resolved to <input wrap="off" type="text" class="input" role="combobox" autocorrect="off" spellcheck="false" aria-label="input" autocapitalize="off" aria-haspopup="menu" aria-expanded="true" aria-autocomplete="list" aria-controls="quickInput_list" aria-activedescendant="list_id_4_0" aria-describedby="quickInput_message" placeholder="Type the name of a command to run."/> - fill("buzz.ts") - attempting fill action - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #1 - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #2 - waiting 20ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #3 - waiting 100ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #4 - waiting 100ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #5 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #6 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #7 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #8 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #9 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #10 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #11 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #12 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #13 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #14 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #15 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #16 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #17 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #18 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #19 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #20 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fil
test-e2e (macos)
Worker teardown timeout of 30000ms exceeded. Failed worker ran 22 tests, last 10 tests were: test/e2e/chat-context.test.ts:11:5 › chat followup context test/e2e/chat-history.test.ts:17:3 › restore chat from sidebar history view test/e2e/chat-history.test.ts:50:3 › delete chat from sidebar history view test/e2e/chat-input.test.ts:25:3 › chat input focus test/e2e/chat-input.test.ts:96:69 › chat toolbar and row UI test/e2e/chat-input.test.ts:192:3 › chat model selector test/e2e/chat-input.test.ts:243:3 › editing follow-up messages in chat view test/e2e/chat-keyboard-shortcuts.test.ts:14:5 › chat keyboard shortcuts for sidebar chat test/e2e/chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection test/e2e/chat-messages.test.ts:17:5 › chat assistant response code buttons
test-e2e (macos)
Worker teardown timeout of 30000ms exceeded. Failed worker ran 1 test: test/e2e/chat-messages.test.ts:17:5 › chat assistant response code buttons
chat-messages.test.ts:17:5 › chat assistant response code buttons: vscode/test/e2e/chat-messages.test.ts#L1
1) chat-messages.test.ts:17:5 › chat assistant response code buttons ───────────────────────────── Tearing down "app" exceeded the test timeout of 30000ms.
chat-messages.test.ts:17:5 › chat assistant response code buttons: vscode/test/e2e/chat-messages.test.ts#L1
1) chat-messages.test.ts:17:5 › chat assistant response code buttons ───────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Tearing down "app" exceeded the test timeout of 30000ms.
enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled: vscode/test/e2e/enterprise-server-sent-models.test.ts#L1
2) enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled Test timeout of 30000ms exceeded.
enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled: vscode/test/e2e/enterprise-server-sent-models.test.ts#L26
2) enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled Error: locator.click: Target page, context or browser has been closed Call log: - waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('listbox', { name: 'Suggestions' }).getByRole('option', { name: 'Titan' }) 24 | await modelSelect.click() 25 | const modelChoices = chatFrame.getByRole('listbox', { name: 'Suggestions' }) > 26 | await modelChoices.getByRole('option', { name: 'Titan' }).click() | ^ 27 | await expect(modelSelect).toHaveText(/^Titan/) 28 | 29 | // Close chat window and create a new one and assert the default model is preserved at /Users/runner/work/cody/cody/vscode/test/e2e/enterprise-server-sent-models.test.ts:26:63
enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled: vscode/test/e2e/enterprise-server-sent-models.test.ts#L1
2) enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled: vscode/test/e2e/enterprise-server-sent-models.test.ts#L26
2) enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.click: Target page, context or browser has been closed Call log: - waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('listbox', { name: 'Suggestions' }).getByRole('option', { name: 'Titan' }) 24 | await modelSelect.click() 25 | const modelChoices = chatFrame.getByRole('listbox', { name: 'Suggestions' }) > 26 | await modelChoices.getByRole('option', { name: 'Titan' }).click() | ^ 27 | await expect(modelSelect).toHaveText(/^Titan/) 28 | 29 | // Close chat window and create a new one and assert the default model is preserved at /Users/runner/work/cody/cody/vscode/test/e2e/enterprise-server-sent-models.test.ts:26:63
mention-repository.test.ts:14:18 › @-mention repository: vscode/test/e2e/mention-repository.test.ts#L45
3) mention-repository.test.ts:14:18 › @-mention repository ─────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('textbox', { name: 'Chat message' }).last().locator('.context-item-mention-node') - Expected - 3 + Received + 1 - Array [ - "codehost.example/user/myrepo", - ] + Array [] Call log: - expect.toHaveText with timeout 5000ms - waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('textbox', { name: 'Chat message' }).last().locator('.context-item-mention-node') - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements - locator resolved to 0 elements 43 | 44 | // Wait for the current user repo to be loaded before opening the mention menu. > 45 | await expect(chatInputMentions(lastChatInput)).toHaveText([userRepo]) | ^ 46 | await openMentionsForProvider(chatFrame, lastChatInput, 'Remote Repositories') 47 | await expect(mentionMenuItems(chatFrame)).toHaveText(['a/b', 'c/d']) 48 | await selectMentionMenuItem(chatFrame, 'c/d') at /Users/runner/work/cody/cody/vscode/test/e2e/mention-repository.test.ts:45:52
test-e2e (macos)
Process completed with exit code 1.
fast_tests_matrix_prep
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
slow_tests_matrix_prep
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-integration (ubuntu)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
build
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-unit (ubuntu, 20)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-unit (ubuntu, 18)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-e2e (windows)
No files were found with the provided path: playwright/ vscode/test-results/. No artifacts will be uploaded.
test-e2e (ubuntu)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Slow Test: vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.4m
Slow Test: vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 1.2m
Slow Test: vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 59.0s
Slow Test: vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 52.4s
Slow Test: vscode/command-edit.test.ts#L1
vscode/command-edit.test.ts took 46.3s
Slow Test: vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.2m
Slow Test: vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 1.0m
Slow Test: vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 51.6s
Slow Test: vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 47.1s
Slow Test: vscode/command-edit.test.ts#L1
vscode/command-edit.test.ts took 37.5s
🎭 Playwright Run Summary
1 flaky chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ────────────────────────── 5 skipped 46 passed (12.2m)
🎭 Playwright Run Summary
2 failed chat-messages.test.ts:17:5 › chat assistant response code buttons ────────────────────────────── enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled 1 flaky mention-repository.test.ts:14:18 › @-mention repository ──────────────────────────────────────── 4 skipped 45 passed (13.7m)

Artifacts

Produced during runtime
Name Size
playwright-recordings macos
2.37 MB