feat(context-agent): tool status callbacks and process support (#6451) #24909
ci.yml
on: push
fast_tests_matrix_prep
0s
slow_tests_matrix_prep
0s
build
2m 26s
Matrix: test-integration
Matrix: test-unit
Matrix: test-e2e
Annotations
16 errors, 18 warnings, and 2 notices
test-e2e (windows)
npm failed with exit code 1
|
test-e2e (windows)
Process completed with exit code 1.
|
src/autocomplete.test.ts > Autocomplete:
agent/src/TestClient.ts#L890
Error: PollyError: [Polly] [adapter:node-http] Recording for the following request is not found and `recordIfMissing` is `false`..
To fix this problem, run the following commands to update the HTTP recordings:
source agent/scripts/export-cody-http-recording-tokens.sh
pnpm update-agent-recordings
❯ TestClient.shutdownAndExit src/TestClient.ts:890:23
❯ TestClient.afterAll src/TestClient.ts:877:9
❯ src/autocomplete.test.ts:23:9
|
test-unit (windows, 20)
Process completed with exit code 1.
|
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection:
vscode/test/e2e/chat-keyboard-shortcuts.test.ts#L1
1) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ─────────────────────────
Test timeout of 30000ms exceeded.
|
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection:
vscode/test/e2e/common.ts#L198
1) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ─────────────────────────
Error: locator.fill: Target page, context or browser has been closed
Call log:
- waiting for getByPlaceholder('Type the name of a command to run.')
- locator resolved to <input wrap="off" type="text" class="input" role="combobox" autocorrect="off" spellcheck="false" aria-label="input" autocapitalize="off" aria-haspopup="menu" aria-expanded="true" aria-autocomplete="list" aria-controls="quickInput_list" aria-activedescendant="list_id_4_0" aria-describedby="quickInput_message" placeholder="Type the name of a command to run."/>
- fill("buzz.ts")
- attempting fill action
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #1
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fil
|
test-e2e (macos)
Worker teardown timeout of 30000ms exceeded.
Failed worker ran 22 tests, last 10 tests were:
test/e2e/chat-context.test.ts:11:5 › chat followup context
test/e2e/chat-history.test.ts:17:3 › restore chat from sidebar history view
test/e2e/chat-history.test.ts:50:3 › delete chat from sidebar history view
test/e2e/chat-input.test.ts:25:3 › chat input focus
test/e2e/chat-input.test.ts:96:69 › chat toolbar and row UI
test/e2e/chat-input.test.ts:192:3 › chat model selector
test/e2e/chat-input.test.ts:243:3 › editing follow-up messages in chat view
test/e2e/chat-keyboard-shortcuts.test.ts:14:5 › chat keyboard shortcuts for sidebar chat
test/e2e/chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection
test/e2e/chat-messages.test.ts:17:5 › chat assistant response code buttons
|
test-e2e (macos)
Worker teardown timeout of 30000ms exceeded.
Failed worker ran 1 test:
test/e2e/chat-messages.test.ts:17:5 › chat assistant response code buttons
|
chat-messages.test.ts:17:5 › chat assistant response code buttons:
vscode/test/e2e/chat-messages.test.ts#L1
1) chat-messages.test.ts:17:5 › chat assistant response code buttons ─────────────────────────────
Tearing down "app" exceeded the test timeout of 30000ms.
|
chat-messages.test.ts:17:5 › chat assistant response code buttons:
vscode/test/e2e/chat-messages.test.ts#L1
1) chat-messages.test.ts:17:5 › chat assistant response code buttons ─────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Tearing down "app" exceeded the test timeout of 30000ms.
|
enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled:
vscode/test/e2e/enterprise-server-sent-models.test.ts#L1
2) enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled
Test timeout of 30000ms exceeded.
|
enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled:
vscode/test/e2e/enterprise-server-sent-models.test.ts#L26
2) enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled
Error: locator.click: Target page, context or browser has been closed
Call log:
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('listbox', { name: 'Suggestions' }).getByRole('option', { name: 'Titan' })
24 | await modelSelect.click()
25 | const modelChoices = chatFrame.getByRole('listbox', { name: 'Suggestions' })
> 26 | await modelChoices.getByRole('option', { name: 'Titan' }).click()
| ^
27 | await expect(modelSelect).toHaveText(/^Titan/)
28 |
29 | // Close chat window and create a new one and assert the default model is preserved
at /Users/runner/work/cody/cody/vscode/test/e2e/enterprise-server-sent-models.test.ts:26:63
|
enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled:
vscode/test/e2e/enterprise-server-sent-models.test.ts#L1
2) enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled:
vscode/test/e2e/enterprise-server-sent-models.test.ts#L26
2) enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Target page, context or browser has been closed
Call log:
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('listbox', { name: 'Suggestions' }).getByRole('option', { name: 'Titan' })
24 | await modelSelect.click()
25 | const modelChoices = chatFrame.getByRole('listbox', { name: 'Suggestions' })
> 26 | await modelChoices.getByRole('option', { name: 'Titan' }).click()
| ^
27 | await expect(modelSelect).toHaveText(/^Titan/)
28 |
29 | // Close chat window and create a new one and assert the default model is preserved
at /Users/runner/work/cody/cody/vscode/test/e2e/enterprise-server-sent-models.test.ts:26:63
|
mention-repository.test.ts:14:18 › @-mention repository:
vscode/test/e2e/mention-repository.test.ts#L45
3) mention-repository.test.ts:14:18 › @-mention repository ───────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('textbox', { name: 'Chat message' }).last().locator('.context-item-mention-node')
- Expected - 3
+ Received + 1
- Array [
- "codehost.example/user/myrepo",
- ]
+ Array []
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('textbox', { name: 'Chat message' }).last().locator('.context-item-mention-node')
- locator resolved to 0 elements
- locator resolved to 0 elements
- locator resolved to 0 elements
- locator resolved to 0 elements
- locator resolved to 0 elements
- locator resolved to 0 elements
- locator resolved to 0 elements
- locator resolved to 0 elements
- locator resolved to 0 elements
43 |
44 | // Wait for the current user repo to be loaded before opening the mention menu.
> 45 | await expect(chatInputMentions(lastChatInput)).toHaveText([userRepo])
| ^
46 | await openMentionsForProvider(chatFrame, lastChatInput, 'Remote Repositories')
47 | await expect(mentionMenuItems(chatFrame)).toHaveText(['a/b', 'c/d'])
48 | await selectMentionMenuItem(chatFrame, 'c/d')
at /Users/runner/work/cody/cody/vscode/test/e2e/mention-repository.test.ts:45:52
|
test-e2e (macos)
Process completed with exit code 1.
|
fast_tests_matrix_prep
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
slow_tests_matrix_prep
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
test-integration (ubuntu)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
build
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
test-unit (ubuntu, 20)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
test-unit (ubuntu, 18)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
test-e2e (windows)
No files were found with the provided path: playwright/
vscode/test-results/. No artifacts will be uploaded.
|
test-e2e (ubuntu)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Slow Test:
vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.4m
|
Slow Test:
vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 1.2m
|
Slow Test:
vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 59.0s
|
Slow Test:
vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 52.4s
|
Slow Test:
vscode/command-edit.test.ts#L1
vscode/command-edit.test.ts took 46.3s
|
Slow Test:
vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.2m
|
Slow Test:
vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 1.0m
|
Slow Test:
vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 51.6s
|
Slow Test:
vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 47.1s
|
Slow Test:
vscode/command-edit.test.ts#L1
vscode/command-edit.test.ts took 37.5s
|
🎭 Playwright Run Summary
1 flaky
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ──────────────────────────
5 skipped
46 passed (12.2m)
|
🎭 Playwright Run Summary
2 failed
chat-messages.test.ts:17:5 › chat assistant response code buttons ──────────────────────────────
enterprise-server-sent-models.test.ts:6:5 › allows multiple enterprise models when server-sent models is enabled
1 flaky
mention-repository.test.ts:14:18 › @-mention repository ────────────────────────────────────────
4 skipped
45 passed (13.7m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
playwright-recordings macos
|
2.37 MB |
|