Subject: Agentic IDE—LLM Formatting Error with Claude Sonnet/Haiku and Gemini 1.5 Pro

[KillshotELOx]

Type: Bug

Subject: Agentic IDE—LLM Formatting Error with Claude Sonnet/Haiku and Gemini 1.5 Pro

Description:

I am encountering an error when attempting to use the Agentic IDE with Claude Sonnet, Claude Haiku, and Gemini 1.5 Pro. Regardless of the selected model, I receive the following error message:

"The LLM that you're using right now returned a response that does not adhere to the format our framework expects, and thus this request has failed. If you keep seeing this error, this is likely because the LLM is unable to follow our system instructions, and it is recommended to switch over to one of our recommended models instead."

Steps to Reproduce:

Open AIDE and select the Agentic IDE mode.

Select either Claude Sonnet, Claude Haiku, or Gemini 1.5 Pro as the LLM.

Attempt to initiate a task (e.g., create a new project, add a new component).

Observe the error message.

(Provide a specific prompt you used or a specific task you tried if possible. This can help narrow down the problem. For example: "I tried to create a new project with the goal of developing a simple 2D platformer game. The specific prompt I used was Create a 2D platformer game project, within my local environment."

Expected Behavior:

The Agentic IDE should successfully interpret the LLM's response and perform the requested action (e.g., create a new project with the specified configurations).

Actual Behavior:

The error message is displayed, preventing the Agentic IDE from functioning correctly. The requested action fails.

Environment:

AIDE Version: Version 1.96.4 (user setup)

Release: 25031

Commit: 4e858de632a2bb7407167560cbe824397e95fa4a

Date: 2025-01-31T18:48:20.686Z

Electron: 32.2.7

ElectronBuildId: undefined

Chromium: 128.0.6613.186

Node.js: 20.18.1

V8: 12.8.374.38-electron.0

OS: Windows_NT x64 10.0.26100

Operating System: Windows 11

Connection Type: Direct

Additional Information/Context:

I am attempting to use Agentic mode to create a 2D game project as a test case for the Agentic IDE's capabilities.

I would like to know if agentic mode is officially supported on AIDE at this time.

If it is supposed to be working, could you provide guidance on troubleshooting this formatting error? Are there specific model versions or settings that I should be using? Are there prompt strategies that help the LLM answer within expected guidelines?

If it is not supported with those models yet, is there a list of models that Agentic mode is designed to work best with?

Aide version: Aide 1.96.4 (4e858de632a2bb7407167560cbe824397e95fa4a, 2025-01-31T18:48:20.686Z)
OS version: Windows_NT x64 10.0.26100
Modes:

System Info

Item	Value
CPUs	AMD Ryzen 3 5300G with Radeon Graphics (8 x 3992)
GPU Status	2d_canvas: enabled canvas_oop_rasterization: enabled_on direct_rendering_display_compositor: disabled_off_ok gpu_compositing: enabled multiple_raster_threads: enabled_on opengl: enabled_on rasterization: enabled raw_draw: disabled_off_ok skia_graphite: disabled_off video_decode: enabled video_encode: enabled vulkan: disabled_off webgl: enabled webgl2: enabled webgpu: enabled webnn: disabled_off
Load (avg)	undefined
Memory (System)	15.34GB (4.61GB free)
Process Argv
Screen Reader	no
VM	0%

Extensions: none

[theskcd]

ACK, on it!

[theskcd]

✅ Fix: Improved error handling for unsupported LLM models in Agentic IDE. This commit clarifies the error message displayed when using Claude Sonnet/Haiku or Gemini 1.5 Pro, recommending GPT-4 or other OpenAI models for optimal compatibility. Please review the changes.

[theskcd]

Hey! You should also restart and update sidecar on the editor, we pushed a lot of fixes