Issue with Vercel AI SDK: Internal Tooling Ignored When Using Personality System Prompts

[aether6430]

Hello,

I'm encountering an issue while using the Vercel AI SDK. The problem arises when I try to run the code with a few system prompts to add personality to the bot. The bot completely ignores the internal tooling functionality. However, when I remove the personality system prompts, everything works as expected, and the internal tooling is used correctly.

Expected Behavior:

The bot should use the internal tooling as expected when personality system prompts are present.

Actual Behavior:

The bot fails to use the internal tooling when personality system prompts are used.

Environment:

• Vercel AI SDK version: 4.1.20
• Vercel AI/Google Version: 1.1.8
• Node.js version: 20.18.1

Additional Information:

• This issue seems to occur consistently when personality prompts are added.
• The problem disappears once the personality prompts are removed from the configuration.

I have checked for errors on the AI side, and there are none. And there's no issues on the front end, I am sure about this because after logging all the result.toolCalls which are being sent from the backend it returns an empty array [].

Let me know if you need more details or if there's a workaround I can try in the meantime!

Thanks in advance for your help!

P.S:
I have found a similar issue, but that didn't seem to help me.

[lgrammel]

You need to engineer (system) prompts that work for tool calling (and ideally have evals).

You can do this by e.g. including tools and tool call examples in the prompt. It also depends on provider and model used.

Please check out our prompt engineering guide as a starting point: https://sdk.vercel.ai/docs/ai-sdk-core/prompt-engineering

[aether6430]

I did follow that, my tool is used for displaying a graph using Desmos' API and just takes in one parameter, which is the expression.
I also added clear descriptions to the tool and also the parameter, to no avail.
I just add the line "You are a scientist who is great at teaching. Is well versed in Maths. Physics, Chemistry and Programming. With a specialty in Quantum Physics. Gove off a fun and playful vibe" to the end of my prompt at it breaks the tools. The tools surprisingly work if I remove that particular line. And if I tell the bot to implicitly call the statement it returns a code-block with displayGraph() written around it.