Skip to content

Add reasoning and reasoningBudgetTokens parameters to config schemas and docs #5041

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

ferenci84
Copy link
Contributor

Description

Adds reasoning and reasoningBudgetTokens params to config schemas and docs.

Issue: #4918

Checklist

  • The relevant docs, if any, have been updated or created
  • The relevant tests, if any, have been updated or created

@ferenci84 ferenci84 requested a review from a team as a code owner April 8, 2025 09:20
@ferenci84 ferenci84 requested review from tomasz-stefaniak and removed request for a team April 8, 2025 09:20
Copy link

netlify bot commented Apr 8, 2025

Deploy Preview for continuedev ready!

Name Link
🔨 Latest commit ff204ef
🔍 Latest deploy log https://app.netlify.com/sites/continuedev/deploys/680506ab47a1920008864d8e
😎 Deploy Preview https://deploy-preview-5041--continuedev.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@RomneyDa
Copy link
Collaborator

RomneyDa commented Apr 8, 2025

@ferenci84 nice
@sestinj will require config yaml bump

Also before we merge would this potentially conflict with a UI that would allow users to adjust reasoning tokens ad hoc in the future? I know either @FallDownTheSystem or @ferenci84 did a PR with this at some point. Something to consider

@ferenci84
Copy link
Contributor Author

@RomneyDa Not sure if you think of bumping the version number of the @continuedev/config-yaml, but if so, I think it should be set when the merging is done, because any change I do now, will soon become obsolete.

I didn't find any other modifications related to reasoning. Also verified that adding reasoning and reasoningBudgetTokens works with a yaml config like this:

  - name: Claude 3.7 Sonnet (thinking)
    provider: anthropic
    model: claude-3-7-sonnet-latest
    apiKey: YOUR-API-KEY
    roles:
      - chat
    chatOptions:
      baseSystemMessage: |
        You are intelligent, helpful and an expert developer, who always gives the correct answer and follow instructions.
    defaultCompletionOptions:
      contextLength: 200000
      maxTokens: 32000
      reasoning: true
      reasoningBudgetTokens: 1024

Before this modification, I was not able to get reasoning to work with the yaml config, although it was working with the json.

@chezsmithy
Copy link
Contributor

I opened a similar PR but also included prompt caching.

We have migrated to yaml and then immediately noticed this regression.

#5202

@tomasz-stefaniak tomasz-stefaniak merged commit d0c063a into continuedev:main Apr 29, 2025
31 checks passed
@tomasz-stefaniak
Copy link
Collaborator

Thank you @ferenci84 !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants