Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

idea: Allow 8192 tokens on Claude 3.5 #3973

Open
darkBuddha opened this issue Nov 7, 2024 · 1 comment
Open

idea: Allow 8192 tokens on Claude 3.5 #3973

darkBuddha opened this issue Nov 7, 2024 · 1 comment
Labels
category: model settings Inference params, presets, templates category: providers Local & remote inference providers type: feature request A new feature

Comments

@darkBuddha
Copy link

Problem Statement

The UI has the old value, 4096, fixed and doesn't allow to enter the correct value 8192

https://docs.anthropic.com/en/docs/about-claude/models#model-comparison-table

Feature Idea

Allow custom values or correct the max. value
@darkBuddha darkBuddha added the type: feature request A new feature label Nov 7, 2024
@imtuyethan imtuyethan added category: providers Local & remote inference providers category: model settings Inference params, presets, templates labels Nov 7, 2024
@imtuyethan
Copy link
Contributor

related #3505

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
category: model settings Inference params, presets, templates category: providers Local & remote inference providers type: feature request A new feature
Projects
Jan & Cortex
Status: Investigating
Milestone
No milestone
Development

No branches or pull requests
2 participants
@darkBuddha @imtuyethan