Replies: 4 comments 4 replies
-
You will need to make a hard-coded change to the codebase
This will be something that is configurable via librechat.yaml soon enough |
Beta Was this translation helpful? Give feedback.
-
Thank you for your fast reply. I modified in the file api/utils/tokens.js to: means max 4000 token in and out? can i check the value on backend side to make sure? additional note to the settings independent from the tokens.js file: removing the entries is not possible. it will not store empty value. |
Beta Was this translation helpful? Give feedback.
-
my fault using 5000 in the frontend |
Beta Was this translation helpful? Give feedback.
-
Last Info. It is not possible to delete the setting for max token in the frontend after you have set it. |
Beta Was this translation helpful? Give feedback.
-
What is your question?
Where can i set the system wide max tokens for open ai for example or for a model?
More Details
to protect expensive tasks i want to limitmax tokens per model oder provider.
What is the main subject of your question?
No response
Screenshots
No response
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions