Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update rate limits #199

Merged
merged 6 commits into from
Oct 18, 2024
Merged

Update rate limits #199

merged 6 commits into from
Oct 18, 2024

Conversation

trentfowlercohere
Copy link
Contributor

@trentfowlercohere trentfowlercohere commented Oct 17, 2024

This PR introduces changes to the rate limits for Cohere's API keys, specifically the trial and production keys. The modifications include:

  • Renaming the 'Evaluation rate limit' to 'Trial rate limit' to align with the new terminology.
  • Updating the rate limits for various endpoints, such as reducing the rate limit for the 'Embed' endpoint from 100,000/min to 100/min for trial keys and introducing a limit of 2,000/min for production keys.
  • Adding new endpoints like 'Tokenize' and 'Classify' with specific rate limits.
  • Implementing a monthly limit of 1,000 calls for all endpoints with a trial key.
  • Providing contact information for rate limit increase inquiries.

Changes:

  • The 'Evaluation' key is now referred to as a 'Trial' key, reflecting a change in terminology.
  • Rate limits for specific endpoints have been adjusted, with notable changes including the 'Embed' endpoint's limit reduction from 100,000/min to 100/min for trial keys and the introduction of a 2,000/min limit for production keys.
  • New endpoints, 'Tokenize' and 'Classify', have been added with their respective rate limits.
  • A monthly limit of 1,000 calls has been set for all endpoints when using a trial key.
  • Contact information ([email protected]) is provided for users seeking rate limit increases.

@trentfowlercohere trentfowlercohere requested a review from a team as a code owner October 17, 2024 19:36
Copy link

Copy link

Copy link

@trentfowlercohere trentfowlercohere merged commit 59f1aeb into main Oct 18, 2024
2 checks passed
@trentfowlercohere trentfowlercohere deleted the update-rate-limits branch October 18, 2024 18:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants