Skip to content

Commit

Permalink
Evaluation keys etc.
Browse files Browse the repository at this point in the history
  • Loading branch information
Trent Fowler authored and Trent Fowler committed Oct 17, 2024
1 parent 48c1b3c commit a1f510c
Showing 1 changed file with 6 additions and 4 deletions.
10 changes: 6 additions & 4 deletions fern/pages/going-to-production/rate-limits.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -11,9 +11,9 @@ keywords: "Cohere, large language model API"
createdAt: "Thu Feb 29 2024 18:20:04 GMT+0000 (Coordinated Universal Time)"
updatedAt: "Wed Jun 05 2024 20:23:51 GMT+0000 (Coordinated Universal Time)"
---
Cohere offers two kinds of API keys: evaluation keys (free but limited in usage), and production keys (paid and much less limited in usage). You can create an evaluation or production key on [the API keys page](https://dashboard.cohere.com/api-keys). For more details on pricing please see our [pricing docs](https://docs.cohere.com/v2/docs/how-does-cohere-pricing-work).
Cohere offers two kinds of API keys: evaluation keys (free but limited in usage), and production keys (paid and much less limited in usage). You can create a trial or production key on [the API keys page](https://dashboard.cohere.com/api-keys). For more details on pricing please see our [pricing docs](https://docs.cohere.com/v2/docs/how-does-cohere-pricing-work).

| Endpoint | Evaluation rate limit | Production rate limit |
| Endpoint | Trial rate limit | Production rate limit |
| ------------------------------------------ | --------------------- | --------------------- |
| [Embed](/reference/embed) | 100/min | 2,000/min |
| [Tokenize](/reference/tokenize) | 100/min | 2,000/min |
Expand All @@ -25,9 +25,11 @@ Cohere offers two kinds of API keys: evaluation keys (free but limited in usage)
| [EmbedJob](/reference/embed-jobs) | 5/min | 50/min |
| Default (anything not covered above) | 500/min | 500/min |

All endpoints are limited to 1,000 calls per month with an evaluation key.
In addition, all endpoints are limited to 1,000 calls **per month** with a **trial** key.

Organizational evaluation key limitations:
- Organizations can have unlimited evaluation keys.
- Organization evaluation keys share the rate limits enumerated above.
- Playground and Chat UI usage counts toward the evaluation key rate limit.
- Playground and Chat UI usage counts toward the evaluation key rate limit.

If you have any questions or want to speak about getting a rate limit increase, reach out to [email protected].

0 comments on commit a1f510c

Please sign in to comment.