Skip to content

Commit

Permalink
Update inference-models.mdx
Browse files Browse the repository at this point in the history
  • Loading branch information
BenHamm authored Oct 6, 2024
1 parent f5f6cd3 commit 714d142
Showing 1 changed file with 0 additions and 8 deletions.
8 changes: 0 additions & 8 deletions fern/docs/getting-started/inference-models.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -14,15 +14,7 @@ OctoAI currently supports the self-service models & checkpoints organized on thi
| Meta | Chat, Coding | Llama-3.1-Instruct (8B) | meta-llama-3.1-8b-instruct | 131,072 |
| Meta | Chat, Coding | Llama-3.1-Instruct (70B) | meta-llama-3.1-70b-instruct | 131,072 |
| Meta | Chat, Coding | Llama-3.1-Instruct (405B) | meta-llama-3.1-405b-instruct | 131,072 |
| Meta | Chat | Llama3-Instruct (70B) | meta-llama-3-70b-instruct | 8,192 |
| Mistral | Chat, Coding | Mistral Instruct v0.3 (7B) | mistral-7b-instruct | 32,768 |
| Mistral | Chat, Coding | Mistral Nemo Instruct (12B) | mistral-nemo-instruct | 65,536 |
| Mistral | Chat, Coding | Mixtral Instruct (8x7B) | mixtral-8x7b-instruct | 32,768 |
| Nous Research | Content Moderation | Nous Hermes 2 Mixtral DPO (8x7B) | nous-hermes-2-mixtral-8x7b-dpo | 32,768 |
| Microsoft | Chat, Coding | WizardLM-2 (8x22B) | wizardlm-2-8x22b | 65,536 |
| Microsoft | Image Understanding| Phi-3.5-Vision (4B) | phi-3.5-vision-instruct | n/a |
| Meta | Content Moderation | Llama Guard 2 | llamaguard-2-7b | 4,096 |
| Alibaba DAMO | Embedding | GTE Large | thenlper/gte-large | n/a |

Check out our [REST API](/docs/text-gen-solution/rest-api), [Python SDK](/docs/text-gen-solution/python-sdk), or [TypeScript SDK](/docs/text-gen-solution/typescript-sdk) docs when you’re ready to use text gen models programmatically.

Expand Down

0 comments on commit 714d142

Please sign in to comment.