Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mistral api configuration without Cloudflare #1472

Open
JonasMedu opened this issue Sep 16, 2024 · 0 comments
Open

Mistral api configuration without Cloudflare #1472

JonasMedu opened this issue Sep 16, 2024 · 0 comments
Labels
support A request for help setting things up

Comments

@JonasMedu
Copy link

I'd like to setup a local deployment using only the mistral API: https://docs.mistral.ai/api.

Can i use ChatUI without an HF deployment and Cloudflare account?

I leave the .env unchanged and overwrite the env.local with the following code

AGENT_ID=<my_agent_id_from_mistral>
MISTRAL_API_KEY==<mytoken>
MODELS='[
    {
      "name": "mistral-large",
      "displayName": "mistralai",
      "description": "Mistral standard",
      "websiteUrl": "https://docs.mistral.ai/",
      "preprompt": "",
      "parameters": {
        "temperature": 0.1,
        "top_p": 0.95,
        "top_k": 5,
        "stream": true,
        "agent_id": "{AGENT_ID}",
        "tool_choice": "auto",
        "max_new_tokens": 4096
      },
      "endpoints": [
          {
              "type": "openai",
              "baseURL": "https://api.mistral.ai/v1",
              "defaultHeaders": {
                  "Authorization": "Bearer {MISTRAL_API_KEY}"
              }
          }
      ]
    },
    {
    "name": "mistral-embed",
    "displayName": "Mistral-embedbedings",
    "description": "Mistral embedding model.",
    "chunkCharLength": 1024,
    "endpoints": [
        {
            "type": "openai",
            "baseURL": "https://api.mistral.ai/v1",
            "defaultHeaders": {
                "Authorization": "Bearer {MISTRAL_API_KEY}"
            }
        }
    ]
  }
]'
MONGODB_URL=mongodb://localhost:27017/
PUBLIC_APP_ASSETS=chatui
PUBLIC_APP_COLOR=blue
PUBLIC_APP_NAME="Mistral Local"

Not quite sure though if the agend_id is overwritten by the "name".

@JonasMedu JonasMedu added the support A request for help setting things up label Sep 16, 2024
@JonasMedu JonasMedu changed the title Mistral api configuration Mistral api configuration without Cloudflare Sep 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
support A request for help setting things up
Projects
None yet
Development

No branches or pull requests

1 participant