-
Notifications
You must be signed in to change notification settings - Fork 1.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: Provider Extension - OpenRouter #3452
Closed
2 of 4 tasks
Labels
Comments
|
Van-QA
changed the title
bug: [DESCRIPTION] Openrouter model selection?
bug: Openrouter model selection?
Aug 30, 2024
Reopen this to cover the openrouter models selection |
imtuyethan
added
type: feature request
A new feature
and removed
type: bug
Something isn't working
labels
Aug 30, 2024
imtuyethan
changed the title
bug: Openrouter model selection?
bug: OpenRouter model selection?
Aug 30, 2024
dan-homebrew
changed the title
bug: OpenRouter model selection?
feat: OpenRouter model selection?
Aug 30, 2024
15 tasks
please allow for multiple, comma-separated model names! |
6 tasks
related #3505 |
0xSage
changed the title
feat: OpenRouter model selection?
feat: Provider Extension - OpenRouter
Oct 17, 2024
This was referenced Oct 17, 2024
23 tasks
Closing in favor of #3786 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Goal
Original User Request
Current behavior
Is there a way to get it show the list of model's available and be able to pick one?
{
"sources": [
{
"url": "https://openrouter.ai"
}
],
"id": "open-router-auto",
"object": "model",
"name": "OpenRouter",
"version": "1.0",
"description": " OpenRouter scouts for the lowest prices and best latencies/throughputs across dozens of providers, and lets you choose how to prioritize them.",
"format": "api",
"settings": {},
"parameters": {
"max_tokens": 1024,
"temperature": 0.7,
"top_p": 0.95,
"frequency_penalty": 0,
"presence_penalty": 0
},
"metadata": {
"author": "OpenRouter",
"tags": [
"General",
"Big Context Length"
]
},
"engine": "openrouter"
}
Minimum reproduction step
its on Auto
Expected behavior
Auto
Screenshots / Logs
{
"sources": [
{
"url": "https://openrouter.ai"
}
],
"id": "open-router-auto",
"object": "model",
"name": "OpenRouter",
"version": "1.0",
"description": " OpenRouter scouts for the lowest prices and best latencies/throughputs across dozens of providers, and lets you choose how to prioritize them.",
"format": "api",
"settings": {},
"parameters": {
"max_tokens": 1024,
"temperature": 0.7,
"top_p": 0.95,
"frequency_penalty": 0,
"presence_penalty": 0
},
"metadata": {
"author": "OpenRouter",
"tags": [
"General",
"Big Context Length"
]
},
"engine": "openrouter"
}
Would switching to work:
import requests
import json
response = requests.post(
url="https://openrouter.ai/api/v1/chat/completions",
headers={
"Authorization": f"Bearer {OPENROUTER_API_KEY}",
"HTTP-Referer": f"{YOUR_SITE_URL}", # Optional, for including your app on openrouter.ai rankings.
"X-Title": f"{YOUR_APP_NAME}", # Optional. Shows in rankings on openrouter.ai.
},
data=json.dumps({
"model": "openai/gpt-3.5-turbo", # Optional
"messages": [
{ "role": "user", "content": "What is the meaning of life?" }
]
})
)
Jan version
Jan v0.5.2
In which operating systems have you tested?
Environment details
N/A
The text was updated successfully, but these errors were encountered: