Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add specific model selection for OpenRouter provider #3582

Closed
ghz opened this issue Aug 2, 2024 · 1 comment
Closed

feat: Add specific model selection for OpenRouter provider #3582

ghz opened this issue Aug 2, 2024 · 1 comment
Labels
category: providers Local & remote inference providers type: feature request A new feature

Comments

@ghz
Copy link

ghz commented Aug 2, 2024

Add specific model selection for OpenRouter provider

Problem
The current implementation of the OpenRouter provider in this AI project does not allow for precise model selection. Users are unable to choose specific models offered by OpenRouter, limiting the flexibility and control over the AI interactions.

Success Criteria

  • Implement a feature that allows users to select specific AI models available through the OpenRouter provider.
  • The selection process should be user-friendly and integrate seamlessly with the existing interface.
  • Users should be able to view a list of available models and select their preferred one for each interaction or set a default.
  • The selected model should be correctly passed to the OpenRouter API in requests.

Additional context
This feature would greatly enhance the project's versatility, allowing users to tailor their AI interactions to specific needs or preferences. It would also future-proof the integration with OpenRouter, as new models could be easily added to the selection list as they become available.

Some considerations for implementation:

  • Fetch the list of available models from OpenRouter's API, if possible, to ensure the selection is always up-to-date.
  • Consider adding a brief description or key characteristics for each model to help users make informed choices.
  • Ensure proper error handling if a selected model becomes unavailable or if there are any issues with the OpenRouter API.
@ghz ghz added the type: feature request A new feature label Aug 2, 2024
@0xSage 0xSage transferred this issue from janhq/cortex.cpp Sep 6, 2024
@0xSage 0xSage added the category: providers Local & remote inference providers label Oct 14, 2024
@0xSage
Copy link
Contributor

0xSage commented Oct 17, 2024

Dupe of #3452
ETA ~2 weeks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: providers Local & remote inference providers type: feature request A new feature
Projects
Archived in project
Development

No branches or pull requests

3 participants