Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Fetch models list directly from API, where supported #50

Open
Renset opened this issue Dec 29, 2024 · 0 comments
Open

[Feature] Fetch models list directly from API, where supported #50

Renset opened this issue Dec 29, 2024 · 0 comments
Labels

Comments

@Renset
Copy link
Owner

Renset commented Dec 29, 2024

Reference Issues

No response

Summary

As macai user, I would like to select the available model from list and avoid using custom model function.

Many LLM APIs already provide API endpoints to get the list of API models supported for the specific API key. This will improve the experience of setting up new API services. It's recommended to cache the list of models locally, either in CoreData or AppStorage.

Basic Example

OpenAI: https://platform.openai.com/docs/api-reference/models/list
Claude: https://docs.anthropic.com/en/api/models-list
xAI: https://docs.x.ai/docs/api-reference#list-models
Google Gemini: https://ai.google.dev/api/models#method:-models.list
Ollama: https://ai.google.dev/api/models#method:-models.list
Perplexity: Unknown
OpenRouter API: https://openrouter.ai/docs/models

Drawbacks

No response

Unresolved questions

No response

@Renset Renset added the feature label Dec 29, 2024
@Renset Renset changed the title [Feature Request] Fetch models list directly from API, where supported [Feature] Fetch models list directly from API, where supported Dec 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant