Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: 参考WebUI的API接入形式 #2124

Open
Fangziyang0910 opened this issue Jan 30, 2025 · 1 comment
Open

[Feature]: 参考WebUI的API接入形式 #2124

Fangziyang0910 opened this issue Jan 30, 2025 · 1 comment

Comments

@Fangziyang0910
Copy link

Class | 类型

大语言模型

Feature Request | 功能请求

能否参考WebUI接入外部API的形式,让用户自定义外部链接的URL、API,然后自动获取模型名称,这样只要兼容OpenAI格式的API都可以方便地接入进来。
目前ChatANyWhere的AP没能很好地接进来,只能通过将openai的url地址转发到chatanywhere来实现,Claude3.5 sonnet和gemini 2 exp都接入不进来。
参考WebUI的API接入设计是否可以减轻作者开发适应多种LLM的API的工作量。

@SakuraPuare
Copy link
Contributor

maybe see oneapi

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants