Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure AI connection #107

Open
stelucz opened this issue Nov 17, 2023 · 2 comments
Open

Azure AI connection #107

stelucz opened this issue Nov 17, 2023 · 2 comments
Labels
help wanted Extra attention is needed question Further information is requested

Comments

@stelucz
Copy link

stelucz commented Nov 17, 2023

I did not find way to connect Rubberduck to my Azure OpenAI deployment. Is it even supported? Thanks a lot.

@stelucz stelucz added the question Further information is requested label Nov 17, 2023
@lgrammel lgrammel added the help wanted Extra attention is needed label Nov 28, 2023
@ntaylor-ads
Copy link

I would also like to request support for Azure AI Studio models. The API is nearly identical to OpenAI, so it should not be too hard to add.

@riotrah
Copy link

riotrah commented Mar 31, 2024

It's a bit different actually, tho not enough to be much work. I somewhat recently refactored a chatbot UI lib (can't remember which) to support azure openai in addition to public chatgpt.

The biggest difference is that with public chatgpt, there's only one endpoint to connect to, and it accepts the model (and/or version, iirc) as a parameter for each call, whereas azure openai, each model/version is deployed separately, and so you have different endpoints (and thus different api keys, etc) for each model/version.

In practical terms, in that refactor I did, I had to generalize the endpoint config so that it assumed endpoint was an array of objects with their own api key and model and such, and in the models selector UX, make several api calls per endpoint etc, and then remember the model<->endpoint mapping for making the actual chat api call.

Not having looked at this codebase at all, I don't think this would be a super big lift.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed question Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants