Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to set Azure Deployment at .env file?, there not list Azure Open AI complete settings section. #377

Open
ejgarcian opened this issue Sep 27, 2024 · 5 comments

Comments

@ejgarcian
Copy link

📖 Documentation

https://rdagent.readthedocs.io/en/latest/installation_and_configuration.html

@TPLin22
Copy link
Collaborator

TPLin22 commented Sep 29, 2024

Hi,

Thank you for reaching out. Could you please provide more details about your specific requirements?

@ejgarcian
Copy link
Author

Sure, looks when it needed to use Azure Open AI, there are some additional parameter (deployment) at the AzureOpenAI client, and get result modifying the llm_utils.py, full operate with Azure Open AI services.

llm_utils py

@TPLin22
Copy link
Collaborator

TPLin22 commented Oct 8, 2024

To use Azure OpenAI, at .env file you should have EMBEDDING_OPENAI_API_KEY=<your_key> or CHAT_OPENAI_API_KEY=<your_key>. The base and version can be modified as in the .env.example file. You can see the priority of API key settings on line 314 of llm_utils.py. Also you need to import the environment variables from the .env file.

@ejgarcian
Copy link
Author

It's doesn't work if the deployment environment is multitenant over Azure Open AI, simply the client can't connect it. The instructions was made only considering OpenAI api, not for real Azure Environment. The client invocations on the internals URi endpoint are different, the only solution that I found was pass the complete arguments on the client, its the correct way to do it.

@SunsetWolf
Copy link
Collaborator

Hi, @ejgarcian
We've recently changed the Azure OpenAI settings section of the documentation, if you follow the instructions in the documentation now, will it solve your problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants