Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it possible to add custom proxy? #461

Open
OmiiiDev opened this issue Dec 28, 2023 · 2 comments
Open

Is it possible to add custom proxy? #461

OmiiiDev opened this issue Dec 28, 2023 · 2 comments
Assignees
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed help-wanted-important

Comments

@OmiiiDev
Copy link

Can I use this with a custom OpenAI api proxy URL?

@AndrewsPanda
Copy link

AndrewsPanda commented Dec 28, 2023

It would be good. It would allow for more llm's from HF or openrouter to be used with this bot, making it a lot more versatile.

I know you can modify the urls in, /models/opennai_model.py, into f-string values and have them pull 'https://api.openai.com/v1' from .env.

The langchain requests also need to be updated.

I know how to do that much but there are other functions that generally break.

@Kav-K im happy to do a PR request for the changes i know how to do.

Its basically the same request as my ticket below.

#454

@Kav-K
Copy link
Owner

Kav-K commented Dec 31, 2023

@AndrewsPanda Yeah sounds great! If you want to get started on a PR with what you can do, I will build on top of it and finish/polish it up!

This is definitely something that I've wanted to implement, added this to the roadmap and prioritized it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed help-wanted-important
Projects
Development

No branches or pull requests

3 participants