Can this interface with oobabooga? #543
-
|
I am wanting to interface with ChatDev and there is an active pull request to support this project as an interface. My LLM is hosted via oobabooga's web ui and so I am wondering if I can use this tool to interface oobabooga's API with ChatDev. |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 1 reply
-
|
Yes we support it @YeloPartyHat Here's how to use it with LiteLLM: https://docs.litellm.ai/docs/tutorials/oobabooga |
Beta Was this translation helpful? Give feedback.
-
|
we still need to add support for exception mapping + add to docs cc @krrishdholakia |
Beta Was this translation helpful? Give feedback.
-
|
@YeloPartyHat oobabooga also has an openai compatible API - https://github.com/oobabooga/text-generation-webui/tree/main/extensions/openai |
Beta Was this translation helpful? Give feedback.
Yes we support it @YeloPartyHat
Here's how to use it with LiteLLM: https://docs.litellm.ai/docs/tutorials/oobabooga