fastchat是什么实现透传openai接口的？

[Huyueeer]

好奇一个问题，是fastchat本身就支持透传api的支持，还是需要chatchat独立实现；
比如我有azure-api的地址，但是如果我独立部署fastchat服务，就不知道如何将azure openai挂到fastchat api上；

[dosubot[bot]]

To integrate Azure OpenAI with FastChat, you'll primarily work with the AzureWorker class found in server/model_workers/azure.py. This class is designed to facilitate communication between FastChat and Azure OpenAI, demonstrating FastChat's capability to support external API integrations directly.

Here's a brief overview of how the AzureWorker class enables this integration:

1. Initialization: The class is initialized with parameters like model names (defaulting to ["azure-api"]), the version of the model (e.g., "gpt-35-turbo"), and addresses for the controller and worker.

2. Chat Operation: The do_chat method constructs and sends a POST request to the Azure OpenAI API endpoint, including necessary headers (with the API key for authentication) and the request body with parameters like messages, temperature, and max_tokens. The method processes the API's response and returns it.

3. Configuration: Integration requires setting up specific configurations such as the API version, deployment name, resource name, and API key. These are used to construct the request URL and headers.

4. Conversation Template: The make_conv_template method sets up a conversation template, defining aspects like the conversation name, system message, roles, and separators.

This setup indicates that FastChat is designed to allow for the integration of external APIs like Azure OpenAI without needing a separate passthrough implementation. You can directly use or adapt the AzureWorker class for your integration, ensuring you configure it with your Azure OpenAI details.

For more detailed implementation, refer to the AzureWorker class in the Langchain-Chatchat repository. This will guide you through setting up the connection parameters, constructing the request, and handling the response for integrating Azure OpenAI with FastChat.

Details

Sources

• 框架中的Agent是否支持调用远端API
• api调用问题
• 希望增加支持微软云openai api功能呢？
• server/model_workers/azure.py
• README_en.md

About Dosu
This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

To continue the conversation, mention @dosu.

[zRzRzRzRzRzRzR]

我们现在不用fschat作为唯一的方式，其实都是fast api起的服务