New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

tools_using_demo中的openai_api_demo.py，stream等于True的时候 finish_reason 不出现"function_call" #1311

Open

1 of 2 tasks

guolushi-7 opened this issue Aug 15, 2024 · 1 comment

Assignees

guolushi-7 commented Aug 15, 2024

System Info / 系統信息

操作系统：Ubuntu 20.04
python：3.10
cuda：12.0
transformers：4.41.0

Who can help? / 谁可以帮助到您？

No response

Information / 问题信息

The official example scripts / 官方的示例脚本
My own modified scripts / 我自己修改的脚本和任务

Reproduction / 复现过程

用tools_using_demo/openai_api_demo.py做测试

但是输出结果是：

输出这个结果就会结束

Expected behavior / 期待表现

是还需要配置什么吗

zRzRzRzRzRzRzR self-assigned this

Member

zRzRzRzRzRzRzR commented Sep 4, 2024

fc应该没有stream，GLM-4的代码有这个功能，但是适配的是GLM-4模型

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment