Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

选定工具后无法进行流式输出 #5096

Open
Zephyr69 opened this issue Nov 20, 2024 · 4 comments
Open

选定工具后无法进行流式输出 #5096

Zephyr69 opened this issue Nov 20, 2024 · 4 comments
Labels
bug Something isn't working

Comments

@Zephyr69
Copy link

问题描述 / Problem Description
选定工具后无法进行流式输出

复现问题的步骤 / Steps to Reproduce
1、启用agent
2、选择一种或多种工具
3、输入prompt并提交

预期的结果 / Expected Result
模型输出应以流式输出的形式更新在chatbox中

实际结果 / Actual Result
模型输出全部完成后才一次全部更新在chatbox中

环境信息 / Environment Information

  • Langchain-Chatchat 版本 / commit 号:3.0.103
  • 部署方式(pypi 安装 / 源码部署 / docker 部署):pypi 安装
  • 使用的模型推理框架(Xinference / Ollama / OpenAI API 等):Xinference
  • 使用的 LLM 模型(GLM-4-9B / Qwen2-7B-Instruct 等):Qwen2.5-instruct
  • 使用的 Embedding 模型(bge-large-zh-v1.5 / m3e-base 等):bce
  • 使用的向量库类型 (faiss / milvus / pg_vector 等):
  • 操作系统及版本 / Operating system and version: ubuntu2204
  • Python 版本 / Python version: 3.10
  • 推理使用的硬件(GPU / CPU / MPS / NPU 等) / Inference hardware (GPU / CPU / MPS / NPU, etc.): GPU
  • 其他相关环境信息 / Other relevant environment information:

附加信息 / Additional Information
添加与问题相关的任何其他信息 / Add any other information related to the issue.

@Zephyr69 Zephyr69 added the bug Something isn't working label Nov 20, 2024
@948024326
Copy link

agent好像不支持流式?

@Zephyr69
Copy link
Author

agent好像不支持流式?

看起来是这样,但是0.2.10还支持的,现在不行了

@lixy0420
Copy link

想问下楼主这个问题解决了, 之前的老版本确实是支持的

@Zephyr69
Copy link
Author

想问下楼主这个问题解决了, 之前的老版本确实是支持的

没解决

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants