Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to enable streaming response when I use chat #211

Open
LeighSu opened this issue Aug 8, 2024 · 2 comments
Open

how to enable streaming response when I use chat #211

LeighSu opened this issue Aug 8, 2024 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@LeighSu
Copy link

LeighSu commented Aug 8, 2024

now when I use the chat functionality, it will just return the whole response at the same time.
what should I do to make the response will be display one chunk by one chunk?

@LeighSu LeighSu added the enhancement New feature or request label Aug 8, 2024
Copy link

github-actions bot commented Aug 8, 2024

Thank you for your contribution. We will check and reply to you as soon as possible.

@shreyaskarnik
Copy link
Owner

Hi @LeighSu, thanks for raising this issue. The streaming response was disabled due to a limitation. I can try to experiment with re-enabling it again. Will keep this thread updated on my findings.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants