-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Chat-UI is not following prompt - producing unknown completely unrelated text? Hacked? #1375
Comments
Hi 👋 I'd need to know the following in order to help you out
Seems to me like a prompt template issue or a stop token issue but can't be sure until I see the above. |
Hi @nsarrazin many thanks for getting back to me, What settings are you using in text-generation-web-ui ?
What model are you running ?
What is the content of your MODELS var for chat-ui ? (Making sure to hide any secrets)
|
Can you also show the |
@nsarrazin this is the contents of my Chat-UI ".env.local" file
|
Anyone have any ideas? Chat-UI is completely unusable so I'm confused how people have (supposedly) got this working? |
Hard to tell what the issue is, probably a config error somewhere. I know people have successfully used llama.cpp OpenAI server as a backend so could be worth trying that to isolate where the issue is coming from |
Thanks but llama.cpp is abysmally slow compared to Ooogabooga text-gen. |
@nsarrazin could you change the tag to "bugs" as this is clearly broken in the current implementation. Not sure why "Support" tag was added.. |
Oogabooga text-generation-web-ui engine used for inference (prompts directly input into the oogabooga ui produce normal results but chat-ui is doing something weird as below), Mongodb setup
Prompt: bake a cake
Assistant:
Title for the chat: Tax refund help
JSON GET RESPONSE DATA:
Prompt 2: make a cake
Assistant:
Title for the chat: COVID vaccine approval
JSON GET RESPONSE DATA:
The text was updated successfully, but these errors were encountered: