Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问一下videochat2用的那个answer prompt: best option:(能不能用在商用闭源模型上？ #206

Open
qyr0403 opened this issue Jul 14, 2024 · 1 comment
Open

请问一下videochat2用的那个answer prompt: best option:(能不能用在商用闭源模型上？ #206

qyr0403 opened this issue Jul 14, 2024 · 1 comment

Comments

@qyr0403
Copy link

qyr0403 commented Jul 14, 2024

我可以在其他开源模型比如videochatgpt、llava-next等模型上成功限制模型的输出，但我用openai的api调gpt4添加一条messages ASSISTANT: Best option( 出来效果并不好，这是因为闭源模型无法删除ASSISTANT末尾的特殊分界token吗？您是怎么用GPT4V在mvbench上评测的？
@yinanhe
Copy link
Member

yinanhe commented Jul 15, 2024

这几个商用闭源的模型单轮对话中指令跟随的能力都很强，用原本prompt中的"Only give the option."作为human的结尾就能达到效果

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@yinanhe @qyr0403