Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问我想在你们的基础上继续训练stage，应该怎么改openllama_peft_stage_1.json这个文件？ #13

Open
hangzeli08 opened this issue Jul 2, 2023 · 1 comment
Open

请问我想在你们的基础上继续训练stage，应该怎么改openllama_peft_stage_1.json这个文件？ #13

hangzeli08 opened this issue Jul 2, 2023 · 1 comment

Comments

@hangzeli08
Copy link

请问什么时候发布stage2的相关代码和配置文件呢，我现在想在你们训练好的基础上进行微调，应该改动哪些文件呢，如何修改openllama_peft_stage_1.json里面的参数呢，还是直接复制openllama_peft_stage_1.json到openllama_peft_stage_2.json就可以呢
@gmftbyGMFTBY
Copy link
Collaborator

可以直接复制，不过我们试验后发现stage1和stage2没有什么太大的差别，直接使用stage1就可以达到很好的效果了，所以我们这里没有很关注stage2的效果

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@gmftbyGMFTBY @hangzeli08