Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gpt 0.4.0 的完整支持和验证 #210

Open
strint opened this issue Aug 3, 2021 · 1 comment
Open

gpt 0.4.0 的完整支持和验证 #210

strint opened this issue Aug 3, 2021 · 1 comment
Assignees

Comments

@strint
Copy link

strint commented Aug 3, 2021

0.4.0的oneflow和benchmark

在调试验证中。当前反馈:

  • 测试了v0.4.0,是可以的
  • 但是有一点需要注意,就是跑的模型参数,hidden_size和seq_length别相等,(一般都不会相等),现在benchmark上直接运行bash examples/pretrain_345M.sh有问题,就是这个问题
    错误样子:
raise RuntimeError("can't infer split axis")
RuntimeError: can't infer split axis

在处理中。

@jackalcooper
Copy link
Contributor

可以考虑整理个master能跑的gpt,然后我加到CI的 dry run里面

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants