Training Log 2022-06-19 #34
zh-zheng
announced in
Training Logs 训练日志
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
CPM-Live Training Log (June, 19)
Time: June, 19 2022 16:00
Recorder: @zh-zheng
Loss
Completed Data
Average Grad Norm
Progress
Comment
At 9:10 this morning, we encountered the OOM issue once again. It's weird! We just resumed the training at 16:08. As this problem occurs frequently these days, we will try to find out the cause in the coming days🤔. If you have any ideas, please post them in the community!
Beta Was this translation helpful? Give feedback.
All reactions