Training Log 2022-07-14 #63
zh-zheng
announced in
Training Logs 训练日志
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
CPM-Live Training Log (July, 14)
Time: July, 14 2022 16:00
Recorder: @zh-zheng
Loss
Completed Data
Average Grad Norm
Progress
Comment
Our training is still stable. Recently, a large open-access multilingual language model BLOOM was released. It has 176B parameters and supports 46 languages and 13 programming languages. As you can see, open source is the trend!
Beta Was this translation helpful? Give feedback.
All reactions