[Training Log 2022-10-14] The training loss of CPM-Bee drops very fast!

[zh-zheng]

CPM-Live Training Log (October, 14)

Time: October, 14 2022 19:00

Recorder: @zh-zheng

Loss

• Begin: 10.41
• End: 2.75

Completed Data

• $\approx$ 1,246.88GB

Average Grad Norm

• 2.74

Progress

• 1.0%

Comment

The first day of CPM-Bee training! Since we inherit the checkpoint of CPM-Ant+, the training loss drops very fast. We can see that our model performs quite well in the daily test. Keep going!