[Training Log 2022-07-05] The loss is falling very fast today.

[zh-zheng]

CPM-Live Training Log (July, 5)

Time: July, 5 2022 16:00

Recorder: @zh-zheng

Loss

• Begin: 2.57
• End: 2.43

Completed Data

• $\approx$ 455.86GB

Average Grad Norm

• 0.87

Progress

• 48.95%

Comment

The loss is falling very fast😲. We think this may be because the model has seen data that it has seen before. Therefore, we remain cautiously optimistic for now due to our previous experience.