WIP: Diagnose training hang #3707

Job	Run time
atorch-python-test	6m 1s
atorch-pre-commit	2m 40s
dlrover-python-test	6h 0m 14s
brain-test	1m 34s
dlrover-system-test-criteo-deeprec	2m 58s
dlrover-system-test-deepfm	2m 36s
dlrover-system-test-tf2	1m 16s
operator-test	1m 31s
pre-commit	1m 38s
tfplus-pre-commit	1m 12s
tfplus-python-test	10s
	6h 21m 50s

Provide feedback