Remove the round to test allgather with all nodes (#512) #1529

Job	Run time
brain-test	2m 48s
atorch-python-test	5m 52s
atorch-pre-commit	4m 10s
dlrover-client-test	2m 59s
dlrover-python-test	4m 0s
dlrover-system-test-deepfm	4m 8s
dlrover-system-test-criteo-deeprec	3m 28s
dlrover-system-test-tf2	2m 28s
dlrover-trainer-test	3m 0s
operator-test	2m 16s
pre-commit	1m 50s
tfplus-pre-commit	56s
tfplus-python-test	1m 18s
	39m 13s

Provide feedback