Training Speed of Uni-Fold

[ZiyaoLi]

We noticed that some of our users are interested in the training speed of Uni-Fold. Here we release the performance (in comparison with AlphaFold Nature paper):

Task	AlphaFold init	AlphaFold finetune (1.1.2)	Uni-Fold init	Uni-Fold finetune
hardware	TPUv3 128 core	TPUv3 128 core	NVIDIA A100 * 128	NVIDIA A100 * 128
batch-size	128	128	128	128
crop-size	256	384	256	384
num msa cluster	128	512	128	512
num extra seq	1024	1024	1024	1024
training samples (*10^6)	9.2	0.6	10.24	1.28
training time (hours)	150	37	106.7	40.6
estimated step time (sec/step)	7.5	28.4	3.6	12.6
source	AlphaFold SI Table 5	AlphaFold SI Table 5	Uni-Fold v2.1.0	Uni-Fold v2.1.0