HPU support #5418

Job	Run time
run-tests (latest, test_prod)	2m 4s
run-tests (latest, test_core)	3m 10s
run-tests (latest, test_cli)	3m 1s
run-tests (latest, test_big_modeling)	2m 31s
run-tests (latest, test_deepspeed)	2m 25s
run-tests (latest, test_fsdp)	2m 28s
run-tests (latest, test_example_differences)	2m 46s
run-tests (latest, test_checkpoint_step)	4m 20s
run-tests (latest, test_checkpoint_epoch)	3m 41s
run-tests (latest, test_rest)	10m 18s
run-tests (minimum, test_prod)	2m 49s
run-tests (minimum, test_core)	4m 12s
run-tests (minimum, test_cli)	4m 0s
run-tests (minimum, test_big_modeling)	3m 38s
run-tests (minimum, test_deepspeed)	3m 38s
run-tests (minimum, test_fsdp)	3m 18s
run-tests (minimum, test_example_differences)	3m 19s
run-tests (minimum, test_checkpoint_step)	5m 27s
run-tests (minimum, test_checkpoint_epoch)	5m 8s
run-tests (minimum, test_rest)	11m 41s
	1h 23m 54s

Provide feedback