[Feature] Gymnasium 1.0 compatibility #2814

Job	Run time
unittests-atari-dqn	0s
unittests-d4rl	0s
unittests-gendgrl	0s
unittests-minari	0s
unittests-openx	0s
unittests-roboset	0s
unittests-vd4rl	0s
unittests-meltingpot / linux-job	14m 28s
unittests-pettingzoo / linux-job	9m 41s
unittests-brax (3.11, 12.1) / linux-job	10m 49s
unittests-envpool (3.9, 12.1) / linux-job	8m 35s
unittests-jumanji (3.9, 12.1) / linux-job	33m 38s
unittests-open_spiel (3.9, 12.1) / linux-job	8m 10s
unittests-gym (3.9, 12.1) / linux-job	19m 35s
unittests-robohive (3.9, 12.1) / linux-job	46m 9s
unittests-sklearn (3.9, 12.1) / linux-job	6m 8s
unittests-smacv2 (3.9, 12.1) / linux-job	11m 36s
unittests-vmas (3.9, 12.1) / linux-job	12m 12s
	3h 1m 1s

Provide feedback