Train VMamba2 but gradients turned into NaN

[Mark2Lutz]

Hi, thanks for your great work, I set up the training with vmamba2, but after a period of time, the gradients turned into NaN. Even with gradient clipping, NaN still occurs. Have you encountered this situation before, and do you have any good solutions?

[MzeroMiko]

If you are talking about VMamba with mamba2, then I have not trained it due to it's slow training on my device.

If you are talking about VMamba with SS2Dv2, then I have not encountered the NaN problem before.