Issue while trying to train recognition model parseq

[whoami02]

I am trying to finetune parseq on custom data using the following command

python references/recognition/train_pytorch.py parseq --train_path "<path>" --val_path "<path>" --epochs 60 --name="parseq1408" --lr=0.0015 --pretrained --freeze-backbone --vocab="mathematical" -b 24 --save-interval-epoch --early-stop --workers 8

I am getting this error.
RuntimeError: The size of tensor a (38) must match the size of tensor b (31) at non-singleton dimension 3

Again running the same command
RuntimeError: The size of tensor a (36) must match the size of tensor b (31) at non-singleton dimension 3

I have finetuned parseq previously using the same command. Moreover, I am getting this issue is only with parseq, able to train viststr_small and others. Can anyone help me?