whether this mod is unsupervised or self-supervised?

[wangxin-fighting]

Hello, I would like to ask why I don't find the decoder section inside the mod of the code, is there no decoder? And I see that the paper is written with self-supervision inside, may I ask if this paper is based on reconstructed transformer or non-reconstructed transformer? Looking forward to your answer, thank you!

[xcyao00]

The transformer network is also the reconstruction network, the output is used to reconstruct the input features. The intra- and inter-branch is trained by self-supervised way, as we use the target correlation as the learning target.

[wangxin-fighting]

The transformer network is also the reconstruction network, the output is used to reconstruct the input features. The intra- and inter-branch is trained by self-supervised way, as we use the target correlation as the learning target.

I'm sorry to bother you again, I didn't find the decoder part of this thesis code, is there no decoder or I didn't find it?