other available views?

[wqtwjt1996]

Could you please release the code of using other views instead of only "l" and "ab" in the training CMC process?

[HobbitLong]

Hi, @wqtwjt1996 ,

Which experiment are you referring to, Video, Segmentation and Depth, or other color spaces?

[wqtwjt1996]

Hi, @wqtwjt1996 ,

Which experiment are you referring to, Video, Segmentation and Depth, or other color spaces?

depth and segmentation.

[HobbitLong]

depth and segmentation.

It needs a bit of work to combine that one in current repo, probably not now.

[yassouali]

@HobbitLong Can you please provide some additional info on how we compute the loss in case of segmentation & depth ? I can't see how to compute the contrastive loss from the segmentation masks, do we pass the labels (C, H, W) through a network to get a representation and then compute the loss? thanks.

[HobbitLong]

@HobbitLong Can you please provide some additional info on how we compute the loss in case of segmentation & depth ? I can't see how to compute the contrastive loss from the segmentation masks, do we pass the labels (C, H, W) through a network to get a representation and then compute the loss? thanks.

As illustrated in the paper, you also need an encoder to encode segmentation masks into features.