Question about randomly sampled x'

[Liyw979]

Is this randomly sampled x' nessesary？

Have you try using half of the x as student and another half of x as teaher for cs-kd loss and using the whole x for cross-entropy loss without introducing x'？Will this do bad to accuracy?

Thanks!