Possible mismatch in runtime weight scaling implementation (equalized learning rate section)

[akanimax]

In your code here: x = self.conv(x.mul(self.scale)), the input x is multiplied by the scale which is equal to scale = sqrt(2 / fan_in) from HE initializer. I am a bit confused about the multiplication. The paper states that w_i_hat = w / scale which in case of convolution, can be achieved by doing out = conv(x / scale).

My question is: why is the scale multiplied by the x, instead of dividing? Please help.