You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In ES training, when all of the rewards are the same value, the standard deviation is 0. The blackbox optimizers do not check for this case before dividing by the standard deviation of the function values (which is zero), resulting in a list of nan for the gradient and thus setting the model weights to nan as well. This case needs to be addressed so that the model weights result in real float values instead.
The text was updated successfully, but these errors were encountered:
In ES training, when all of the rewards are the same value, the standard deviation is 0. The blackbox optimizers do not check for this case before dividing by the standard deviation of the function values (which is zero), resulting in a list of nan for the gradient and thus setting the model weights to nan as well. This case needs to be addressed so that the model weights result in real float values instead.
The text was updated successfully, but these errors were encountered: