Training Deep Neural Networks

20 / 49

If we want to ensure that Gradient Clipping does not change the direction of the gradient vector, we should clip by norm by setting clipnorm instead of clipvalue because this will clip the whole gradient if its $L^2 $ norm is greater than the threshold we picked.

See Answer

Note - Having trouble with the assessment engine? Follow the steps listed here

No hints are availble for this assesment

Loading comments...