Measure the validation error every N steps, just like for early stopping, and reduce the learning rate by a factor of lambda when the error stops dropping. This type of learning rate scheduling is known as:
Note - Having trouble with the assessment engine? Follow the steps listed here
Loading comments...