Adaptive Learning Rate Clipping Stabilizes Learning

Author
Jeffrey M. Ede, Richard Beanland
License
Creative Commons CC BY 4.0
Abstract

Adaptive learning rate clipping (ALRC) stabilizes learning by limiting backpropagated losses.

Adaptive Learning Rate Clipping Stabilizes Learning