LARC(optimizer[, trust_coefficient, clip, …])
|
LARC is a pytorch implementation of both the scaling and clipping variants of LARC, in which the ratio between gradient and parameter magnitudes is used to calculate an adaptive local learning rate for each individual parameter.
|