torch-optimizer -- collection of optimizers for Pytorch
翻译 - 炬优化器-Pytorch优化器的集合
Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay
