Pytorch implementation of lookahead optimizer(https://arxiv.org/pdf/1907.08610.pdf) and RAdam(https://arxiv.org/pdf/1908.03265.pdf)
python
deep-learning
neural-network
optimizer
pytorch
lookahead
adamw
radam
lookahead-optim
lookahead-pytorch
-
Updated
Jun 25, 2022 - Jupyter Notebook