NeurosciencebioRxivPreprint
An Adaptive Optimizer without User-Specified Hyperparameters through Historical Projection and Self-Calibrated Scaling
This paper introduces YamAdam, an adaptive optimizer with no user-specified hyperparameters, and shows it outperforms 30 other optimizer settings across multiple tasks.
4 citations