Paper ID: 2202.09701

A History of Meta-gradient: Gradient Methods for Meta-learning

Richard S. Sutton

The history of meta-learning methods based on gradient descent is reviewed, focusing primarily on methods that adapt step-size (learning rate) meta-parameters.

Submitted: Feb 20, 2022