A History of Meta-gradient: Gradient Methods for Meta-learning
Not on the map. Why?
Abstract (arXiv)
The history of meta-learning methods based on gradient descent is reviewed, focusing primarily on methods that adapt step-size (learning rate) meta-parameters.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 9 of its 57 references that are in the map. First posted on arXiv 20 Feb 2022.
Builds on
9 of 57 references.
References · 9
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2016Learning to learn by gradient descent by gradient descentcited by 616
- 2018Learning to Adapt in Dynamic, Real-World Environments Through Meta-Reinforcement Learningcited by 270
- 2017DeepStack: Expert-Level Artificial Intelligence in No-Limit Pokercited by 228
- 2018Meta-Gradient Reinforcement Learningcited by 156
- 2019Discovery of Useful Questions as Auxiliary Taskscited by 45
- 2018TIDBD: Adapting Temporal-difference Step-sizes Through Stochastic Meta-descentcited by 5
- 2018Metatrace Actor-Critic: Online Step-size Tuning by Meta-gradient Descent for Reinforcement Learning Controlcited by 5
- 2019Examining the Use of Temporal-Difference Incremental Delta-Bar-Delta for Real-World Predictive Knowledge Architecturescited by 1
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 4; 2025: 0; 2026: 1.
7 papers.
- 2024In-context Exploration-Exploitation for Reinforcement Learningcited by 16
- 2024Step-size Optimization for Continual Learningcited by 6
- 2024MetaOptimize: A Framework for Optimizing Step Sizes and Other Meta-parameterscited by 5
- 2022Reinforcement Teachingcited by 1
- 2024PID Accelerated Temporal Difference Algorithmscited by 1
- 2022Learning to Accelerate by the Methods of Step-size Planningcited by 0
- 2026Meta-Learning and Meta-Reinforcement Learning -- Tracing the Path towards DeepMind's Adaptive Agentcited by 0
- 2026Meta-Learning and Meta-Reinforcement Learning -- Tracing the Path towards DeepMind's Adaptive Agent23 Feb 2026
- 2024PID Accelerated Temporal Difference Algorithms11 Jul 2024
- 2024In-context Exploration-Exploitation for Reinforcement Learning11 Mar 2024
- 2024MetaOptimize: A Framework for Optimizing Step Sizes and Other Meta-parameters4 Feb 2024
- 2024Step-size Optimization for Continual Learning30 Jan 2024
- 2022Reinforcement Teaching25 Apr 2022
- 2022Learning to Accelerate by the Methods of Step-size Planning1 Apr 2022