Alpha MAML: Adaptive Model-Agnostic Meta-Learning
Not on the map. Why?
Abstract (arXiv)
Model-agnostic meta-learning (MAML) is a meta-learning technique to train a model on a multitude of learning tasks in a way that primes the model for few-shot learning of new tasks. The MAML algorithm performs well on few-shot learning problems in classification, regression, and fine-tuning of policy gradients in reinforcement learning, but comes with the need for costly hyperparameter tuning for training stability. We address this shortcoming by introducing an extension to MAML, called Alpha MAML, to incorporate an online hyperparameter adaptation scheme that eliminates the need to tune meta-learning and learning rates. Our results with the Omniglot database demonstrate a substantial reduction in the need to tune MAML training hyperparameters and improvement to training stability with less sensitivity to hyperparameter choice.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 1; 2023: 8; 2024: 1; 2025: 2; 2026: 1.
25 papers.
Sort:
- 2021Personalized Federated Learning using Hypernetworkscited by 210
- 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyondcited by 151
- 2021Personalized Federated Learning with Gaussian Processescited by 76
- 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
- 2021Domain Invariant Representation Learning with Domain Density Transformationscited by 53
- 2021Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learningcited by 49
- 2023An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learningcited by 39
- 2021Generalization of Model-Agnostic Meta-Learning Algorithms: Recurring and Unseen Taskscited by 36
- 2023Meta-learning approaches for few-shot learning: A survey of recent advancescited by 25
- 2023Learning to Learn from APIs: Black-Box Data-Free Meta-Learningcited by 18
- 2021PAC-Bayes Bounds for Meta-learning with Data-Dependent Priorcited by 11
- 2022Task Discovery: Finding the Tasks that Neural Networks Generalize oncited by 9
13 more
- 2023A Partially Supervised Reinforcement Learning Framework for Visual Active Searchcited by 8
- 2021Memory-Based Optimization Methods for Model-Agnostic Meta-Learning and Personalized Federated Learningcited by 6
- 2023Convergence of Gradient-based MAML in LQRcited by 5
- 2021Embedding Adaptation is Still Needed for Few-Shot Learningcited by 2
- 2021Bayesian Active Meta-Learning for Few Pilot Demodulation and Equalizationcited by 2
- 2023Generalizing Supervised Deep Learning MRI Reconstruction to Multiple and Unseen Contrasts using Meta-Learning Hypernetworkscited by 2
- 2021Meta Adversarial Perturbationscited by 1
- 2023Towards Personalized Preprocessing Pipeline Searchcited by 1
- 2024Meta-Learning Neural Procedural Biasescited by 1
- 2025Benchmarking for Practice: Few-Shot Time-Series Crop-Type Classification on the EuroCropsML Datasetcited by 1
- 2025Heterogeneity-Oblivious Robust Federated Learningcited by 1
- 2021Graceful Degradation and Related Fieldscited by 0
- 2026Meta-Learning and Meta-Reinforcement Learning -- Tracing the Path towards DeepMind's Adaptive Agentcited by 0
- 2026Meta-Learning and Meta-Reinforcement Learning -- Tracing the Path towards DeepMind's Adaptive Agent23 Feb 2026
- 2025Heterogeneity-Oblivious Robust Federated Learning5 Aug 2025
- 2025Benchmarking for Practice: Few-Shot Time-Series Crop-Type Classification on the EuroCropsML Dataset15 Apr 2025
- 2024Meta-Learning Neural Procedural Biases12 Jun 2024
- 2023A Partially Supervised Reinforcement Learning Framework for Visual Active Search15 Oct 2023
- 2023Convergence of Gradient-based MAML in LQR12 Sep 2023
- 2023An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning1 Aug 2023
- 2023Generalizing Supervised Deep Learning MRI Reconstruction to Multiple and Unseen Contrasts using Meta-Learning Hypernetworks13 Jul 2023
- 2023Advances and Challenges in Meta-Learning: A Technical Review10 Jul 2023
- 2023Learning to Learn from APIs: Black-Box Data-Free Meta-Learning28 May 2023
- 2023Meta-learning approaches for few-shot learning: A survey of recent advances13 Mar 2023
- 2023Towards Personalized Preprocessing Pipeline Search28 Feb 2023
13 more
- 2022Task Discovery: Finding the Tasks that Neural Networks Generalize on1 Dec 2022
- 2021Meta Adversarial Perturbations19 Nov 2021
- 2021Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learning8 Oct 2021
- 2021Bayesian Active Meta-Learning for Few Pilot Demodulation and Equalization2 Aug 2021
- 2021Personalized Federated Learning with Gaussian Processes29 Jun 2021
- 2021Graceful Degradation and Related Fields21 Jun 2021
- 2021Memory-Based Optimization Methods for Model-Agnostic Meta-Learning and Personalized Federated Learning9 Jun 2021
- 2021Embedding Adaptation is Still Needed for Few-Shot Learning15 Apr 2021
- 2021Personalized Federated Learning using Hypernetworks8 Mar 2021
- 2021Domain Invariant Representation Learning with Domain Density Transformations9 Feb 2021
- 2021Generalization of Model-Agnostic Meta-Learning Algorithms: Recurring and Unseen Tasks7 Feb 2021
- 2021PAC-Bayes Bounds for Meta-learning with Data-Dependent Prior7 Feb 2021
- 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond27 Jan 2021
- 2021Personalized Federated Learning using Hypernetworkscited by 210
- 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyondcited by 151
- 2021Personalized Federated Learning with Gaussian Processescited by 76
- 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
- 2021Domain Invariant Representation Learning with Domain Density Transformationscited by 53
- 2021Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learningcited by 49
- 2023An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learningcited by 39
- 2021Generalization of Model-Agnostic Meta-Learning Algorithms: Recurring and Unseen Taskscited by 36
- 2023Meta-learning approaches for few-shot learning: A survey of recent advancescited by 25
- 2023Learning to Learn from APIs: Black-Box Data-Free Meta-Learningcited by 18
- 2021PAC-Bayes Bounds for Meta-learning with Data-Dependent Priorcited by 11
- 2022Task Discovery: Finding the Tasks that Neural Networks Generalize oncited by 9
12 most cited of 25 All 25 (JSON)
- 2026Meta-Learning and Meta-Reinforcement Learning -- Tracing the Path towards DeepMind's Adaptive Agent23 Feb 2026
- 2025Heterogeneity-Oblivious Robust Federated Learning5 Aug 2025
- 2025Benchmarking for Practice: Few-Shot Time-Series Crop-Type Classification on the EuroCropsML Dataset15 Apr 2025
- 2024Meta-Learning Neural Procedural Biases12 Jun 2024
- 2023A Partially Supervised Reinforcement Learning Framework for Visual Active Search15 Oct 2023
- 2023Convergence of Gradient-based MAML in LQR12 Sep 2023
- 2023An Introduction to Bi-level Optimization: Foundations and Applications in Signal Processing and Machine Learning1 Aug 2023
- 2023Generalizing Supervised Deep Learning MRI Reconstruction to Multiple and Unseen Contrasts using Meta-Learning Hypernetworks13 Jul 2023
- 2023Advances and Challenges in Meta-Learning: A Technical Review10 Jul 2023
- 2023Learning to Learn from APIs: Black-Box Data-Free Meta-Learning28 May 2023
- 2023Meta-learning approaches for few-shot learning: A survey of recent advances13 Mar 2023
- 2023Towards Personalized Preprocessing Pipeline Search28 Feb 2023
12 newest of 25 All 25 (JSON)