Bayesian Model-Agnostic Meta-Learning
Not on the map. Why?
Abstract (arXiv)
Learning to infer Bayesian posterior from a few-shot dataset is an important step towards robust meta-learning due to the model uncertainty inherent in the problem. In this paper, we propose a novel Bayesian model-agnostic meta-learning method. The proposed method combines scalable gradient-based meta-learning with nonparametric variational inference in a principled probabilistic framework. During fast adaptation, the method is capable of learning complex uncertainty structure beyond a point estimate or a simple Gaussian approximation. In addition, a robust Bayesian meta-update mechanism with a new meta-loss prevents overfitting during meta-update. Remaining an efficient gradient-based meta-learner, the method is also model-agnostic and simple to implement. Experiment results show the accuracy and robustness of the proposed method in various tasks: sinusoidal regression, image classification, active learning, and reinforcement learning.
Key facts. Cited by 194 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 66; 2022: 45; 2023: 40; 2024: 17; 2025: 19; 2026: 7.
194 papers.
Sort:
By area:
- 2021Transformers Can Do Bayesian Inferencecited by 360
- 2021Efficiently Identifying Task Groupings for Multi-Task Learningcited by 222
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
- 2022Prompting Decision Transformer for Few-Shot Policy Generalizationcited by 146
- 2021Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learningcited by 113
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AIcited by 62
- 2022Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learningcited by 58
- 2021Bayesian Learning via Neural Schr"odinger-F"ollmer Flowscited by 56
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
38 more
- 2021Diminishing Uncertainty within the Training Pool: Active Learning for Medical Image Segmentationcited by 45
- 2021Generalization Bounds For Meta-Learning: An Information-Theoretic Analysiscited by 45
- 2023Modeling rapid language learning by distilling Bayesian priors into artificial neural networkscited by 42
- 2021Uncertainty-guided Model Generalization to Unseen Domainscited by 41
- 2021Meta-Learning Dynamics Forecasting Using Task Inferencecited by 38
- 2021Meta-Auto-Decoder for Solving Parametric Partial Differential Equationscited by 36
- 2022FedPop: A Bayesian Approach for Personalised Federated Learningcited by 35
- 2021Few-shot Image Classification: Just Use a Library of Pre-trained Feature Extractors and a Simple Classifiercited by 32
- 2021Fast Adaptation with Linearized Neural Networkscited by 32
- 2022Matching Feature Sets for Few-Shot Image Classificationcited by 25
- 2023Meta-learning approaches for few-shot learning: A survey of recent advancescited by 25
- 2025Latent Thought Models with Variational Bayes Inference-Time Computationcited by 25
- 2022HyperShot: Few-Shot Learning by Kernel HyperNetworkscited by 24
- 2021Meta-Learning Reliable Priors in the Function Spacecited by 23
- 2021Reinforced Few-Shot Acquisition Function Learning for Bayesian Optimizationcited by 23
- 2021Fed-ensemble: Improving Generalization through Model Ensembling in Federated Learningcited by 23
- 2021The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learningcited by 23
- 2021Bayesian Meta-Learning for Few-Shot Policy Adaptation Across Robotic Platformscited by 22
- 2021Bridging the Gap Between Practice and PAC-Bayes Theory in Few-Shot Meta-Learningcited by 21
- 2021Few-Shot Learning with Class Imbalancecited by 18
- 2021Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classificationcited by 18
- 2021Out-of-Domain Generalization from a Single Source: An Uncertainty Quantification Approachcited by 18
- 2021An Optimization-Based Meta-Learning Model for MRI Reconstruction with Diverse Datasetcited by 18
- 2022What Matters For Meta-Learning Vision Regression Tasks?cited by 18
- 2021Model-based Meta Reinforcement Learning using Graph Structured Surrogate Modelscited by 17
- 2021Sampling with Mirrored Stein Operatorscited by 17
- 2022HyperMAML: Few-Shot Adaptation of Deep Models with Hypernetworkscited by 17
- 2022Few-Shot Calibration of Set Predictors via Meta-Learned Cross-Validation-Based Conformal Predictioncited by 17
- 2023Recurrent Hypernetworks are Surprisingly Strong in Meta-RLcited by 16
- 2021Meta-Learning with Neural Tangent Kernelscited by 15
- 2021Blurs Behave Like Ensembles: Spatial Smoothings to Improve Accuracy, Uncertainty, and Robustnesscited by 14
- 2021Hierarchical Variational Memory for Few-shot Learning Across Domainscited by 14
- 2022The Effect of Diversity in Meta-Learningcited by 14
- 2022Meta-Learning Priors for Safe Bayesian Optimizationcited by 14
- 2021Adaptive Knowledge-Enhanced Bayesian Meta-Learning for Few-shot Event Detectioncited by 13
- 2022Is Bayesian Model-Agnostic Meta Learning Better than Model-Agnostic Meta Learning, Provably?cited by 13
- 2023Learning Large-scale Neural Fields via Context Pruned Meta-Learningcited by 13
- 2021Non-Gaussian Gaussian Processes for Few-Shot Regressioncited by 12
50 most cited of 194 All 194 (JSON)
- 2026Purification and Regulation: Comorbidity-Aware Multi-Label Few-Shot Learning for Medical Image Classification18 Sep 2026
- 2026MetaKoopman: Bayesian Meta-Learning of Koopman Operators for Modeling Structured Dynamics under Distribution Shifts28 Jul 2026
- 2026Cumulative Meta-Learning from Active Learning Queries for Robustness to Spurious Correlations20 May 2026
- 2026Compositional Meta-Learning for Mitigating Task Heterogeneity in Physics-Informed Neural Networks29 Apr 2026
- 2026Binomial Gradient-Based Meta-Learning for Enhanced Meta-Gradient Estimation14 Apr 2026
- 2026BayMOTH: Bayesian optiMizatiOn with meTa-lookahead -- a simple approacH13 Apr 2026
- 2026Bayesian Meta-Learning with Expert Feedback for Task-Shift Adaptation through Causal Embeddings23 Feb 2026
- 2025MAD-NG: Meta-Auto-Decoder Neural Galerkin Method for Solving Parametric Partial Differential Equations25 Dec 2025
- 2025Meta-RL with Bayesian Linear Task Models24 Dec 2025
- 2025Context-aware Learned Mesh-based Simulation via Trajectory-Level Meta-Learning7 Nov 2025
- 2025Neural Variational Dropout Processes22 Oct 2025
- 2025MaNGO - Adaptable Graph Network Simulators via Meta-Learning7 Oct 2025
38 more
- 2025On Quantification of Borrowing of Information in Hierarchical Bayesian Models22 Sep 2025
- 2025Learnable Loss Geometries with Mirror Descent for Scalable and Convergent Meta-Learning2 Sep 2025
- 2025Optimizing In-Context Learning for Efficient Full Conformal Prediction1 Sep 2025
- 2025Domain-Generalization to Improve Learning in Meta-Learning Algorithms13 Aug 2025
- 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection10 Jul 2025
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimation9 Jul 2025
- 2025Quantifying Uncertainty in the Presence of Distribution Shifts23 Jun 2025
- 2025BOFormer: Learning to Solve Multi-Objective Bayesian Optimization via Non-Markovian RL28 May 2025
- 2025Self-cross Feature based Spiking Neural Networks for Efficient Few-shot Learning12 May 2025
- 2025Combining Bayesian Inference and Reinforcement Learning for Agent Decision Making: A Review12 May 2025
- 2025Fast and Robust: Task Sampling with Posterior and Diversity Synergies for Adaptive Decision-Makers in Randomized Environments27 Apr 2025
- 2025Benchmarking for Practice: Few-Shot Time-Series Crop-Type Classification on the EuroCropsML Dataset15 Apr 2025
- 2025Riemannian Geometric-based Meta Learning14 Mar 2025
- 2025Latent Thought Models with Variational Bayes Inference-Time Computation3 Feb 2025
- 2024Meta-Controller: Few-Shot Imitation of Unseen Embodiments and Tasks in Continuous Control10 Dec 2024
- 2024Proxy-informed Bayesian transfer learning with unknown sources5 Nov 2024
- 2024Attr-Int: A Simple and Effective Entity Alignment Framework for Heterogeneous Knowledge Graphs17 Oct 2024
- 2024Towards General Deepfake Detection with Dynamic Curriculum15 Oct 2024
- 2024A Stochastic Approach to Bi-Level Optimization for Hyperparameter Optimization and Meta Learning14 Oct 2024
- 2024Reducing Variance in Meta-Learning via Laplace Approximation for Regression Tasks2 Oct 2024
- 2024Strategic Arms with Side Communication Prevail Over Low-Regret MAB Algorithms30 Aug 2024
- 2024Bayesian meta learning for trustworthy uncertainty quantification27 Jul 2024
- 2024Accelerating Convergence in Bayesian Few-Shot Classification2 May 2024
- 2024T-Pixel2Mesh: Combining Global and Local Transformer for 3D Mesh Generation from a Single Image20 Mar 2024
- 2024XB-MAML: Learning Expandable Basis Parameters for Effective Meta-Learning with Wide Task Coverage11 Mar 2024
- 2024Bayesian Multi-Task Transfer Learning for Soft Prompt Tuning13 Feb 2024
- 2024Brain-Body-Task Co-Adaptation can Improve Autonomous Learning and Speed of Bipedal Walking4 Feb 2024
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI1 Feb 2024
- 2024BayesPrompt: Prompting Large-Scale Pre-Trained Language Models on Few-shot Inference via Debiased Domain Abstraction25 Jan 2024
- 2024TEN-GUARD: Tensor Decomposition for Backdoor Attack Detection in Deep Neural Networks6 Jan 2024
- 2024TRLS: A Time Series Representation Learning Framework via Spectrogram for Medical Signal Processing6 Jan 2024
- 2023DarkShot: Lighting Dark Images with Low-Compute and High-Quality28 Dec 2023
- 2023Bayesian Transfer Learning20 Dec 2023
- 2023Self-supervised Adaptive Pre-training of Multilingual Speech Models for Language and Dialect Identification12 Dec 2023
- 2023GMTR: Graph Matching Transformers14 Nov 2023
- 2023Latent Task-Specific Graph Network Simulators9 Nov 2023
- 2023On Task-personalized Multimodal Few-shot Learning for Visually-rich Document Entity Retrieval1 Nov 2023
- 2023Amortised Inference in Neural Networks for Small-Scale Probabilistic Meta-Learning24 Oct 2023
50 newest of 194 All 194 (JSON)
- 2025Meta-RL with Bayesian Linear Task Modelscited by 0
- 2025Meta-RL with Bayesian Linear Task Models24 Dec 2025
- 2021Transformers Can Do Bayesian Inferencecited by 360
- 2021Efficiently Identifying Task Groupings for Multi-Task Learningcited by 222
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 163
- 2021Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learningcited by 113
- 2021Priors in Bayesian Deep Learning: A Reviewcited by 101
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
- 2024Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AIcited by 62
- 2022Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learningcited by 58
- 2021Bayesian Learning via Neural Schr"odinger-F"ollmer Flowscited by 56
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
- 2021Diminishing Uncertainty within the Training Pool: Active Learning for Medical Image Segmentationcited by 45
12 most cited of 190 All 190 (JSON)
- 2026Purification and Regulation: Comorbidity-Aware Multi-Label Few-Shot Learning for Medical Image Classification18 Sep 2026
- 2026MetaKoopman: Bayesian Meta-Learning of Koopman Operators for Modeling Structured Dynamics under Distribution Shifts28 Jul 2026
- 2026Cumulative Meta-Learning from Active Learning Queries for Robustness to Spurious Correlations20 May 2026
- 2026Compositional Meta-Learning for Mitigating Task Heterogeneity in Physics-Informed Neural Networks29 Apr 2026
- 2026Binomial Gradient-Based Meta-Learning for Enhanced Meta-Gradient Estimation14 Apr 2026
- 2026BayMOTH: Bayesian optiMizatiOn with meTa-lookahead -- a simple approacH13 Apr 2026
- 2026Bayesian Meta-Learning with Expert Feedback for Task-Shift Adaptation through Causal Embeddings23 Feb 2026
- 2025MAD-NG: Meta-Auto-Decoder Neural Galerkin Method for Solving Parametric Partial Differential Equations25 Dec 2025
- 2025Context-aware Learned Mesh-based Simulation via Trajectory-Level Meta-Learning7 Nov 2025
- 2025Neural Variational Dropout Processes22 Oct 2025
- 2025MaNGO - Adaptable Graph Network Simulators via Meta-Learning7 Oct 2025
- 2025On Quantification of Borrowing of Information in Hierarchical Bayesian Models22 Sep 2025
12 newest of 190 All 190 (JSON)