Meta-Learning Probabilistic Inference For Prediction
Not on the map. Why?
Abstract (arXiv)
This paper introduces a new framework for data efficient and versatile learning. Specifically: 1) We develop ML-PIP, a general framework for Meta-Learning approximate Probabilistic Inference for Prediction. ML-PIP extends existing probabilistic interpretations of meta-learning to cover a broad class of methods. 2) We introduce VERSA, an instance of the framework employing a flexible and versatile amortization network that takes few-shot learning datasets as inputs, with arbitrary numbers of shots, and outputs a distribution over task-specific parameters in a single forward pass. VERSA substitutes optimization at test time with forward passes through inference networks, amortizing the cost of inference and relieving the need for second derivatives during training. 3) We evaluate VERSA on benchmark datasets where the method sets new state-of-the-art results, handles arbitrary numbers of shots, and for classification, arbitrary numbers of classes at train and test time. The power of the approach is then demonstrated through a challenging few-shot ShapeNet view reconstruction task.
Key facts. Cited by 108 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 26; 2023: 19; 2024: 14; 2025: 15; 2026: 6.
108 papers.
Sort:
By area:
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2021Domain Generalization: A Surveycited by 760
- 2022Transformers learn in-context by gradient descentcited by 714
- 2021Transformers Can Do Bayesian Inferencecited by 338
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 243
- 2022Self-Support Few-Shot Semantic Segmentationcited by 96
- 2022Tutorial on amortized optimizationcited by 83
- 2025Universal Actions for Enhanced Embodied Foundation Modelscited by 80
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2021Bayesian Learning via Neural Schr"odinger-F"ollmer Flowscited by 56
- 2022Bayesian Prompt Learning for Image-Language Model Generalizationcited by 51
38 more
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
- 2023In-Context Learning Learns Label Relationships but Is Not Conventional Learningcited by 48
- 2021Property-Aware Relation Networks for Few-Shot Molecular Property Predictioncited by 41
- 2024Mixture of In-Context Prompters for Tabular PFNscited by 32
- 2021ORBIT: A Real-World Few-Shot Dataset for Teachable Object Recognitioncited by 29
- 2021Kernel Continual Learningcited by 27
- 2022Realistic Evaluation of Transductive Few-Shot Learningcited by 26
- 2022Learning to Generalize across Domains on Single Test Samplescited by 24
- 2022HyperShot: Few-Shot Learning by Kernel HyperNetworkscited by 24
- 2021The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learningcited by 23
- 2021Bayesian Meta-Learning for Few-Shot Policy Adaptation Across Robotic Platformscited by 22
- 2021Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classificationcited by 18
- 2022What Matters For Meta-Learning Vision Regression Tasks?cited by 18
- 2022HyperMAML: Few-Shot Adaptation of Deep Models with Hypernetworkscited by 16
- 2021Variational Multi-Task Learning with Gumbel-Softmax Priorscited by 15
- 2021A contrastive rule for meta-learningcited by 14
- 2021Memory Efficient Meta-Learning with Large Imagescited by 14
- 2022Is Bayesian Model-Agnostic Meta Learning Better than Model-Agnostic Meta Learning, Provably?cited by 13
- 2023From system models to class models: An in-context learning paradigmcited by 13
- 2025Skill Expansion and Composition in Parameter Spacecited by 13
- 2021Non-Gaussian Gaussian Processes for Few-Shot Regressioncited by 12
- 2021Learning to Rectify for Robust Learning with Noisy Labelscited by 12
- 2023Patch-Prompt Aligned Bayesian Prompt Tuning for Vision-Language Modelscited by 12
- 2024Query-guided Prototype Evolution Network for Few-Shot Segmentationcited by 12
- 2021Adaptive Convolutions with Per-pixel Dynamic Filter Atomcited by 11
- 2023Model-Agnostic Meta-Learning for Multilingual Hate Speech Detectioncited by 11
- 2025Estimating Interventional Distributions with Uncertain Causal Graphs through Meta-Learningcited by 11
- 2021Information-Theoretic Analysis of Epistemic Uncertainty in Bayesian Meta-learningcited by 10
- 2022Adaptive Dimension Reduction and Variational Inference for Transductive Few-Shot Classificationcited by 10
- 2022Evidential Conditional Neural Processescited by 10
- 2022Multidimensional Belief Quantification for Label-Efficient Meta-Learningcited by 9
- 2023A Simple Yet Effective Strategy to Robustify the Meta Learning Paradigmcited by 9
- 2021Bayesian Embeddings for Few-Shot Open World Recognitioncited by 8
- 2022Hidden Parameter Recurrent State Space Models For Changing Dynamics Scenarioscited by 8
- 2023Episodic Multi-Task Learning with Heterogeneous Neural Processescited by 8
- 2023Hacking Task Confounder in Meta-Learningcited by 8
- 2024Learning to Continually Learn with the Bayesian Principlecited by 8
- 2021Few-Shot Video Object Detectioncited by 7
50 most cited of 108 All 108 (JSON)
- 2026Toward Machine Learning with the Unit as a Primitive: Learning from Unit-Linked Events25 Aug 2026
- 2026Multi-Task Bayesian In-Context Learning18 Jun 2026
- 2026Bayesian meta-learning for modeling Alzheimer's disease progression1 Jun 2026
- 2026Goal-driven Bayesian Optimal Experimental Design for Robust Decision-Making Under Model Uncertainty25 May 2026
- 2026Amortising Inference and Meta-Learning Priors in Neural Networks9 Feb 2026
- 2026BayPrAnoMeta: Bayesian Proto-MAML for Few-Shot Industrial Image Anomaly Detection27 Jan 2026
- 2025Context-aware Learned Mesh-based Simulation via Trajectory-Level Meta-Learning7 Nov 2025
- 2025Federated Learning via Meta-Variational Dropout23 Oct 2025
- 2025Neural Variational Dropout Processes22 Oct 2025
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model11 Oct 2025
- 2025metabeta -- A fast neural model for Bayesian mixed-effects regression8 Oct 2025
- 2025MaNGO - Adaptable Graph Network Simulators via Meta-Learning7 Oct 2025
38 more
- 2025On Quantification of Borrowing of Information in Hierarchical Bayesian Models22 Sep 2025
- 2025GraphPPD: Posterior Predictive Modelling for Graph-Level Inference23 Aug 2025
- 2025Estimating Interventional Distributions with Uncertain Causal Graphs through Meta-Learning7 Jul 2025
- 2025Bayesian Meta-Reinforcement Learning with Laplace Variational Recurrent Networks24 May 2025
- 2025Sparse Gaussian Neural Processes2 Apr 2025
- 2025Skill Expansion and Composition in Parameter Space9 Feb 2025
- 2025Universal Actions for Enhanced Embodied Foundation Models17 Jan 2025
- 2025Enhancing Unsupervised Graph Few-shot Learning via Set Functions and Optimal Transport10 Jan 2025
- 2025Bridge the Inference Gaps of Neural Processes via Expectation Maximization4 Jan 2025
- 2024Neuromodulated Meta-Learning11 Nov 2024
- 2024Proxy-informed Bayesian transfer learning with unknown sources5 Nov 2024
- 2024Theoretical Investigations and Practical Enhancements on Tail Task Risk Minimization in Meta Learning30 Oct 2024
- 2024Amortized Inference of Causal Models via Conditional Fixed-Point Iterations8 Oct 2024
- 2024Reducing Variance in Meta-Learning via Laplace Approximation for Regression Tasks2 Oct 2024
- 2024Localization and Expansion: A Decoupled Framework for Point Cloud Few-shot Semantic Segmentation25 Aug 2024
- 2024Artificial Inductive Bias for Synthetic Tabular Data Generation in Data-Scarce Scenarios3 Jul 2024
- 2024Learning to Continually Learn with the Bayesian Principle29 May 2024
- 2024Mixture of In-Context Prompters for Tabular PFNs25 May 2024
- 2024Learning World Models With Hierarchical Temporal Abstractions: A Probabilistic Perspective24 Apr 2024
- 2024Adapting Mental Health Prediction Tasks for Cross-lingual Learning via Meta-Training and In-context Learning with Large Language Model13 Apr 2024
- 2024Class-Incremental Few-Shot Event Detection2 Apr 2024
- 2024Query-guided Prototype Evolution Network for Few-Shot Segmentation11 Mar 2024
- 2024FORML: A Riemannian Hessian-free Method for Meta-learning on Stiefel Manifolds28 Feb 2024
- 2023Hacking Task Confounder in Meta-Learning10 Dec 2023
- 2023Latent Task-Specific Graph Network Simulators9 Nov 2023
- 2023Episodic Multi-Task Learning with Heterogeneous Neural Processes28 Oct 2023
- 2023Amortised Inference in Neural Networks for Small-Scale Probabilistic Meta-Learning24 Oct 2023
- 2023Bayesian Active Learning in the Presence of Nuisance Parameters23 Oct 2023
- 2023Task Aware Modulation using Representation Learning: An Approach for Few Shot Learning in Environmental Systems7 Oct 2023
- 2023Amortized Network Intervention to Steer the Excitatory Point Processes6 Oct 2023
- 2023A Simple Yet Effective Strategy to Robustify the Meta Learning Paradigm1 Oct 2023
- 2023Amortised Inference in Bayesian Neural Networks6 Sep 2023
- 2023From system models to class models: An in-context learning paradigm25 Aug 2023
- 2023Prompt2Gaussia: Uncertain Prompt-learning for Script Event Prediction4 Aug 2023
- 2023In-Context Learning Learns Label Relationships but Is Not Conventional Learning23 Jul 2023
- 2023Comparing the Efficacy of Fine-Tuning and Meta-Learning for Few-Shot Policy Imitation23 Jun 2023
- 2023A Hierarchical Bayesian Model for Deep Few-Shot Meta Learning16 Jun 2023
- 2023FewSAR: A Few-shot SAR Image Classification Benchmark16 Jun 2023
50 newest of 108 All 108 (JSON)
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023Patch-Prompt Aligned Bayesian Prompt Tuning for Vision-Language Modelscited by 12
- 2021Domain Generalization: A Surveycited by 760
- 2022Transformers learn in-context by gradient descentcited by 714
- 2021Transformers Can Do Bayesian Inferencecited by 338
- 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 243
- 2022Self-Support Few-Shot Semantic Segmentationcited by 96
- 2022Tutorial on amortized optimizationcited by 83
- 2025Universal Actions for Enhanced Embodied Foundation Modelscited by 80
- 2021MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Imagescited by 78
- 2021Bayesian Learning via Neural Schr"odinger-F"ollmer Flowscited by 56
- 2022Bayesian Prompt Learning for Image-Language Model Generalizationcited by 51
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
- 2023In-Context Learning Learns Label Relationships but Is Not Conventional Learningcited by 48
12 most cited of 103 All 103 (JSON)
- 2026Toward Machine Learning with the Unit as a Primitive: Learning from Unit-Linked Events25 Aug 2026
- 2026Multi-Task Bayesian In-Context Learning18 Jun 2026
- 2026Bayesian meta-learning for modeling Alzheimer's disease progression1 Jun 2026
- 2026Goal-driven Bayesian Optimal Experimental Design for Robust Decision-Making Under Model Uncertainty25 May 2026
- 2026Amortising Inference and Meta-Learning Priors in Neural Networks9 Feb 2026
- 2026BayPrAnoMeta: Bayesian Proto-MAML for Few-Shot Industrial Image Anomaly Detection27 Jan 2026
- 2025Context-aware Learned Mesh-based Simulation via Trajectory-Level Meta-Learning7 Nov 2025
- 2025Federated Learning via Meta-Variational Dropout23 Oct 2025
- 2025Neural Variational Dropout Processes22 Oct 2025
- 2025metabeta -- A fast neural model for Bayesian mixed-effects regression8 Oct 2025
- 2025MaNGO - Adaptable Graph Network Simulators via Meta-Learning7 Oct 2025
- 2025On Quantification of Borrowing of Information in Hierarchical Bayesian Models22 Sep 2025
12 newest of 103 All 103 (JSON)