Meta-Learning: A Survey
Not on the map. Why?
Abstract (arXiv)
Meta-learning, or learning to learn, is the science of systematically observing how different machine learning approaches perform on a wide range of learning tasks, and then learning from this experience, or meta-data, to learn new tasks much faster than otherwise possible. Not only does this dramatically speed up and improve the design of machine learning pipelines or neural architectures, it also allows us to replace hand-engineered algorithms with novel approaches learned in a data-driven way. In this chapter, we provide an overview of the state of the art in this fascinating and continuously evolving field.
Key facts. Cited by 254 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 1; 2021: 73; 2022: 76; 2023: 45; 2024: 22; 2025: 24; 2026: 12.
254 papers.
Sort:
By area:
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2021A Survey on Deep Semi-supervised Learningcited by 250
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2023Knowledge Editing for Large Language Models: A Surveycited by 189
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2022Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modelingcited by 126
- 2025REASONING GYM: Reasoning Environments for Reinforcement Learning with Verifiable Rewardscited by 121
- 2022Learning What Not to Segment: A New Perspective on Few-Shot Segmentationcited by 120
- 2021Machine Learning with a Reject Option: A surveycited by 107
38 more
- 2022Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Timecited by 85
- 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentationcited by 84
- 2022πBO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimizationcited by 69
- 2021Continual Learning via Local Module Compositioncited by 61
- 2022Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learningcited by 57
- 2024Beyond Model Adaptation at Test Time: A Surveycited by 55
- 2021A Survey of Machine Learning for Computer Architecture and Systemscited by 53
- 2021Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptationcited by 50
- 2020Provable Representation Learning for Imitation Learning via Bi-level Optimizationcited by 41
- 2021Generalization of Model-Agnostic Meta-Learning Algorithms: Recurring and Unseen Taskscited by 36
- 2021Continual Learning for Recurrent Neural Networks: an Empirical Evaluationcited by 34
- 2021Exploiting Adapters for Cross-lingual Low-resource Speech Recognitioncited by 33
- 2022Image Coding for Machines with Omnipotent Feature Learningcited by 31
- 2022A computational framework for physics-informed symbolic regression with straightforward integration of domain knowledgecited by 31
- 2024Quantum Architecture Search: A Surveycited by 31
- 2022A Closer Look at Learned Optimization: Stability, Robustness, and Inductive Biasescited by 30
- 2021Artificial Intelligence in Drug Discovery: Applications and Techniquescited by 28
- 2022Active Surrogate Estimators: An Active Learning Approach to Label-Efficient Model Evaluationcited by 26
- 2022Meta Learning for Natural Language Processing: A Surveycited by 26
- 2021VolcanoML: Speeding up End-to-End AutoML via Scalable Search Space Decompositioncited by 25
- 2021Towards Green Automated Machine Learning: Status Quo and Future Directionscited by 25
- 2019Federated Imitation Learning: A Novel Framework for Cloud Robotic Systems with Heterogeneous Sensor Datacited by 24
- 2021Formalizing the Generalization-Forgetting Trade-off in Continual Learningcited by 24
- 2023Learngene: Inheriting Condensed Knowledge from the Ancestry Model to Descendant Modelscited by 24
- 2021A deep learning theory for neural networks grounded in physicscited by 23
- 2021Meta-Adaptive Nonlinear Control: Theory and Algorithmscited by 23
- 2021The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learningcited by 23
- 2022Sylph: A Hypernetwork Framework for Incremental Few-shot Object Detectioncited by 23
- 2021How to Train Your MAML to Excel in Few-Shot Classificationcited by 22
- 2022Global Convergence of MAML and Theory-Inspired Neural Architecture Search for Few-Shot Learningcited by 22
- 2021A Semi-Personalized System for User Cold Start Recommendation on Music Streaming Appscited by 21
- 2021Meta-Learning-Based Deep Reinforcement Learning for Multiobjective Optimization Problemscited by 20
- 2021Fairness-Aware Online Meta-learningcited by 19
- 2021TeachMyAgent: a Benchmark for Automatic Curriculum Learning in Deep RLcited by 18
- 2022Leaving No One Behind: A Multi-Scenario Multi-Task Meta Learning Approach for Advertiser Modelingcited by 18
- 2022Toward Unsupervised Outlier Model Selectioncited by 18
- 2021On Data Efficiency of Meta-learningcited by 16
- 2022Winning solutions and post-challenge analyses of the ChaLearn AutoDL challenge 2019cited by 16
50 most cited of 254 All 254 (JSON)
- 2026The Gold in Bias: Maturing the AI Design Process through Verification24 Sep 2026
- 2026Emergent Models: Intelligence from Tiny Substrates14 Aug 2026
- 2026Distortion-Resilient Robotic Imitation Learning for Autonomous Cable Routing10 Jun 2026
- 2026FAME: Forecastability-Aware Mixture of Experts for Heterogeneous Time Series Forecasting8 Jun 2026
- 2026Synthics: Synthetic Physics-like Datasets for Machine Learning4 Jun 2026
- 2026Statistical Embeddings for Similarity, Retrieval, and Interpretable Alignment of Numeric Tabular Datasets28 May 2026
- 2026CLUBench: A Clustering Benchmark28 May 2026
- 2026Safe Bayesian Optimization for Uncertain Correlation Matrices in Linear Models of Co-Regionalization13 May 2026
- 2026Diffusion Sequence Models for Generative In-Context Meta-Learning of Robot Dynamics15 Apr 2026
- 2026Explaining AutoClustering: Uncovering Meta-Feature Contribution in AutoML for Clustering20 Feb 2026
- 2026MacrOData: New Benchmarks of Thousands of Datasets for Tabular Outlier Detection10 Feb 2026
- 2026A Meta-Knowledge-Augmented LLM Framework for Hyperparameter Optimization in Time-Series Forecasting1 Feb 2026
38 more
- 2025MetaRank: Task-Aware Metric Selection for Model Transferability Estimation26 Nov 2025
- 2025Structured Matrix Scaling for Multi-Class Calibration5 Nov 2025
- 2025Elements of Active Continuous Learning and Uncertainty Self-Awareness: a Narrow Implementation for Face and Facial Expression Recognition4 Nov 2025
- 2025A Survey of Inductive Reasoning for Large Language Models11 Oct 2025
- 2025Automated Machine Learning for Unsupervised Tabular Tasks8 Oct 2025
- 2025Opt-ICL at LeWiDi-2025: Maximizing In-Context Signal from Rater Examples via Meta-Learning8 Oct 2025
- 2025Pre-Hoc Predictions in AutoML: Leveraging LLMs to Enhance Model Selection and Benchmarking for Tabular datasets2 Oct 2025
- 2025Dynamic Meta-Learning for Adaptive XGBoost-Neural Ensembles30 Sep 2025
- 2025InfiAgent: Self-Evolving Pyramid Agent Framework for Infinite Scenarios26 Sep 2025
- 2025Is Meta-Learning Out? Rethinking Unsupervised Few-Shot Classification with Limited Entropy16 Sep 2025
- 2025MetaLLMix : An XAI Aided LLM-Meta-learning Based Approach for Hyper-parameters Optimization11 Sep 2025
- 2025Robust and Adaptive Spectral Method for Representation Multi-Task Learning with Contamination8 Sep 2025
- 2025M3OOD: Automatic Selection of Multimodal OOD Detectors16 Aug 2025
- 2025Exploring Strategies for Personalized Radiation Therapy: Part III Identifying genetic determinants for Radiation Response with Meta Learning11 Aug 2025
- 2025ICM-Fusion: In-Context Meta-Optimized LoRA Fusion for Multi-Task Adaptation6 Aug 2025
- 2025REASONING GYM: Reasoning Environments for Reinforcement Learning with Verifiable Rewards30 May 2025
- 2025Hyperparameter Optimization via Interacting with Probabilistic Circuits23 May 2025
- 2025PREMISE: Matching-based Prediction for Accurate Review Recommendation2 May 2025
- 2025An experimental survey and Perspective View on Meta-Learning for Automated Algorithms Selection and Parametrization8 Apr 2025
- 2025The AI Cosmologist I: An Agentic System for Automated Data Analysis4 Apr 2025
- 2025Efficient Model Selection for Time Series Forecasting via LLMs2 Apr 2025
- 2025Riemannian Geometric-based Meta Learning14 Mar 2025
- 2025Zero-shot Meta-learning for Tabular Prediction Tasks with Adversarially Pre-trained Transformer6 Feb 2025
- 2025Evolution and The Knightian Blindspot of Machine Learning22 Jan 2025
- 2024MetaRuleGPT: Recursive Numerical Reasoning of Language Models Trained with Simple Rules18 Dec 2024
- 2024Neuromodulated Meta-Learning11 Nov 2024
- 2024Beyond Model Adaptation at Test Time: A Survey6 Nov 2024
- 2024Meta-Learning from Learning Curves for Budget-Limited Algorithm Selection10 Oct 2024
- 2024MetaOOD: Automatic Selection of OOD Detection Models4 Oct 2024
- 2024Unsupervised Meta-Learning via Dynamic Head and Heterogeneous Task Construction for Few-Shot Classification3 Oct 2024
- 2024Few-Shot Image Quality Assessment via Adaptation of Vision-Language Models9 Sep 2024
- 2024On Supernet Transfer Learning for Effective Task Adaptation26 Jul 2024
- 2024CLAMS: A System for Zero-Shot Model Selection for Clustering15 Jul 2024
- 2024Meta-Learning and representation learner: A short theoretical note4 Jul 2024
- 2024Automated Privacy-Preserving Techniques via Meta-Learning24 Jun 2024
- 2024Exploring Cross-Domain Few-Shot Classification via Frequency-Aware Prompting24 Jun 2024
- 2024Meta-Learning Neural Procedural Biases12 Jun 2024
- 2024Quantum Architecture Search: A Survey10 Jun 2024
50 newest of 254 All 254 (JSON)
- 2020Provable Representation Learning for Imitation Learning via Bi-level Optimizationcited by 41
- 2019Federated Imitation Learning: A Novel Framework for Cloud Robotic Systems with Heterogeneous Sensor Datacited by 24
- 2021Zero-shot Task Adaptation using Natural Languagecited by 15
- 2026Distortion-Resilient Robotic Imitation Learning for Autonomous Cable Routingcited by 0
- 2026Distortion-Resilient Robotic Imitation Learning for Autonomous Cable Routing10 Jun 2026
- 2021Zero-shot Task Adaptation using Natural Language5 Jun 2021
- 2020Provable Representation Learning for Imitation Learning via Bi-level Optimization24 Feb 2020
- 2019Federated Imitation Learning: A Novel Framework for Cloud Robotic Systems with Heterogeneous Sensor Data24 Dec 2019
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2021A Survey on Deep Semi-supervised Learningcited by 250
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2022Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modelingcited by 126
- 2025REASONING GYM: Reasoning Environments for Reinforcement Learning with Verifiable Rewardscited by 121
- 2022Learning What Not to Segment: A New Perspective on Few-Shot Segmentationcited by 120
- 2021Machine Learning with a Reject Option: A surveycited by 107
- 2022Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Timecited by 85
- 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentationcited by 84
12 most cited of 240 All 240 (JSON)
- 2026The Gold in Bias: Maturing the AI Design Process through Verification24 Sep 2026
- 2026Emergent Models: Intelligence from Tiny Substrates14 Aug 2026
- 2026Synthics: Synthetic Physics-like Datasets for Machine Learning4 Jun 2026
- 2026Statistical Embeddings for Similarity, Retrieval, and Interpretable Alignment of Numeric Tabular Datasets28 May 2026
- 2026CLUBench: A Clustering Benchmark28 May 2026
- 2026Safe Bayesian Optimization for Uncertain Correlation Matrices in Linear Models of Co-Regionalization13 May 2026
- 2026Explaining AutoClustering: Uncovering Meta-Feature Contribution in AutoML for Clustering20 Feb 2026
- 2026MacrOData: New Benchmarks of Thousands of Datasets for Tabular Outlier Detection10 Feb 2026
- 2026A Meta-Knowledge-Augmented LLM Framework for Hyperparameter Optimization in Time-Series Forecasting1 Feb 2026
- 2025MetaRank: Task-Aware Metric Selection for Model Transferability Estimation26 Nov 2025
- 2025Structured Matrix Scaling for Multi-Class Calibration5 Nov 2025
- 2025Elements of Active Continuous Learning and Uncertainty Self-Awareness: a Narrow Implementation for Face and Facial Expression Recognition4 Nov 2025
12 newest of 240 All 240 (JSON)