Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examples
Not on the map. Why?
Abstract (arXiv)
Few-shot classification refers to learning a classifier for new classes given only a few examples. While a plethora of models have emerged to tackle it, we find the procedure and datasets that are used to assess their progress lacking. To address this limitation, we propose Meta-Dataset: a new benchmark for training and evaluating models that is large-scale, consists of diverse datasets, and presents more realistic tasks. We experiment with popular baselines and meta-learners on Meta-Dataset, along with a competitive method that we propose. We analyze performance as a function of various characteristics of test tasks and examine the models' ability to leverage diverse training sources for improving their generalization. We also propose a new set of baselines for quantifying the benefit of meta-learning in Meta-Dataset. Our extensive experimentation has uncovered important research challenges and we hope to inspire work in these directions.
Key facts. Cited by 312 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 86; 2022: 75; 2023: 62; 2024: 50; 2025: 28; 2026: 11.
312 papers.
Sort:
By area:
- 2021Transformers in Vision: A Surveycited by 1,009
- 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
- 2021Intriguing Properties of Vision Transformerscited by 446
- 2021True Few-Shot Learning with Language Modelscited by 343
- 2021Few-shot Learning with Multilingual Language Modelscited by 278
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
- 2022Federated Learning from Pre-Trained Models: A Contrastive Learning Approachcited by 141
- 2022Pushing the Limits of Simple Pipelines for Few-Shot Learning: External Data and Fine-Tuning Make a Differencecited by 123
- 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
- 2021Exploring the Limits of Large Scale Pre-trainingcited by 104
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
38 more
- 2023FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learningcited by 86
- 2021Temporal-Relational CrossTransformers for Few-Shot Action Recognitioncited by 83
- 2022MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflictscited by 81
- 2021Cross-domain Few-shot Learning with Task-specific Adapterscited by 79
- 2021FLEX: Unifying Evaluation for Few-Shot NLPcited by 67
- 2023Advances and Challenges in Meta-Learning: A Technical Reviewcited by 65
- 2021Learning a Universal Template for Few-shot Dataset Generalizationcited by 61
- 2021Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot Learningcited by 56
- 2021Universal Representation Learning from Multiple Domains for Few-shot Classificationcited by 56
- 2021Dynamic Distillation Network for Cross-Domain Few-Shot Recognition with Unlabeled Datacited by 49
- 2021Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learningcited by 49
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
- 2023A Closer Look at Few-shot Classification Againcited by 46
- 2021Bootstrapped Meta-Learningcited by 45
- 2021Orthogonal Projection Losscited by 44
- 2021A linearized framework and a new benchmark for model selection for fine-tuningcited by 41
- 2021Partner-Assisted Learning for Few-Shot Image Classificationcited by 36
- 2022Skill-based Meta-Reinforcement Learningcited by 36
- 2023Strong Baselines for Parameter Efficient Few-Shot Fine-tuningcited by 36
- 2021Few-shot Intent Classification and Slot Filling with Retrieved Examplescited by 35
- 2022Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactionscited by 34
- 2021Few-shot Image Classification: Just Use a Library of Pre-trained Feature Extractors and a Simple Classifiercited by 32
- 2021NAS-Bench-360: Benchmarking Neural Architecture Search on Diverse Taskscited by 32
- 2021A Metalearning Approach for Physics-Informed Neural Networks (PINNs): Application to Parameterized PDEscited by 31
- 2024Towards Few-Shot Adaptation of Foundation Models via Multitask Finetuningcited by 31
- 2021ORBIT: A Real-World Few-Shot Dataset for Teachable Object Recognitioncited by 29
- 2021Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalizationcited by 29
- 2023Meta-Album: Multi-domain Meta-Dataset for Few-Shot Image Classificationcited by 29
- 2021MetaHTR: Towards Writer-Adaptive Handwritten Text Recognitioncited by 27
- 2021Learngene: From Open-World to Your Learning Taskcited by 27
- 2022Realistic Evaluation of Transductive Few-Shot Learningcited by 26
- 2022Meta Learning for Natural Language Processing: A Surveycited by 26
- 2021Impact of Aliasing on Generalization in Deep Convolutional Networkscited by 25
- 2022Practical Conditional Neural Processes Via Tractable Dependent Predictionscited by 25
- 2022Integrative Few-Shot Learning for Classification and Segmentationcited by 25
- 2023Meta-learning approaches for few-shot learning: A survey of recent advancescited by 25
- 2022MetaAudio: A Few-Shot Audio Classification Benchmarkcited by 24
- 2023Learngene: Inheriting Condensed Knowledge from the Ancestry Model to Descendant Modelscited by 24
50 most cited of 312 All 312 (JSON)
- 2026When Semantics Saturate or Emerge: Adaptation-Conditional Semantic Utility in Source-Free Cross-Domain Few-Shot Learning7 Aug 2026
- 2026Federated Martingale Posterior Samping18 May 2026
- 2026VDLF-Net: Variational Feature Fusion for Adaptive and Few-Shot Visual Learning26 Apr 2026
- 2026MAPLE: A Meta-learning Framework for Cross-Prompt Essay Scoring19 Apr 2026
- 2026Reclaiming Lost Text Layers for Source-Free Cross-Domain Few-Shot Learning5 Mar 2026
- 2026SRasP: Self-Reorientation Adversarial Style Perturbation for Cross-Domain Few-Shot Learning5 Mar 2026
- 2026Benchmarking Few-shot Transferability of Pre-trained Models with Improved Evaluation Protocols28 Feb 2026
- 2026Hierarchic-EEG2Text: Assessing EEG-To-Text Decoding across Hierarchical Abstraction Levels24 Feb 2026
- 2026Meta-Learning and Meta-Reinforcement Learning -- Tracing the Path towards DeepMind's Adaptive Agent23 Feb 2026
- 2026Unified Optimization of Source Weights and Transfer Quantities in Multi-Source Transfer Learning: An Asymptotic Framework15 Jan 2026
- 2026Meta-learning to Address Data Shift in Time Series Classification13 Jan 2026
- 2025Neural Coherence : Find higher performance to out-of-distribution tasks from few samples5 Dec 2025
38 more
- 2025Free Lunch to Meet the Gap: Intermediate Domain Reconstruction for Cross-Domain Few-Shot Learning18 Nov 2025
- 2025FreqGRL: Suppressing Low-Frequency Bias and Mining High-Frequency Knowledge for Cross-Domain Few-Shot Learning10 Nov 2025
- 2025Toward Better Generalization in Few-Shot Learning through the Meta-Component Combination7 Nov 2025
- 2025Provably Robust Adaptation for Language-Empowered Foundation Models9 Oct 2025
- 2025Task-Level Contrastiveness for Cross-Domain Few-Shot Learning3 Oct 2025
- 2025Embodied Intelligence in Disassembly: Multimodal Perception Cross-validation and Continual Learning in Neuro-Symbolic TAMP14 Sep 2025
- 2025CCoMAML: Efficient Cattle Identification Using Cooperative Model-Agnostic Meta-Learning14 Sep 2025
- 2025Learning to Imitate with Less: Efficient Individual Behavior Modeling in Chess29 Jul 2025
- 2025Meta-Learning Transformers to Improve In-Context Generalization7 Jul 2025
- 2025Automated Grading of Students' Handwritten Graphs: A Comparison of Meta-Learning and Vision-Large Language Models3 Jul 2025
- 2025Few-shot Classification as Multi-instance Verification: Effective Backbone-agnostic Transfer across Domains1 Jul 2025
- 2025XTransfer: Modality-Agnostic Few-Shot Model Transfer for Human Sensing at the Edge28 Jun 2025
- 2025Episode-specific Fine-tuning for Metric-based Few-shot Learners with Optimization-based Training20 Jun 2025
- 2025Reliable Few-shot Learning under Dual Noises19 Jun 2025
- 2025Few-Shot Learning for Industrial Time Series: A Comparative Analysis Using the Example of Screw-Fastening Process Monitoring16 Jun 2025
- 2025Detecting Sockpuppetry on Wikipedia Using Meta-Learning12 Jun 2025
- 2025Deciphering Trajectory-Aided LLM Reasoning: An Optimization Perspective26 May 2025
- 2025Prompt Tuning Vision Language Models with Margin Regularizer for Few-Shot Learning under Distribution Shifts21 May 2025
- 2025Your Offline Policy is Not Trustworthy: Bilevel Reinforcement Learning for Sequential Portfolio Optimization19 May 2025
- 2025FAD: Frequency Adaptation and Diversion for Cross-domain Few-shot Learning13 May 2025
- 2025HyperFlow: Gradient-Free Emulation of Few-Shot Fine-Tuning21 Apr 2025
- 2025Benchmarking for Practice: Few-Shot Time-Series Crop-Type Classification on the EuroCropsML Dataset15 Apr 2025
- 2025Memory-Modular Classification: Learning to Generalize with Memory Replacement8 Apr 2025
- 2025OpenEarthSensing: Large-Scale Fine-Grained Benchmark for Open-World Remote Sensing28 Feb 2025
- 2025Model Diffusion for Certifiable Few-shot Transfer Learning10 Feb 2025
- 2025Learning to Learn Weight Generation via Local Consistency Diffusion3 Feb 2025
- 2025Enhancing Unsupervised Graph Few-shot Learning via Set Functions and Optimal Transport10 Jan 2025
- 2024LEARN: A Unified Framework for Multi-Task Domain Adapt Few-Shot Learning20 Dec 2024
- 2024Task-Specific Preconditioner for Cross-Domain Few-Shot Learning20 Dec 2024
- 2024Towards Cross-Lingual Audio Abuse Detection in Low-Resource Settings with Few-Shot Learning2 Dec 2024
- 2024Neuromodulated Meta-Learning11 Nov 2024
- 2024Meta-Learning Approaches for Improving Detection of Unseen Speech Deepfakes27 Oct 2024
- 2024Electrocardiogram-Language Model for Few-Shot Question Answering with Meta Learning18 Oct 2024
- 2024Mind the Gap Between Prototypes and Images in Cross-domain Finetuning16 Oct 2024
- 2024Metalic: Meta-Learning In-Context with Protein Language Models10 Oct 2024
- 2024Learning to Learn with Contrastive Meta-Objective8 Oct 2024
- 2024Episodic fine-tuning prototypical networks for optimization-based few-shot learning: Application to audio classification4 Oct 2024
- 2024Identifiable Shared Component Analysis of Unpaired Multimodal Mixtures28 Sep 2024
50 newest of 312 All 312 (JSON)
- 2024SQ-LLaVA: Self-Questioning for Large Vision-Language Assistantcited by 18
- 2023SATIN: A Multi-Task Metadataset for Classifying Satellite Imagery using Vision-Language Modelscited by 15
- 2023Proto-CLIP: Vision-Language Prototypical Network for Few-Shot Learningcited by 12
- 2025Prompt Tuning Vision Language Models with Margin Regularizer for Few-Shot Learning under Distribution Shiftscited by 2
- 2025Prompt Tuning Vision Language Models with Margin Regularizer for Few-Shot Learning under Distribution Shifts21 May 2025
- 2024SQ-LLaVA: Self-Questioning for Large Vision-Language Assistant17 Mar 2024
- 2023Proto-CLIP: Vision-Language Prototypical Network for Few-Shot Learning6 Jul 2023
- 2023SATIN: A Multi-Task Metadataset for Classifying Satellite Imagery using Vision-Language Models23 Apr 2023
- 2021Transformers in Vision: A Surveycited by 1,009
- 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 858
- 2021Intriguing Properties of Vision Transformerscited by 446
- 2021True Few-Shot Learning with Language Modelscited by 343
- 2021Few-shot Learning with Multilingual Language Modelscited by 278
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2021CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLPcited by 142
- 2022Federated Learning from Pre-Trained Models: A Contrastive Learning Approachcited by 141
- 2022Pushing the Limits of Simple Pipelines for Few-Shot Learning: External Data and Fine-Tuning Make a Differencecited by 123
- 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
- 2021Exploring the Limits of Large Scale Pre-trainingcited by 104
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
12 most cited of 301 All 301 (JSON)
- 2026When Semantics Saturate or Emerge: Adaptation-Conditional Semantic Utility in Source-Free Cross-Domain Few-Shot Learning7 Aug 2026
- 2026Federated Martingale Posterior Samping18 May 2026
- 2026VDLF-Net: Variational Feature Fusion for Adaptive and Few-Shot Visual Learning26 Apr 2026
- 2026MAPLE: A Meta-learning Framework for Cross-Prompt Essay Scoring19 Apr 2026
- 2026Reclaiming Lost Text Layers for Source-Free Cross-Domain Few-Shot Learning5 Mar 2026
- 2026SRasP: Self-Reorientation Adversarial Style Perturbation for Cross-Domain Few-Shot Learning5 Mar 2026
- 2026Benchmarking Few-shot Transferability of Pre-trained Models with Improved Evaluation Protocols28 Feb 2026
- 2026Hierarchic-EEG2Text: Assessing EEG-To-Text Decoding across Hierarchical Abstraction Levels24 Feb 2026
- 2026Meta-Learning and Meta-Reinforcement Learning -- Tracing the Path towards DeepMind's Adaptive Agent23 Feb 2026
- 2026Unified Optimization of Source Weights and Transfer Quantities in Multi-Source Transfer Learning: An Asymptotic Framework15 Jan 2026
- 2026Meta-learning to Address Data Shift in Time Series Classification13 Jan 2026
- 2025Neural Coherence : Find higher performance to out-of-distribution tasks from few samples5 Dec 2025
12 newest of 301 All 301 (JSON)