A Theoretical Analysis of the Number of Shots in Few-Shot Learning
Not on the map. Why?
Abstract (arXiv)
Few-shot classification is the task of predicting the category of an example from a set of few labeled examples. The number of labeled examples per category is called the number of shots (or shot number). Recent works tackle this task through meta-learning, where a meta-learner extracts information from observed tasks during meta-training to quickly adapt to new tasks during meta-testing. In this formulation, the number of shots exploited during meta-training has an impact on the recognition performance at meta-test time. Generally, the shot number used in meta-training should match the one used in meta-testing to obtain the best performance. We introduce a theoretical analysis of the impact of the shot number on Prototypical Networks, a state-of-the-art few-shot classification method. From our analysis, we propose a simple method that is robust to the choice of shot number used during meta-training, which is a crucial hyperparameter. The performance of our model trained for an arbitrary meta-training shot number shows great performance for different values of meta-testing shot numbers. We experimentally demonstrate our approach on different few-shot classification benchmarks.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 13; 2023: 7; 2024: 7; 2025: 2.
39 papers.
Sort:
By area:
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2021FLEX: Unifying Evaluation for Few-Shot NLPcited by 67
- 2023Can Large Language Models be Good Path Planners? A Benchmark and Investigation on Spatial-temporal Reasoningcited by 49
- 2024LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planningcited by 44
- 2021Few-Shot Learning with Class Imbalancecited by 18
- 2023Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentationcited by 17
- 2021Few-Shot Learning with a Strong Teachercited by 16
- 2021A Closer Look at Prototype Classifier for Few-shot Image Classificationcited by 15
- 2023ProtoDiff: Learning to Learn Prototypical Networks by Task-Guided Diffusioncited by 15
- 2024How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responsescited by 12
- 2022Few-Shot Learning on Graphscited by 11
27 more
- 2022Adaptive Dimension Reduction and Variational Inference for Transductive Few-Shot Classificationcited by 10
- 2021Feature Generation for Long-tail Classificationcited by 9
- 2021Weak Adaptation Learning -- Addressing Cross-domain Data Insufficiency with Weak Annotatorcited by 8
- 2023Episodic Multi-Task Learning with Heterogeneous Neural Processescited by 8
- 2022Temporal Transductive Inference for Few-Shot Video Object Segmentationcited by 6
- 2022Robust Meta-learning with Sampling Noise and Label Noise via Eigen-Reptilecited by 6
- 2021MCML: A Novel Memory-based Contrastive Meta-Learning Method for Few Shot Slot Taggingcited by 4
- 2024Enhanced Multimodal Content Moderation of Children's Videos using Audiovisual Fusioncited by 4
- 2023Few Shot Semantic Segmentation: a review of methodologies, benchmarks, and open challengescited by 3
- 2023Learning Repeatable Speech Embeddings Using An Intra-class Correlation Regularizercited by 3
- 2021MetaKernel: Learning Variational Random Features with Limited Labelscited by 2
- 2022Long-Tailed Classification with Gradual Balanced Loss and Adaptive Feature Generationcited by 2
- 2022A Statistical Model for Predicting Generalization in Few-Shot Classificationcited by 2
- 2024Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Expertscited by 2
- 2021Mutual-Information Based Few-Shot Classificationcited by 1
- 2021Inconsistent Few-Shot Relation Classification via Cross-Attentional Prototype Networks with Contrastive Learningcited by 1
- 2022Increasing Model Generalizability for Unsupervised Domain Adaptationcited by 1
- 2022Rethinking the Number of Shots in Robust Model-Agnostic Meta-Learningcited by 1
- 2023P3DC-Shot: Prior-Driven Discrete Data Calibration for Nearest-Neighbor Few-Shot Classificationcited by 1
- 2024Task Attribute Distance for Few-Shot Learning: Theoretical Analysis and Applicationscited by 1
- 2025Efficient Detection of Intermittent Job Failures Using Few-Shot Learningcited by 1
- 2025CCoMAML: Efficient Cattle Identification Using Cooperative Model-Agnostic Meta-Learningcited by 1
- 2022Diagnosing and Remedying Shot Sensitivity with Cosine Few-Shot Learnerscited by 0
- 2022Constrained Few-Shot Learning: Human-Like Low Sample Complexity Learning and Non-Episodic Text Classificationcited by 0
- 2022A Study on Representation Transfer for Few-Shot Learningcited by 0
- 2024Unsupervised Domain Adaptation Using Compact Internal Representationscited by 0
- 2024EnvId: A Metric Learning Approach for Forensic Few-Shot Identification of Unseen Environmentscited by 0
- 2025CCoMAML: Efficient Cattle Identification Using Cooperative Model-Agnostic Meta-Learning14 Sep 2025
- 2025Efficient Detection of Intermittent Job Failures Using Few-Shot Learning5 Jul 2025
- 2024LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planning20 Jun 2024
- 2024Enhanced Multimodal Content Moderation of Children's Videos using Audiovisual Fusion9 May 2024
- 2024EnvId: A Metric Learning Approach for Forensic Few-Shot Identification of Unseen Environments3 May 2024
- 2024How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses2 May 2024
- 2024Task Attribute Distance for Few-Shot Learning: Theoretical Analysis and Applications6 Mar 2024
- 2024Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts5 Feb 2024
- 2024Unsupervised Domain Adaptation Using Compact Internal Representations14 Jan 2024
- 2023Episodic Multi-Task Learning with Heterogeneous Neural Processes28 Oct 2023
- 2023Learning Repeatable Speech Embeddings Using An Intra-class Correlation Regularizer25 Oct 2023
- 2023Can Large Language Models be Good Path Planners? A Benchmark and Investigation on Spatial-temporal Reasoning5 Oct 2023
27 more
- 2023ProtoDiff: Learning to Learn Prototypical Networks by Task-Guided Diffusion26 Jun 2023
- 2023Few Shot Semantic Segmentation: a review of methodologies, benchmarks, and open challenges12 Apr 2023
- 2023Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentation29 Mar 2023
- 2023P3DC-Shot: Prior-Driven Discrete Data Calibration for Nearest-Neighbor Few-Shot Classification2 Jan 2023
- 2022A Statistical Model for Predicting Generalization in Few-Shot Classification13 Dec 2022
- 2022Rethinking the Number of Shots in Robust Model-Agnostic Meta-Learning28 Nov 2022
- 2022Increasing Model Generalizability for Unsupervised Domain Adaptation29 Sep 2022
- 2022Adaptive Dimension Reduction and Variational Inference for Transductive Few-Shot Classification18 Sep 2022
- 2022A Study on Representation Transfer for Few-Shot Learning5 Sep 2022
- 2022Constrained Few-Shot Learning: Human-Like Low Sample Complexity Learning and Non-Episodic Text Classification17 Aug 2022
- 2022Diagnosing and Remedying Shot Sensitivity with Cosine Few-Shot Learners7 Jul 2022
- 2022Robust Meta-learning with Sampling Noise and Label Noise via Eigen-Reptile4 Jun 2022
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities13 May 2022
- 2022Temporal Transductive Inference for Few-Shot Video Object Segmentation27 Mar 2022
- 2022Few-Shot Learning on Graphs17 Mar 2022
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learning7 Mar 2022
- 2022Long-Tailed Classification with Gradual Balanced Loss and Adaptive Feature Generation28 Feb 2022
- 2021Feature Generation for Long-tail Classification10 Nov 2021
- 2021Inconsistent Few-Shot Relation Classification via Cross-Attentional Prototype Networks with Contrastive Learning13 Oct 2021
- 2021A Closer Look at Prototype Classifier for Few-shot Image Classification11 Oct 2021
- 2021MCML: A Novel Memory-based Contrastive Meta-Learning Method for Few Shot Slot Tagging26 Aug 2021
- 2021FLEX: Unifying Evaluation for Few-Shot NLP15 Jul 2021
- 2021Few-Shot Learning with a Strong Teacher1 Jul 2021
- 2021Mutual-Information Based Few-Shot Classification23 Jun 2021
- 2021MetaKernel: Learning Variational Random Features with Limited Labels8 May 2021
- 2021Weak Adaptation Learning -- Addressing Cross-domain Data Insufficiency with Weak Annotator15 Feb 2021
- 2021Few-Shot Learning with Class Imbalance7 Jan 2021
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2021FLEX: Unifying Evaluation for Few-Shot NLPcited by 67
- 2024LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planningcited by 44
- 2021Few-Shot Learning with Class Imbalancecited by 18
- 2023Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentationcited by 17
- 2021Few-Shot Learning with a Strong Teachercited by 16
- 2021A Closer Look at Prototype Classifier for Few-shot Image Classificationcited by 15
- 2024How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responsescited by 12
- 2022Few-Shot Learning on Graphscited by 11
- 2022Adaptive Dimension Reduction and Variational Inference for Transductive Few-Shot Classificationcited by 10
- 2021Feature Generation for Long-tail Classificationcited by 9
12 most cited of 36 All 36 (JSON)
- 2025CCoMAML: Efficient Cattle Identification Using Cooperative Model-Agnostic Meta-Learning14 Sep 2025
- 2025Efficient Detection of Intermittent Job Failures Using Few-Shot Learning5 Jul 2025
- 2024LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planning20 Jun 2024
- 2024Enhanced Multimodal Content Moderation of Children's Videos using Audiovisual Fusion9 May 2024
- 2024EnvId: A Metric Learning Approach for Forensic Few-Shot Identification of Unseen Environments3 May 2024
- 2024How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses2 May 2024
- 2024Task Attribute Distance for Few-Shot Learning: Theoretical Analysis and Applications6 Mar 2024
- 2024Unsupervised Domain Adaptation Using Compact Internal Representations14 Jan 2024
- 2023Episodic Multi-Task Learning with Heterogeneous Neural Processes28 Oct 2023
- 2023Learning Repeatable Speech Embeddings Using An Intra-class Correlation Regularizer25 Oct 2023
- 2023Few Shot Semantic Segmentation: a review of methodologies, benchmarks, and open challenges12 Apr 2023
- 2023Towards Foundation Models and Few-Shot Parameter-Efficient Fine-Tuning for Volumetric Organ Segmentation29 Mar 2023
12 newest of 36 All 36 (JSON)