Improved Few-Shot Visual Classification
Not on the map. Why?
Abstract (arXiv)
Few-shot learning is a fundamental task in computer vision that carries the promise of alleviating the need for exhaustively labeled data. Most few-shot learning approaches to date have focused on progressively more complex neural feature extractors and classifier adaptation strategies, as well as the refinement of the task definition itself. In this paper, we explore the hypothesis that a simple class-covariance-based distance metric, namely the Mahalanobis distance, adopted into a state of the art few-shot learning approach (CNAPS) can, in and of itself, lead to a significant performance improvement. We also discover that it is possible to learn adaptive feature extractors that allow useful estimation of the high dimensional feature covariances required by this metric from surprisingly few samples. The result of our work is a new "Simple CNAPS" architecture which has up to 9.2% fewer trainable parameters than CNAPS and performs up to 6.1% better than state of the art on the standard few-shot image classification benchmark dataset.
Key facts. Cited by 114 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 24; 2023: 28; 2024: 22; 2025: 13; 2026: 2.
114 papers.
Sort:
By area:
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 162
- 2023Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Modelscited by 91
- 2021Temporal-Relational CrossTransformers for Few-Shot Action Recognitioncited by 83
- 2021Cross-domain Few-shot Learning with Task-specific Adapterscited by 79
- 2021Learning a Universal Template for Few-shot Dataset Generalizationcited by 61
- 2021Universal Representation Learning from Multiple Domains for Few-shot Classificationcited by 56
- 2021Spatio-temporal Relation Modeling for Few-shot Action Recognitioncited by 52
- 2022Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Expertscited by 50
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
- 2023A Closer Look at Few-shot Classification Againcited by 46
- 2023First Session Adaptation: A Strong Replay-Free Baseline for Class-Incremental Learningcited by 46
38 more
- 2021Property-Aware Relation Networks for Few-Shot Molecular Property Predictioncited by 41
- 2023The Rise of AI Language Pathologists: Exploring Two-level Prompt Learning for Few-shot Weakly-supervised Whole Slide Image Classificationcited by 41
- 2023MetaGCD: Learning to Continually Learn in Generalized Category Discoverycited by 40
- 2022Adversarial Feature Augmentation for Cross-domain Few-shot Classificationcited by 36
- 2024Online Adaptation of Language Models with a Memory of Amortized Contextscited by 35
- 2023Test-Time Domain Adaptation by Learning Domain-Aware Batch Normalizationcited by 31
- 2022FiT: Parameter Efficient Few-shot Transfer Learning for Personalized and Federated Image Classificationcited by 26
- 2021Deep Metric Learning for Few-Shot Image Classification: A Review of Recent Developmentscited by 23
- 2022Universal Representations: A Unified Look at Multiple Task and Domain Learningcited by 23
- 2022Few-shot Learning with Noisy Labelscited by 23
- 2024AMU-Tuning: Effective Logit Bias for CLIP-based Few-shot Learningcited by 22
- 2023Bongard-OpenWorld: Few-Shot Reasoning for Free-form Visual Concepts in the Real Worldcited by 18
- 2023Exploring Efficient Few-shot Adaptation for Vision Transformerscited by 16
- 2025Reliable Few-shot Learning under Dual Noisescited by 16
- 2021A Closer Look at Prototype Classifier for Few-shot Image Classificationcited by 15
- 2022AirFi: Empowering WiFi-based Passive Human Gesture Recognition to Unseen Environment via Domain Generalizationcited by 15
- 2023Simple Semantic-Aided Few-Shot Learningcited by 15
- 2024Few-Shot Recognition via Stage-Wise Retrieval-Augmented Finetuningcited by 15
- 2025ProKeR: A Kernel Perspective on Few-Shot Adaptation of Large Vision-Language Modelscited by 15
- 2021Memory Efficient Meta-Learning with Large Imagescited by 14
- 2022Tree Structure-Aware Few-Shot Image Classification via Hierarchical Aggregationcited by 14
- 2023DETA: Denoised Task Adaptation for Few-Shot Learningcited by 13
- 2024Frozen Feature Augmentation for Few-Shot Image Classificationcited by 13
- 2023Cross-Modal Concept Learning and Inference for Vision-Language Modelscited by 12
- 2023Meta-Learning with a Geometry-Adaptive Preconditionercited by 11
- 2023Towards Task Sampler Learning for Meta-Learningcited by 11
- 2023Not Just Learning from Others but Relying on Yourself: A New Perspective on Few-Shot Segmentation in Remote Sensingcited by 11
- 2021What Can Knowledge Bring to Machine Learning? -- A Survey of Low-shot Learning for Structured Datacited by 10
- 2022Evidential Conditional Neural Processescited by 10
- 2022CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classificationcited by 9
- 2023Learning to Drive Anywherecited by 9
- 2021Object-aware Long-short-range Spatial Alignment for Few-Shot Fine-Grained Image Classificationcited by 8
- 2021Task Affinity with Maximum Bipartite Matching in Few-Shot Learningcited by 8
- 2024Task-Adapter: Task-specific Adaptation of Image Models for Few-shot Action Recognitioncited by 8
- 2021Prototype Completion for Few-Shot Learningcited by 7
- 2022Transductive Decoupled Variational Inference for Few-Shot Classificationcited by 7
- 2023MVP: Meta Visual Prompt Tuning for Few-Shot Remote Sensing Image Scene Classificationcited by 7
- 2023In-Context Learning for Few-Shot Molecular Property Predictioncited by 7
50 most cited of 114 All 114 (JSON)
- 2026Learning to Recover Task Experts from a Multi-Task Merged Model25 Jun 2026
- 2026Rethinking the Good Enough Embedding for Easy Few-Shot Learning13 May 2026
- 2025Task-Level Contrastiveness for Cross-Domain Few-Shot Learning3 Oct 2025
- 2025VT-FSL: Bridging Vision and Text with LLMs for Few-Shot Learning29 Sep 2025
- 2025Reliable Few-shot Learning under Dual Noises19 Jun 2025
- 2025Classification of Multi-Parametric Body MRI Series Using Deep Learning18 Jun 2025
- 2025Active Multimodal Distillation for Few-shot Action Recognition16 Jun 2025
- 2025AutoExpert: Automating 3D LiDAR Annotation from Expert-Crafted Guidelines3 Jun 2025
- 2025Optimization-Inspired Few-Shot Adaptation for Large Language Models25 May 2025
- 2025FAD: Frequency Adaptation and Diversion for Cross-domain Few-shot Learning13 May 2025
- 2025Task-Adapter++: Task-specific Adaptation with Order-aware Alignment for Few-shot Action Recognition9 May 2025
- 2025HyperFlow: Gradient-Free Emulation of Few-Shot Fine-Tuning21 Apr 2025
38 more
- 2025Transductive One-Shot Learning Meet Subspace Decomposition1 Apr 2025
- 2025Dual-level Mixup for Graph Few-shot Learning with Fewer Tasks19 Feb 2025
- 2025ProKeR: A Kernel Perspective on Few-Shot Adaptation of Large Vision-Language Models19 Jan 2025
- 2024Neuromodulated Meta-Learning11 Nov 2024
- 2024Enhancing Visual Classification using Comparative Descriptors8 Nov 2024
- 2024Mind the Gap Between Prototypes and Images in Cross-domain Finetuning16 Oct 2024
- 2024Learning to Learn with Contrastive Meta-Objective8 Oct 2024
- 2024Model X-Ray: Detection of Hidden Malware in AI Model Weights using Few Shot Learning28 Sep 2024
- 2024AgMTR: Agent Mining Transformer for Few-shot Segmentation in Remote Sensing26 Sep 2024
- 2024Towards Few-Shot Learning in the Open World: A Review and Beyond19 Aug 2024
- 2024Task-Adapter: Task-specific Adaptation of Image Models for Few-shot Action Recognition1 Aug 2024
- 2024Mining Open Semantics from CLIP: A Relation Transition Perspective for Few-Shot Learning17 Jun 2024
- 2024Few-Shot Recognition via Stage-Wise Retrieval-Augmented Finetuning17 Jun 2024
- 2024MOKD: Cross-domain Finetuning for Few-shot Classification via Maximizing Optimized Kernel Dependence29 May 2024
- 2024Chameleon: A Data-Efficient Generalist for Dense Visual Prediction in the Wild29 Apr 2024
- 2024AMU-Tuning: Effective Logit Bias for CLIP-based Few-shot Learning13 Apr 2024
- 2024PM2: A New Prompting Multi-modal Model Paradigm for Few-shot Medical Image Classification13 Apr 2024
- 2024Flatness Improves Backbone Generalisation in Few-shot Classification11 Apr 2024
- 2024Robust Few-Shot Ensemble Learning with Focal Diversity-Based Pruning5 Apr 2024
- 2024Frozen Feature Augmentation for Few-Shot Image Classification15 Mar 2024
- 2024Unleashing the Power of Meta-tuning for Few-shot Generalization Through Sparse Interpolated Experts13 Mar 2024
- 2024Online Adaptation of Language Models with a Memory of Amortized Contexts7 Mar 2024
- 2024BECLR: Batch Enhanced Contrastive Few-Shot Learning4 Feb 2024
- 2024Few and Fewer: Learning Better from Few Examples Using Fewer Base Classes29 Jan 2024
- 2024Dual-View Data Hallucination with Semantic Relation Guidance for Few-Shot Image Recognition13 Jan 2024
- 2023HyperMix: Out-of-Distribution Detection and Classification in Few-Shot Settings22 Dec 2023
- 2023Leveraging Normalization Layer in Adapters With Progressive Learning and Adaptive Distillation for Cross-Domain Few-Shot Learning18 Dec 2023
- 2023Test-Time Domain Adaptation by Learning Domain-Aware Batch Normalization15 Dec 2023
- 2023Simple Semantic-Aided Few-Shot Learning30 Nov 2023
- 2023Not Just Learning from Others but Relying on Yourself: A New Perspective on Few-Shot Segmentation in Remote Sensing19 Oct 2023
- 2023Bongard-OpenWorld: Few-Shot Reasoning for Free-form Visual Concepts in the Real World16 Oct 2023
- 2023Subspace Adaptation Prior for Few-Shot Learning13 Oct 2023
- 2023In-Context Learning for Few-Shot Molecular Property Prediction13 Oct 2023
- 2023PrototypeFormer: Learning to Explore Prototype Relationships for Few-shot Image Classification5 Oct 2023
- 2023Learning to Drive Anywhere21 Sep 2023
- 2023MVP: Meta Visual Prompt Tuning for Few-Shot Remote Sensing Image Scene Classification17 Sep 2023
- 2023MetaGCD: Learning to Continually Learn in Generalized Category Discovery21 Aug 2023
- 2023Cross-Modal Concept Learning and Inference for Vision-Language Models28 Jul 2023
50 newest of 114 All 114 (JSON)
- 2024AMU-Tuning: Effective Logit Bias for CLIP-based Few-shot Learningcited by 22
- 2025ProKeR: A Kernel Perspective on Few-Shot Adaptation of Large Vision-Language Modelscited by 15
- 2023Cross-Modal Concept Learning and Inference for Vision-Language Modelscited by 12
- 2024Enhancing Visual Classification using Comparative Descriptorscited by 2
- 2024Mining Open Semantics from CLIP: A Relation Transition Perspective for Few-Shot Learningcited by 0
- 2025ProKeR: A Kernel Perspective on Few-Shot Adaptation of Large Vision-Language Models19 Jan 2025
- 2024Enhancing Visual Classification using Comparative Descriptors8 Nov 2024
- 2024Mining Open Semantics from CLIP: A Relation Transition Perspective for Few-Shot Learning17 Jun 2024
- 2024AMU-Tuning: Effective Logit Bias for CLIP-based Few-shot Learning13 Apr 2024
- 2023Cross-Modal Concept Learning and Inference for Vision-Language Models28 Jul 2023
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 162
- 2023Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Modelscited by 91
- 2021Temporal-Relational CrossTransformers for Few-Shot Action Recognitioncited by 83
- 2021Cross-domain Few-shot Learning with Task-specific Adapterscited by 79
- 2021Learning a Universal Template for Few-shot Dataset Generalizationcited by 61
- 2021Universal Representation Learning from Multiple Domains for Few-shot Classificationcited by 56
- 2021Spatio-temporal Relation Modeling for Few-shot Action Recognitioncited by 52
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
- 2023A Closer Look at Few-shot Classification Againcited by 46
- 2023First Session Adaptation: A Strong Replay-Free Baseline for Class-Incremental Learningcited by 46
- 2021Property-Aware Relation Networks for Few-Shot Molecular Property Predictioncited by 41
12 most cited of 106 All 106 (JSON)
- 2026Learning to Recover Task Experts from a Multi-Task Merged Model25 Jun 2026
- 2026Rethinking the Good Enough Embedding for Easy Few-Shot Learning13 May 2026
- 2025Task-Level Contrastiveness for Cross-Domain Few-Shot Learning3 Oct 2025
- 2025VT-FSL: Bridging Vision and Text with LLMs for Few-Shot Learning29 Sep 2025
- 2025Reliable Few-shot Learning under Dual Noises19 Jun 2025
- 2025Classification of Multi-Parametric Body MRI Series Using Deep Learning18 Jun 2025
- 2025Active Multimodal Distillation for Few-shot Action Recognition16 Jun 2025
- 2025AutoExpert: Automating 3D LiDAR Annotation from Expert-Crafted Guidelines3 Jun 2025
- 2025Optimization-Inspired Few-Shot Adaptation for Large Language Models25 May 2025
- 2025FAD: Frequency Adaptation and Diversion for Cross-domain Few-shot Learning13 May 2025
- 2025Task-Adapter++: Task-specific Adaptation with Order-aware Alignment for Few-shot Action Recognition9 May 2025
- 2025HyperFlow: Gradient-Free Emulation of Few-Shot Fine-Tuning21 Apr 2025
12 newest of 106 All 106 (JSON)