SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learning
Not on the map. Why?
Abstract (arXiv)
Few-shot learners aim to recognize new object classes based on a small number of labeled training examples. To prevent overfitting, state-of-the-art few-shot learners use meta-learning on convolutional-network features and perform classification using a nearest-neighbor classifier. This paper studies the accuracy of nearest-neighbor baselines without meta-learning. Surprisingly, we find simple feature transformations suffice to obtain competitive few-shot learning accuracies. For example, we find that a nearest-neighbor classifier used in combination with mean-subtraction and L2-normalization outperforms prior results in three out of five settings on the miniImageNet dataset.
Key facts. Cited by 195 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 44; 2022: 49; 2023: 45; 2024: 25; 2025: 18; 2026: 14.
195 papers.
Sort:
By area:
- 2023StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learnerscited by 177
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 162
- 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 161
- 2021The Surprising Effectiveness of Representation Learning for Visual Imitationcited by 154
- 2022Pushing the Limits of Simple Pipelines for Few-Shot Learning: External Data and Fine-Tuning Make a Differencecited by 126
- 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 118
- 2021Generalized Few-Shot Object Detection without Forgettingcited by 88
- 2022Few-Shot Class-Incremental Learning by Sampling Multi-Phase Taskscited by 88
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2021CONTaiNER: Few-Shot Named Entity Recognition via Contrastive Learningcited by 64
- 2022Test-Time Adaptation via Self-Training with Nearest Neighbor Informationcited by 64
38 more
- 2021Personalized Federated Learning through Local Memorizationcited by 57
- 2025BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learningcited by 50
- 2021Shallow Bayesian Meta Learning for Real-World Few-Shot Recognitioncited by 48
- 2023A General-Purpose Self-Supervised Model for Computational Pathologycited by 42
- 2024RudolfV: A Foundation Model by Pathologists for Pathologistscited by 41
- 2022Generating Representative Samples for Few-Shot Classificationcited by 39
- 2023MoLo: Motion-augmented Long-short Contrastive Learning for Few-shot Action Recognitioncited by 37
- 2021Few-shot Intent Classification and Slot Filling with Retrieved Examplescited by 35
- 2022Handcrafted Histological Transformer (H2T): Unsupervised Representation of Whole Slide Imagescited by 32
- 2023Learning Visual Representations via Language-Guided Samplingcited by 32
- 2024Transductive Zero-Shot and Few-Shot CLIPcited by 32
- 2022Few-Shot Classification with Contrastive Learningcited by 31
- 2023Transductive Few-shot Learning with Prototype-based Label Propagation by Iterative Graph Refinementcited by 30
- 2022Realistic Evaluation of Transductive Few-Shot Learningcited by 27
- 2024MVP-Shot: Multi-Velocity Progressive-Alignment Framework for Few-Shot Action Recognitioncited by 25
- 2021Procrustean Training for Imbalanced Deep Learningcited by 24
- 2022HyperShot: Few-Shot Learning by Kernel HyperNetworkscited by 24
- 2022MetaAudio: A Few-Shot Audio Classification Benchmarkcited by 24
- 2024Fine-Tuning is Fine, if Calibratedcited by 24
- 2021Transductive Few-Shot Classification on the Oblique Manifoldcited by 23
- 2021How to Train Your MAML to Excel in Few-Shot Classificationcited by 22
- 2022Task Discrepancy Maximization for Fine-grained Few-Shot Classificationcited by 21
- 2022FHIST: A Benchmark for Few-shot Classification of Histological Imagescited by 20
- 2022Alleviating the Sample Selection Bias in Few-shot Learning by Removing Projection to the Centroidcited by 20
- 2021Few-Shot Learning with Class Imbalancecited by 18
- 2021Reinforced Attention for Few-Shot Learning and Beyondcited by 18
- 2023Learning to Learn from APIs: Black-Box Data-Free Meta-Learningcited by 18
- 2022HyperMAML: Few-Shot Adaptation of Deep Models with Hypernetworkscited by 17
- 2021Few-Shot Learning with a Strong Teachercited by 16
- 2022EASY: Ensemble Augmented-Shot Y-shaped Learning: State-Of-The-Art Few-Shot Classification with Simple Ingredientscited by 16
- 2022Towards better understanding and better generalization of few-shot classification in histology images with contrastive learningcited by 16
- 2021Rich Semantics Improve Few-shot Learningcited by 15
- 2021A Closer Look at Prototype Classifier for Few-shot Image Classificationcited by 15
- 2021Adaptive Poincar'e Point to Set Distance for Few-Shot Classificationcited by 15
- 2022POODLE: Improving Few-shot Learning via Penalizing Out-of-Distribution Samplescited by 15
- 2021Multilingual and cross-lingual document classification: A meta-learning approachcited by 14
- 2021Squeezing Backbone Feature Distributions to the Max for Efficient Few-Shot Learningcited by 14
- 2023CDFSL-V: Cross-Domain Few-Shot Learning for Videoscited by 13
50 most cited of 195 All 195 (JSON)
- 2026Detecting Nighttime Anomalies from NASA Black Marble Using a Generalized Spatio-Temporally Robust Framework of Machine Leaning Ensembles5 Oct 2026
- 2026Scaling Full Conformal Image Classifiers29 Sep 2026
- 2026Are We Really Doing Few-Shot Learning? A Critical Examination of Pre-Training Assumptions9 Sep 2026
- 2026BIDETA: Brain-Inspired Data-Efficient Tactile Adaptation for Unseen Sensors8 Sep 2026
- 2026The Blending Ratio Is Not Where the Performance Is: Diagnosing Prototype Blending for Few-Shot Adaptation of Vision-Language Models23 Aug 2026
- 2026From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology4 Aug 2026
- 2026PhenoStitch: Training-Free Panoptic Crop Mapping from Satellite Image Time Series1 Aug 2026
- 2026Planktonzilla: Multimodal dataset and models for understanding plankton ecosystems22 May 2026
- 2026Unlocking Compositional Generalization in Continual Few-Shot Learning12 May 2026
- 2026Few-Shot Learning Pipeline for Monkeypox Skin Disease Classification Using CNN Feature Extractors6 May 2026
- 2026Mochi: Aligning Pre-training and Inference for Efficient Graph Foundation Models via Meta-Learning23 Apr 2026
- 2026Semi-Supervised Few-Shot Adaptation of Vision-Language Models3 Mar 2026
38 more
- 2026Unifying Contrastive and Generative Objectives for Visual Understanding and Text-to-Image Generation3 Mar 2026
- 2026Feature-Space Generative Models for One-Shot Class-Incremental Learning25 Jan 2026
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosis29 Dec 2025
- 2025Visual Species Recognition with Large Multimodal Models as Post-Hoc Correctors10 Dec 2025
- 2025Decoupling Template Bias in CLIP: Harnessing Empty Prompts for Enhanced Few-Shot Learning9 Dec 2025
- 2025MOCHA: Multi-modal Objects-aware Cross-arcHitecture Alignment17 Sep 2025
- 2025Is Meta-Learning Out? Rethinking Unsupervised Few-Shot Classification with Limited Entropy16 Sep 2025
- 2025Data-Efficient Point Cloud Semantic Segmentation Pipeline for Unimproved Roads26 Aug 2025
- 2025Separating Knowledge and Perception with Procedural Data12 Aug 2025
- 2025Foundation Models for Bioacoustics -- a Comparative Review2 Aug 2025
- 2025PictSure: Pretraining Embeddings Matters for In-Context Learning Image Classifiers16 Jun 2025
- 2025Overcoming Labelled Data Scarcity for Defect Classification in Scanning Tunneling Microscopy2 Jun 2025
- 2025BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learning29 May 2025
- 2025ProMi: An Efficient Prototype-Mixture Baseline for Few-Shot Segmentation with Bounding-Box Annotations18 May 2025
- 2025Impact of Language Guidance: A Reproducibility Study10 Apr 2025
- 2025Transductive One-Shot Learning Meet Subspace Decomposition1 Apr 2025
- 2025Unbiased Max-Min Embedding Classification for Transductive Few-Shot Learning: Clustering and Classification Are All You Need28 Mar 2025
- 2025Membership Inference Attacks fueled by Few-Short Learning to detect privacy leakage tackling data integrity12 Mar 2025
- 20253D Foundation Model for Generalizable Disease Detection in Head Computed Tomography4 Feb 2025
- 2025Geometric Mean Improves Loss For Few-Shot Learning24 Jan 2025
- 2024Multimodal Whole Slide Foundation Model for Pathology29 Nov 2024
- 2024Context-Aware Multimodal Pretraining22 Nov 2024
- 2024Layer-Wise Feature Metric of Semantic-Pixel Matching for Few-Shot Learning10 Nov 2024
- 2024Stepping Forward on the Last Mile6 Nov 2024
- 2024Contextual Representation Anchor Network to Alleviate Selection Bias in Few-Shot Drug Discovery28 Oct 2024
- 2024Cross-Domain Evaluation of Few-Shot Classification Models: Natural Images vs. Histopathological Images11 Oct 2024
- 2024Model X-Ray: Detection of Hidden Malware in AI Model Weights using Few Shot Learning28 Sep 2024
- 2024Fine-Tuning is Fine, if Calibrated24 Sep 2024
- 2024Enhancing Few-Shot Image Classification through Learnable Multi-Scale Embedding and Attention Mechanisms12 Sep 2024
- 2024Oops, I Sampled it Again: Reinterpreting Confidence Intervals in Few-Shot Learning4 Sep 2024
- 2024Few-Shot Histopathology Image Classification: Evaluating State-of-the-Art Methods and Unveiling Performance Insights25 Aug 2024
- 2024A New Era in Computational Pathology: A Survey on Foundation and Vision-Language Models23 Aug 2024
- 2024Towards flexible perception with visual memory15 Aug 2024
- 2024Cross-Architecture Auxiliary Feature Space Translation for Efficient Few-Shot Personalized Object Detection1 Jul 2024
- 2024MVP-Shot: Multi-Velocity Progressive-Alignment Framework for Few-Shot Action Recognition3 May 2024
- 2024A Unified Label-Aware Contrastive Learning Framework for Few-Shot Named Entity Recognition26 Apr 2024
- 2024Transductive Zero-Shot and Few-Shot CLIP8 Apr 2024
- 2024Object-conditioned Bag of Instances for Few-Shot Personalized Instance Recognition1 Apr 2024
50 newest of 195 All 195 (JSON)
- 2024A New Era in Computational Pathology: A Survey on Foundation and Vision-Language Modelscited by 9
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosiscited by 3
- 2025Visual Species Recognition with Large Multimodal Models as Post-Hoc Correctorscited by 0
- 2026Semi-Supervised Few-Shot Adaptation of Vision-Language Modelscited by 0
- 2026The Blending Ratio Is Not Where the Performance Is: Diagnosing Prototype Blending for Few-Shot Adaptation of Vision-Language Modelscited by 0
- 2026The Blending Ratio Is Not Where the Performance Is: Diagnosing Prototype Blending for Few-Shot Adaptation of Vision-Language Models23 Aug 2026
- 2026Semi-Supervised Few-Shot Adaptation of Vision-Language Models3 Mar 2026
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosis29 Dec 2025
- 2025Visual Species Recognition with Large Multimodal Models as Post-Hoc Correctors10 Dec 2025
- 2024A New Era in Computational Pathology: A Survey on Foundation and Vision-Language Models23 Aug 2024
- 2023StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learnerscited by 177
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 162
- 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 161
- 2022Pushing the Limits of Simple Pipelines for Few-Shot Learning: External Data and Fine-Tuning Make a Differencecited by 126
- 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 118
- 2021Generalized Few-Shot Object Detection without Forgettingcited by 88
- 2022Few-Shot Class-Incremental Learning by Sampling Multi-Phase Taskscited by 88
- 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2021CONTaiNER: Few-Shot Named Entity Recognition via Contrastive Learningcited by 64
- 2022Test-Time Adaptation via Self-Training with Nearest Neighbor Informationcited by 64
- 2021Personalized Federated Learning through Local Memorizationcited by 57
12 most cited of 186 All 186 (JSON)
- 2026Detecting Nighttime Anomalies from NASA Black Marble Using a Generalized Spatio-Temporally Robust Framework of Machine Leaning Ensembles5 Oct 2026
- 2026Scaling Full Conformal Image Classifiers29 Sep 2026
- 2026Are We Really Doing Few-Shot Learning? A Critical Examination of Pre-Training Assumptions9 Sep 2026
- 2026BIDETA: Brain-Inspired Data-Efficient Tactile Adaptation for Unseen Sensors8 Sep 2026
- 2026From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology4 Aug 2026
- 2026PhenoStitch: Training-Free Panoptic Crop Mapping from Satellite Image Time Series1 Aug 2026
- 2026Planktonzilla: Multimodal dataset and models for understanding plankton ecosystems22 May 2026
- 2026Unlocking Compositional Generalization in Continual Few-Shot Learning12 May 2026
- 2026Few-Shot Learning Pipeline for Monkeypox Skin Disease Classification Using CNN Feature Extractors6 May 2026
- 2026Mochi: Aligning Pre-training and Inference for Efficient Graph Foundation Models via Meta-Learning23 Apr 2026
- 2026Unifying Contrastive and Generative Objectives for Visual Understanding and Text-to-Image Generation3 Mar 2026
- 2026Feature-Space Generative Models for One-Shot Class-Incremental Learning25 Jan 2026
12 newest of 186 All 186 (JSON)