Few-Shot Learning Through an Information Retrieval Lens
Not on the map. Why?
Abstract (arXiv)
Few-shot learning refers to understanding new concepts from only a few examples. We propose an information retrieval-inspired approach for this problem that is motivated by the increased importance of maximally leveraging all the available information in this low-data regime. We define a training objective that aims to extract as much information as possible from each training batch by effectively optimizing over all relative orderings of the batch points simultaneously. In particular, we view each batch point as a `query' that ranks the remaining ones based on its predicted relevance to them and we define a model within the framework of structured prediction to optimize mean Average Precision over these rankings. Our method achieves impressive results on the standard few-shot classification benchmarks while is also capable of few-shot retrieval.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jul 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 23; 2022: 16; 2023: 6; 2024: 4; 2025: 0; 2026: 1.
51 papers.
Sort:
By area:
- 2021LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5cited by 103
- 2023In-Context Learning with Iterative Demonstration Selectioncited by 74
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
- 2018Task-Embedded Control Networks for Few-Shot Imitation Learningcited by 65
- 2022Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentationcited by 65
- 2023Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learningcited by 55
- 2022Retrieval-Enhanced Machine Learningcited by 46
- 2021von Mises-Fisher Loss: An Exploration of Embedding Geometries for Supervised Learningcited by 42
- 2022Continual Training of Language Models for Few-Shot Learningcited by 33
- 2021Ranking Distance Calibration for Cross-Domain Few-Shot Learningcited by 27
- 2021Binocular Mutual Learning for Improving Few-shot Classificationcited by 26
- 2021Few-Shot Learning with Class Imbalancecited by 18
38 more
- 2021Characterizing Generalization under Out-Of-Distribution Shifts in Deep Metric Learningcited by 17
- 2022Continual Few-shot Relation Learning via Embedding Space Regularization and Data Augmentationcited by 17
- 2021Few-Shot Learning with a Strong Teachercited by 16
- 2023Dual Adaptive Representation Alignment for Cross-domain Few-shot Learningcited by 15
- 2021Hierarchical Variational Memory for Few-shot Learning Across Domainscited by 14
- 2023Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning?cited by 11
- 2021What Can Knowledge Bring to Machine Learning? -- A Survey of Low-shot Learning for Structured Datacited by 10
- 2021A Comparative Review of Recent Few-Shot Object Detection Algorithmscited by 10
- 2022Few-shot Metric Learning: Online Adaptation of Embedding for Retrievalcited by 8
- 2021On the Importance of Firth Bias Reduction in Few-Shot Classificationcited by 7
- 2022What GPT Knows About Who is Whocited by 7
- 2022Stochastic Deep Networks with Linear Competing Units for Model-Agnostic Meta-Learningcited by 7
- 2021MetaCloth: Learning Unseen Tasks of Dense Fashion Landmark Detection from a Few Samplescited by 6
- 2021Contextualizing Meta-Learning via Learning to Decomposecited by 5
- 2023Beyond Output Matching: Bidirectional Alignment for Enhanced In-Context Learningcited by 5
- 2021DAMSL: Domain Agnostic Meta Score-based Learningcited by 4
- 2021Learning Instance and Task-Aware Dynamic Kernels for Few Shot Learningcited by 4
- 2021Multi-Domain Few-Shot Learning and Dataset for Agricultural Applicationscited by 3
- 2021Ortho-Shot: Low Displacement Rank Regularization with Data Augmentation for Few-Shot Learningcited by 3
- 2022Similarity Learning based Few Shot Learning for ECG Time Series Classificationcited by 3
- 2022Towards Scalable Hyperbolic Neural Networks using Taylor Series Approximationscited by 3
- 2022Exploring Effective Knowledge Transfer for Few-shot Object Detectioncited by 3
- 2022Enhancing Dual-Encoders with Question and Answer Cross-Embeddings for Answer Retrievalcited by 2
- 2021Semi Supervised Learning For Few-shot Audio Classification By Episodic Triplet Miningcited by 1
- 2021Morphable Detector for Object Detection on Demandcited by 1
- 2022BaseTransformers: Attention over base data-points for One Shot Learningcited by 1
- 2024Harnessing the Power of Local Representations for Few-Shot Classificationcited by 1
- 2024Detect an Object At Once without Fine-tuningcited by 1
- 2021Connecting Images through Time and Sources: Introducing Low-data, Heterogeneous Instance Retrievalcited by 0
- 2021One-shot Learning with Absolute Generalizationcited by 0
- 2021Learning by Examples Based on Multi-level Optimizationcited by 0
- 2022A Framework of Meta Functional Learning for Regularising Knowledge Transfercited by 0
- 2022Learning Primitive-aware Discriminative Representations for Few-shot Learningcited by 0
- 2022CobNet: Cross Attention on Object and Background for Few-Shot Segmentationcited by 0
- 2022Cross-Domain Few-Shot Relation Extraction via Representation Learning and Domain Adaptationcited by 0
- 2023Enhancing Instance-Level Image Classification with Set-Level Labelscited by 0
- 2024LDCA: Local Descriptors with Contextual Augmentation for Few-Shot Learningcited by 0
- 2024Embedding Space Allocation with Angle-Norm Joint Classifiers for Few-Shot Class-Incremental Learningcited by 0
50 most cited of 51 All 51 (JSON)
- 2026Beyond Humans: Multispecies Animal Face Recognition Using Transfer Learning8 Jun 2026
- 2024Embedding Space Allocation with Angle-Norm Joint Classifiers for Few-Shot Class-Incremental Learning14 Nov 2024
- 2024Detect an Object At Once without Fine-tuning4 Nov 2024
- 2024Harnessing the Power of Local Representations for Few-Shot Classification2 Jul 2024
- 2024LDCA: Local Descriptors with Contextual Augmentation for Few-Shot Learning24 Jan 2024
- 2023Beyond Output Matching: Bidirectional Alignment for Enhanced In-Context Learning28 Dec 2023
- 2023Enhancing Instance-Level Image Classification with Set-Level Labels9 Nov 2023
- 2023In-Context Learning with Iterative Demonstration Selection15 Oct 2023
- 2023Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning18 Jun 2023
- 2023Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learning2 Apr 2023
- 2023Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning?16 Feb 2023
- 2022Cross-Domain Few-Shot Relation Extraction via Representation Learning and Domain Adaptation5 Dec 2022
38 more
- 2022Few-shot Metric Learning: Online Adaptation of Embedding for Retrieval14 Nov 2022
- 2022CobNet: Cross Attention on Object and Background for Few-Shot Segmentation21 Oct 2022
- 2022Continual Training of Language Models for Few-Shot Learning11 Oct 2022
- 2022BaseTransformers: Attention over base data-points for One Shot Learning5 Oct 2022
- 2022Exploring Effective Knowledge Transfer for Few-shot Object Detection5 Oct 2022
- 2022Learning Primitive-aware Discriminative Representations for Few-shot Learning20 Aug 2022
- 2022Stochastic Deep Networks with Linear Competing Units for Model-Agnostic Meta-Learning2 Aug 2022
- 2022Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentation18 Jul 2022
- 2022Towards Scalable Hyperbolic Neural Networks using Taylor Series Approximations7 Jun 2022
- 2022Enhancing Dual-Encoders with Question and Answer Cross-Embeddings for Answer Retrieval7 Jun 2022
- 2022What GPT Knows About Who is Who16 May 2022
- 2022Retrieval-Enhanced Machine Learning2 May 2022
- 2022A Framework of Meta Functional Learning for Regularising Knowledge Transfer28 Mar 2022
- 2022Continual Few-shot Relation Learning via Embedding Space Regularization and Data Augmentation4 Mar 2022
- 2022Similarity Learning based Few Shot Learning for ECG Time Series Classification31 Jan 2022
- 2021Hierarchical Variational Memory for Few-shot Learning Across Domains15 Dec 2021
- 2021Learning Instance and Task-Aware Dynamic Kernels for Few Shot Learning7 Dec 2021
- 2021MetaCloth: Learning Unseen Tasks of Dense Fashion Landmark Detection from a Few Samples6 Dec 2021
- 2021Ranking Distance Calibration for Cross-Domain Few-Shot Learning1 Dec 2021
- 2021A Comparative Review of Recent Few-Shot Object Detection Algorithms30 Oct 2021
- 2021Ortho-Shot: Low Displacement Rank Regularization with Data Augmentation for Few-Shot Learning18 Oct 2021
- 2021LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T514 Oct 2021
- 2021Morphable Detector for Object Detection on Demand10 Oct 2021
- 2021On the Importance of Firth Bias Reduction in Few-Shot Classification6 Oct 2021
- 2021Learning by Examples Based on Multi-level Optimization22 Sep 2021
- 2021Multi-Domain Few-Shot Learning and Dataset for Agricultural Applications21 Sep 2021
- 2021Binocular Mutual Learning for Improving Few-shot Classification27 Aug 2021
- 2021Characterizing Generalization under Out-Of-Distribution Shifts in Deep Metric Learning20 Jul 2021
- 2021Few-Shot Learning with a Strong Teacher1 Jul 2021
- 2021Contextualizing Meta-Learning via Learning to Decompose15 Jun 2021
- 2021What Can Knowledge Bring to Machine Learning? -- A Survey of Low-shot Learning for Structured Data11 Jun 2021
- 2021DAMSL: Domain Agnostic Meta Score-based Learning6 Jun 2021
- 2021One-shot Learning with Absolute Generalization28 May 2021
- 2021von Mises-Fisher Loss: An Exploration of Embedding Geometries for Supervised Learning29 Mar 2021
- 2021Connecting Images through Time and Sources: Introducing Low-data, Heterogeneous Instance Retrieval19 Mar 2021
- 2021Semi Supervised Learning For Few-shot Audio Classification By Episodic Triplet Mining16 Feb 2021
- 2021Deep Learning for Instance Retrieval: A Survey27 Jan 2021
- 2021Few-Shot Learning with Class Imbalance7 Jan 2021
50 newest of 51 All 51 (JSON)
- 2021LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5cited by 103
- 2023In-Context Learning with Iterative Demonstration Selectioncited by 74
- 2021Deep Learning for Instance Retrieval: A Surveycited by 70
- 2022Dense Cross-Query-and-Support Attention Weighted Mask Aggregation for Few-Shot Segmentationcited by 65
- 2023Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learningcited by 55
- 2022Retrieval-Enhanced Machine Learningcited by 46
- 2021von Mises-Fisher Loss: An Exploration of Embedding Geometries for Supervised Learningcited by 42
- 2022Continual Training of Language Models for Few-Shot Learningcited by 33
- 2021Ranking Distance Calibration for Cross-Domain Few-Shot Learningcited by 27
- 2021Binocular Mutual Learning for Improving Few-shot Classificationcited by 26
- 2021Few-Shot Learning with Class Imbalancecited by 18
- 2021Characterizing Generalization under Out-Of-Distribution Shifts in Deep Metric Learningcited by 17
12 most cited of 50 All 50 (JSON)
- 2026Beyond Humans: Multispecies Animal Face Recognition Using Transfer Learning8 Jun 2026
- 2024Embedding Space Allocation with Angle-Norm Joint Classifiers for Few-Shot Class-Incremental Learning14 Nov 2024
- 2024Detect an Object At Once without Fine-tuning4 Nov 2024
- 2024Harnessing the Power of Local Representations for Few-Shot Classification2 Jul 2024
- 2024LDCA: Local Descriptors with Contextual Augmentation for Few-Shot Learning24 Jan 2024
- 2023Beyond Output Matching: Bidirectional Alignment for Enhanced In-Context Learning28 Dec 2023
- 2023Enhancing Instance-Level Image Classification with Set-Level Labels9 Nov 2023
- 2023In-Context Learning with Iterative Demonstration Selection15 Oct 2023
- 2023Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning18 Jun 2023
- 2023Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learning2 Apr 2023
- 2023Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning?16 Feb 2023
- 2022Cross-Domain Few-Shot Relation Extraction via Representation Learning and Domain Adaptation5 Dec 2022
12 newest of 50 All 50 (JSON)