Boosting Few-Shot Learning With Adaptive Margin Loss
Not on the map. Why?
Abstract (arXiv)
Few-shot learning (FSL) has attracted increasing attention in recent years but remains challenging, due to the intrinsic difficulty in learning to generalize from a few examples. This paper proposes an adaptive margin principle to improve the generalization ability of metric-based meta-learning approaches for few-shot learning problems. Specifically, we first develop a class-relevant additive margin loss, where semantic similarity between each pair of classes is considered to separate samples in the feature embedding space from similar classes. Further, we incorporate the semantic context among all classes in a sampled training task and develop a task-relevant additive margin loss to better distinguish samples from different classes. Our adaptive margin method can be easily extended to a more realistic generalized FSL setting. Extensive experiments demonstrate that the proposed method can boost the performance of current metric-based meta-learning approaches, under both the standard FSL and generalized FSL settings.
Key facts. Cited by 83 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 18; 2023: 18; 2024: 13; 2025: 5; 2026: 3.
83 papers.
Sort:
By area:
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2021Beyond Max-Margin: Class Margin Equilibrium for Few-shot Object Detectioncited by 80
- 2021Spoken Moments: Learning Joint Audio-Visual Representations from Video Descriptionscited by 53
- 2021Rectifying the Shortcut Learning of Background for Few-Shot Learningcited by 51
- 2022Margin-Based Few-Shot Class-Incremental Learning with Class-Level Overfitting Mitigationcited by 45
- 2021Orthogonal Projection Losscited by 44
- 2023Black Box Few-Shot Adaptation for Vision-Language modelscited by 39
- 2021Partner-Assisted Learning for Few-Shot Image Classificationcited by 36
- 2023Semantic Prompt for Few-Shot Image Recognitioncited by 29
- 2021Few-Shot Object Detection: A Comprehensive Surveycited by 28
- 2021Binocular Mutual Learning for Improving Few-shot Classificationcited by 26
- 2021Anti-aliasing Semantic Reconstruction for Few-Shot Semantic Segmentationcited by 23
38 more
- 2021Prototype Guided Federated Learning of Visual Feature Representationscited by 22
- 2021How to Train Your MAML to Excel in Few-Shot Classificationcited by 22
- 2022Task Discrepancy Maximization for Fine-grained Few-Shot Classificationcited by 21
- 2023Learning to Learn from APIs: Black-Box Data-Free Meta-Learningcited by 18
- 2021Few-Shot Learning with a Strong Teachercited by 16
- 2021SEGA: Semantic Guided Attention on Visual Prototype for Few-Shot Learningcited by 15
- 2021Inferring Prototypes for Multi-Label Few-Shot Image Classification with Word Vector Guided Attentioncited by 15
- 2023Simple Semantic-Aided Few-Shot Learningcited by 15
- 2021Aligning Visual Prototypes with BERT Embeddings for Few-Shot Learningcited by 12
- 2023FD-Align: Feature Discrimination Alignment for Fine-tuning Pre-Trained Models in Few-Shot Learningcited by 12
- 2021Federated Few-Shot Learning with Adversarial Learningcited by 11
- 2021Boosting Few-Shot Classification with View-Learnable Contrastive Learningcited by 11
- 2021What Can Knowledge Bring to Machine Learning? -- A Survey of Low-shot Learning for Structured Datacited by 10
- 2023Architecture, Dataset and Model-Scale Agnostic Data-free Meta-Learningcited by 10
- 2024Boosting Few-Shot Learning via Attentive Feature Regularizationcited by 10
- 2022Adaptive Local-Component-aware Graph Convolutional Network for One-shot Skeleton-based Action Recognitioncited by 9
- 2022Modelling Commonsense Properties using Pre-Trained Bi-Encoderscited by 9
- 2021Revisiting Local Descriptor for Improved Few-Shot Classificationcited by 8
- 2022Powering Finetuning in Few-Shot Learning: Domain-Agnostic Bias Reduction with Selected Samplingcited by 8
- 2023Distilling Semantic Concept Embeddings from Contrastively Fine-Tuned Language Modelscited by 8
- 2024Envisioning Class Entity Reasoning by Large Language Models for Few-shot Learningcited by 8
- 2021Prototype Completion for Few-Shot Learningcited by 7
- 2024Blind Super-Resolution via Meta-learning and Markov Chain Monte Carlo Simulationcited by 7
- 2024Making Large Vision Language Models to be Good Few-shot Learnerscited by 7
- 2025VT-FSL: Bridging Vision and Text with LLMs for Few-Shot Learningcited by 7
- 2021Information Symmetry Matters: A Modal-Alternating Propagation Network for Few-Shot Learningcited by 6
- 2023Advancing Incremental Few-shot Semantic Segmentation via Semantic-guided Relation Alignment and Adaptationcited by 6
- 2024Selective Annotation via Data Allocation: These Data Should Be Triaged to Experts for Annotation Rather Than the Modelcited by 6
- 2022Class Impression for Data-free Incremental Learningcited by 4
- 2022AdaMS: Deep Metric Learning with Adaptive Margin and Adaptive Scale for Acoustic Word Discriminationcited by 4
- 2023DiffKendall: A Novel Approach for Few-Shot Learning with Differentiable Kendall's Rank Correlationcited by 4
- 2023Task-Oriented Channel Attention for Fine-Grained Few-Shot Classificationcited by 4
- 2023Task-Distributionally Robust Data-Free Meta-Learningcited by 4
- 2024DiffCLIP: Few-shot Language-driven Multimodal Classifiercited by 4
- 2025Adaptive Margin Contrastive Learning for Ambiguity-aware 3D Semantic Segmentationcited by 4
- 2021Few-shot Image Classification with Multi-Facet Prototypescited by 3
- 2021Few-shot Partial Multi-view Learningcited by 3
- 2021Attention Guided Cosine Margin For Overcoming Class-Imbalance in Few-Shot Road Object Detectioncited by 3
50 most cited of 83 All 83 (JSON)
- 2026Purification and Regulation: Comorbidity-Aware Multi-Label Few-Shot Learning for Medical Image Classification18 Sep 2026
- 2026DVLA-RL: Dual-Level Vision-Language Alignment with Reinforcement Learning Gating for Few-Shot Learning31 Jan 2026
- 2026Can One-Shot Test-Time Data Augmentation Help with Generalization?27 Jan 2026
- 2025VT-FSL: Bridging Vision and Text with LLMs for Few-Shot Learning29 Sep 2025
- 2025Ambiguity-aware Point Cloud Segmentation by Adaptive Margin Contrastive Learning9 Jul 2025
- 2025Geometry-aware Distance Measure for Diverse Hierarchical Structures in Hyperbolic Spaces23 Jun 2025
- 2025KaFT: Knowledge-aware Fine-tuning for Boosting LLMs' Domain-specific Question-Answering Performance21 May 2025
- 2025Adaptive Margin Contrastive Learning for Ambiguity-aware 3D Semantic Segmentation6 Feb 2025
- 2024Modeling Multi-modal Cross-interaction for Multi-label Few-shot Image Classification Based on Local Feature Selection18 Dec 2024
- 2024DiffCLIP: Few-shot Language-driven Multimodal Classifier10 Dec 2024
- 2024KNN Transformer with Pyramid Prompts for Few-Shot Learning14 Oct 2024
- 2024Envisioning Class Entity Reasoning by Large Language Models for Few-shot Learning22 Aug 2024
38 more
- 2024Making Large Vision Language Models to be Good Few-shot Learners21 Aug 2024
- 2024Blind Super-Resolution via Meta-learning and Markov Chain Monte Carlo Simulation13 Jun 2024
- 2024CCSI: Continual Class-Specific Impression for Data-free Class Incremental Learning9 Jun 2024
- 2024Like Humans to Few-Shot Learning through Knowledge Permeation of Vision and Text21 May 2024
- 2024Selective Annotation via Data Allocation: These Data Should Be Triaged to Experts for Annotation Rather Than the Model20 May 2024
- 2024Boosting Few-Shot Learning via Attentive Feature Regularization23 Mar 2024
- 2024Controllable Relation Disentanglement for Few-Shot Class-Incremental Learning17 Mar 2024
- 2024Boosting Meta-Training with Base Class Information for Few-Shot Learning6 Mar 2024
- 2024Augmenting Prototype Network with TransMix for Few-shot Hyperspectral Image Classification22 Jan 2024
- 2023TransMed: Large Language Models Enhance Vision Transformer for Biomedical Image Classification12 Dec 2023
- 2023Simple Semantic-Aided Few-Shot Learning30 Nov 2023
- 2023Inferring Latent Class Statistics from Text for Robust Visual Few-Shot Learning24 Nov 2023
- 2023Task-Distributionally Robust Data-Free Meta-Learning23 Nov 2023
- 2023FD-Align: Feature Discrimination Alignment for Fine-tuning Pre-Trained Models in Few-Shot Learning23 Oct 2023
- 2023What do Deck Chairs and Sun Hats Have in Common? Uncovering Shared Properties in Large Concept Vocabularies23 Oct 2023
- 2023Task-Oriented Channel Attention for Fine-Grained Few-Shot Classification28 Jul 2023
- 2023DiffKendall: A Novel Approach for Few-Shot Learning with Differentiable Kendall's Rank Correlation28 Jul 2023
- 2023Unifying Token and Span Level Supervisions for Few-Shot Sequence Labeling16 Jul 2023
- 2023FILM: How can Few-Shot Image Classification Benefit from Pre-Trained Language Models?9 Jul 2023
- 2023Epistemic Graph: A Plug-And-Play Module For Hybrid Representation Learning30 May 2023
- 2023Learning to Learn from APIs: Black-Box Data-Free Meta-Learning28 May 2023
- 2023Advancing Incremental Few-shot Semantic Segmentation via Semantic-guided Relation Alignment and Adaptation18 May 2023
- 2023Distilling Semantic Concept Embeddings from Contrastively Fine-Tuned Language Models16 May 2023
- 2023Black Box Few-Shot Adaptation for Vision-Language models4 Apr 2023
- 2023Semantic Prompt for Few-Shot Image Recognition24 Mar 2023
- 2023Architecture, Dataset and Model-Scale Agnostic Data-free Meta-Learning20 Mar 2023
- 2023Gestalt-Guided Image Understanding for Few-Shot Learning8 Feb 2023
- 2022Disentangled Generation with Information Bottleneck for Few-Shot Learning29 Nov 2022
- 2022Better Generalized Few-Shot Learning Even Without Base Data29 Nov 2022
- 2022Few-shot Classification with Hypersphere Modeling of Prototypes10 Nov 2022
- 2022Reconciliation of Pre-trained Models and Prototypical Neural Networks in Few-shot Named Entity Recognition7 Nov 2022
- 2022AdaMS: Deep Metric Learning with Adaptive Margin and Adaptive Scale for Acoustic Word Discrimination26 Oct 2022
- 2022Margin-Based Few-Shot Class-Incremental Learning with Class-Level Overfitting Mitigation10 Oct 2022
- 2022Learning to embed semantic similarity for joint image-text retrieval7 Oct 2022
- 2022Modelling Commonsense Properties using Pre-Trained Bi-Encoders6 Oct 2022
- 2022Adaptive Local-Component-aware Graph Convolutional Network for One-shot Skeleton-based Action Recognition21 Sep 2022
- 2022Fine-grained Few-shot Recognition by Deep Object Parsing14 Jul 2022
- 2022Task Discrepancy Maximization for Fine-grained Few-Shot Classification4 Jul 2022
50 newest of 83 All 83 (JSON)
- 2024DiffCLIP: Few-shot Language-driven Multimodal Classifier10 Dec 2024
- 2024Making Large Vision Language Models to be Good Few-shot Learners21 Aug 2024
- 2023Black Box Few-Shot Adaptation for Vision-Language models4 Apr 2023
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2021Beyond Max-Margin: Class Margin Equilibrium for Few-shot Object Detectioncited by 80
- 2021Spoken Moments: Learning Joint Audio-Visual Representations from Video Descriptionscited by 53
- 2021Rectifying the Shortcut Learning of Background for Few-Shot Learningcited by 51
- 2022Margin-Based Few-Shot Class-Incremental Learning with Class-Level Overfitting Mitigationcited by 45
- 2021Orthogonal Projection Losscited by 44
- 2021Partner-Assisted Learning for Few-Shot Image Classificationcited by 36
- 2023Semantic Prompt for Few-Shot Image Recognitioncited by 29
- 2021Few-Shot Object Detection: A Comprehensive Surveycited by 28
- 2021Binocular Mutual Learning for Improving Few-shot Classificationcited by 26
- 2021Anti-aliasing Semantic Reconstruction for Few-Shot Semantic Segmentationcited by 23
- 2021Prototype Guided Federated Learning of Visual Feature Representationscited by 22
12 most cited of 79 All 79 (JSON)
- 2026Purification and Regulation: Comorbidity-Aware Multi-Label Few-Shot Learning for Medical Image Classification18 Sep 2026
- 2026DVLA-RL: Dual-Level Vision-Language Alignment with Reinforcement Learning Gating for Few-Shot Learning31 Jan 2026
- 2026Can One-Shot Test-Time Data Augmentation Help with Generalization?27 Jan 2026
- 2025VT-FSL: Bridging Vision and Text with LLMs for Few-Shot Learning29 Sep 2025
- 2025Ambiguity-aware Point Cloud Segmentation by Adaptive Margin Contrastive Learning9 Jul 2025
- 2025Geometry-aware Distance Measure for Diverse Hierarchical Structures in Hyperbolic Spaces23 Jun 2025
- 2025KaFT: Knowledge-aware Fine-tuning for Boosting LLMs' Domain-specific Question-Answering Performance21 May 2025
- 2025Adaptive Margin Contrastive Learning for Ambiguity-aware 3D Semantic Segmentation6 Feb 2025
- 2024Modeling Multi-modal Cross-interaction for Multi-label Few-shot Image Classification Based on Local Feature Selection18 Dec 2024
- 2024KNN Transformer with Pyramid Prompts for Few-Shot Learning14 Oct 2024
- 2024Blind Super-Resolution via Meta-learning and Markov Chain Monte Carlo Simulation13 Jun 2024
- 2024CCSI: Continual Class-Specific Impression for Data-free Class Incremental Learning9 Jun 2024
12 newest of 79 All 79 (JSON)