Does Few-shot Learning Suffer from Backdoor Attacks?
Not on the map. Why?
Abstract (arXiv)
The field of few-shot learning (FSL) has shown promising results in scenarios where training data is limited, but its vulnerability to backdoor attacks remains largely unexplored. We first explore this topic by first evaluating the performance of the existing backdoor attack methods on few-shot learning scenarios. Unlike in standard supervised learning, existing backdoor attack methods failed to perform an effective attack in FSL due to two main issues. Firstly, the model tends to overfit to either benign features or trigger features, causing a tough trade-off between attack success rate and benign accuracy. Secondly, due to the small number of training samples, the dirty label or visible trigger in the support set can be easily detected by victims, which reduces the stealthiness of attacks. It seemed that FSL could survive from backdoor attacks. However, in this paper, we propose the Few-shot Learning Backdoor Attack (FLBA) to show that FSL can still be vulnerable to backdoor attacks. Specifically, we first generate a trigger to maximize the gap between poisoned and benign features. It enables the model to learn both benign and trigger features, which solves the problem of overfitting. To make it more stealthy, we hide the trigger by optimizing two types of imperceptible perturbation, namely attractive and repulsive perturbation, instead of attaching the trigger directly. Once we obtain the perturbations, we can poison all samples in the benign support set into a hidden poisoned support set and fine-tune the model on it. Our method demonstrates a high Attack Success Rate (ASR) in FSL tasks with different few-shot learning paradigms while preserving clean accuracy and maintaining stealthiness. This study reveals that few-shot learning still suffers from backdoor attacks, and its security should be given attention.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 38 of its 52 references that are in the map. First posted on arXiv 31 Dec 2023.
Builds on
38 of 52 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
- 2019A Closer Look at Few-shot Classificationcited by 679
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
- 2018Meta-Learning with Latent Embedding Optimizationcited by 476
- 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
26 more
- 2018Meta-Learning for Semi-Supervised Few-Shot Classificationcited by 456
- 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 435
- 2018Meta-learning with differentiable closed-form solverscited by 395
- 2015Recent Advances in Convolutional Neural Networkscited by 360
- 2019Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAMLcited by 359
- 2019Hidden Trigger Backdoor Attackscited by 359
- 2020Input-Aware Dynamic Backdoor Attackcited by 304
- 2019A Baseline for Few-Shot Image Classificationcited by 298
- 2019Label-Consistent Backdoor Attackscited by 285
- 2021Free Lunch for Few-shot Learning: Distribution Calibrationcited by 165
- 2020Clean-Label Backdoor Attacks on Video Recognition Modelscited by 162
- 2020Negative Margin Matters: Understanding Margin in Few-shot Classificationcited by 129
- 2019Revisiting Local Descriptor based Image-to-Class Measure for Few-shot Learningcited by 121
- 2020Few-Shot Classification with Feature Map Reconstruction Networkscited by 116
- 2021Relational Embedding for Few-Shot Classificationcited by 74
- 2022SegPGD: An Effective and Efficient Adversarial Attack for Evaluating and Boosting Segmentation Robustnesscited by 74
- 2020Adv-watermark: A Novel Watermark Perturbation for Adversarial Examplescited by 56
- 2022A Large-scale Multiple-objective Method for Black-box Attack against Object Detectioncited by 55
- 2021Defending against Model Stealing via Verifying Embedded External Featurescited by 44
- 2020Self-supervised Knowledge Distillation for Few-shot Learningcited by 41
- 2021LibFewShot: A Comprehensive Library for Few-shot Learningcited by 21
- 2022Watermark Vaccine: Adversarial Attacks to Prevent Watermark Removalcited by 18
- 2020Backdoor Attacks on Federated Meta-Learningcited by 14
- 2022ALA: Naturalness-aware Adversarial Lightness Attackcited by 11
- 2021AdvFilter: Predictive Perturbation-aware Filtering against Adversarial Attack via Multi-domain Learningcited by 9
- 2023Exploring Non-additive Randomness on ViT against Query-Based Black-Box Attackscited by 1
Built on by
Citing papers per year: 2024: 12; 2025: 4; 2026: 3.
19 papers.
Sort:
By area:
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Promptcited by 103
- 2024Unveiling the Safety of GPT-4o: An Empirical Study using Jailbreak Attackscited by 35
- 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearningcited by 31
- 2024Effectiveness Assessment of Recent Large Vision-Language Modelscited by 29
- 2024Compromising Embodied Agents with Contextual Backdoor Attackscited by 29
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detectioncited by 25
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusionscited by 18
- 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlookcited by 13
- 2025ELBA-Bench: An Efficient Learning Backdoor Attacks Benchmark for Large Language Modelscited by 10
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threatscited by 6
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysiscited by 4
- 2025Scanning Trojaned Models Using Out-of-Distribution Samplescited by 3
7 more
- 2025CBW: Towards Dataset Ownership Verification for Speaker Verification via Clustering-based Backdoor Watermarkingcited by 3
- 2024Are You Using Reliable Graph Prompts? Trojan Prompt Attacks on Graph Neural Networkscited by 2
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggerscited by 1
- 2026Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspectivecited by 1
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Modelscited by 0
- 2025Provably Robust Adaptation for Language-Empowered Foundation Modelscited by 0
- 2026ElasticBack: Stealthy Conditional Backdoor in LLM-Agent Skills via Coupled Trigger-Rule Optimizationcited by 0
- 2026ElasticBack: Stealthy Conditional Backdoor in LLM-Agent Skills via Coupled Trigger-Rule Optimization10 Aug 2026
- 2026Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspective7 Jul 2026
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggers6 Apr 2026
- 2025Provably Robust Adaptation for Language-Empowered Foundation Models9 Oct 2025
- 2025CBW: Towards Dataset Ownership Verification for Speaker Verification via Clustering-based Backdoor Watermarking2 Mar 2025
- 2025ELBA-Bench: An Efficient Learning Backdoor Attacks Benchmark for Large Language Models22 Feb 2025
- 2025Scanning Trojaned Models Using Out-of-Distribution Samples28 Jan 2025
- 2024Are You Using Reliable Graph Prompts? Trojan Prompt Attacks on Graph Neural Networks17 Oct 2024
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Models7 Oct 2024
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threats29 Sep 2024
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysis24 Sep 2024
- 2024Compromising Embodied Agents with Contextual Backdoor Attacks6 Aug 2024
7 more
- 2024Unveiling the Safety of GPT-4o: An Empirical Study using Jailbreak Attacks10 Jun 2024
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt6 Jun 2024
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusions3 Jun 2024
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detection9 May 2024
- 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlook24 Mar 2024
- 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearning24 Mar 2024
- 2024Effectiveness Assessment of Recent Large Vision-Language Models7 Mar 2024
- 2024Unveiling the Safety of GPT-4o: An Empirical Study using Jailbreak Attackscited by 35
- 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearningcited by 31
- 2025ELBA-Bench: An Efficient Learning Backdoor Attacks Benchmark for Large Language Modelscited by 10
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threatscited by 6
- 2025Scanning Trojaned Models Using Out-of-Distribution Samplescited by 3
- 2025ELBA-Bench: An Efficient Learning Backdoor Attacks Benchmark for Large Language Models22 Feb 2025
- 2025Scanning Trojaned Models Using Out-of-Distribution Samples28 Jan 2025
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threats29 Sep 2024
- 2024Unveiling the Safety of GPT-4o: An Empirical Study using Jailbreak Attacks10 Jun 2024
- 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearning24 Mar 2024
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Promptcited by 103
- 2024Effectiveness Assessment of Recent Large Vision-Language Modelscited by 29
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggerscited by 1
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Modelscited by 0
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggers6 Apr 2026
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Models7 Oct 2024
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt6 Jun 2024
- 2024Effectiveness Assessment of Recent Large Vision-Language Models7 Mar 2024
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detectioncited by 25
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusionscited by 18
- 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlookcited by 13
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysiscited by 4
- 2025CBW: Towards Dataset Ownership Verification for Speaker Verification via Clustering-based Backdoor Watermarkingcited by 3
- 2024Are You Using Reliable Graph Prompts? Trojan Prompt Attacks on Graph Neural Networkscited by 2
- 2025Provably Robust Adaptation for Language-Empowered Foundation Modelscited by 0
- 2025Provably Robust Adaptation for Language-Empowered Foundation Models9 Oct 2025
- 2025CBW: Towards Dataset Ownership Verification for Speaker Verification via Clustering-based Backdoor Watermarking2 Mar 2025
- 2024Are You Using Reliable Graph Prompts? Trojan Prompt Attacks on Graph Neural Networks17 Oct 2024
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysis24 Sep 2024
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusions3 Jun 2024
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detection9 May 2024
- 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlook24 Mar 2024