Density-aware Sample-specific Attack
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
Despite recent progress in backdoor attacks, existing methods remain susceptible to post-training defenses that erase the backdoor through fine-tuning or pruning. We revisit the core objectives of backdoor attacks and derive principled criteria characterizing optimal sample-specific trigger construction under a Bayes-optimal model of the victim's training. Our analysis reveals that both attack success and clean-accuracy preservation are simultaneously optimized when triggered samples are steered into low-density regions of the clean data distribution, a distributional condition that controls all moments of the poisoned distribution at once rather than a handful of input-space summary statistics. We introduce a bilevel optimization framework that estimates density ratios via conditional time-score matching and optimizes a mixture-model objective to place triggered samples in these sparse regions. Extensive evaluations on MNIST, CIFAR-10, GTSRB, and TinyImageNet demonstrate that our method achieves above 99% attack success rate before defense and retains 50--85 percentage points higher post-defense ASR than the strongest baselines under fine-tuning defenses. Against neuron-pruning defenses, the method exhibits complete immunity, with zero neurons identified for removal across all pruning thresholds. These results expose a fundamental gap in current defense paradigms and underscore the need for defenses that operate beyond the support of the clean distribution.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 21 of its 36 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
21 of 36 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,106
- 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,055
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 580
- 2018Spectral Signatures in Backdoor Attackscited by 484
- 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 459
- 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 405
- 2020Invisible Backdoor Attack with Sample-Specific Triggerscited by 353
- 2020Input-Aware Dynamic Backdoor Attackcited by 313
- 2019Optimizing Millions of Hyperparameters by Implicit Differentiationcited by 304
9 more
- 2019Label-Consistent Backdoor Attackscited by 296
- 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 235
- 2021Adversarial Unlearning of Backdoors via Implicit Hypergradientcited by 166
- 2022BppAttack: Stealthy and Efficient Trojan Attacks against Deep Neural Networks via Image Quantization and Contrastive Adversarial Learningcited by 86
- 2023Enhancing Fine-Tuning Based Backdoor Defense with Sharpness-Aware Minimizationcited by 64
- 2023Reconstructive Neuron Pruning for Backdoor Defensecited by 59
- 2023Towards Stable Backdoor Purification through Feature Shift Tuningcited by 32
- 2025Density Ratio Estimation with Conditional Probability Pathscited by 13
- 2023WaveAttack: Asymmetric Frequency Obfuscation-based Backdoor Attacks Against Deep Neural Networkscited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026When Stronger Triggers Backfire: A High-Dimensional Theory of Backdoor Attacks
- 2023Stealthy Backdoor Attack via Confidence-driven Sampling
- 2021Backdoor Learning Curves: Explaining Backdoor Poisoning Beyond Influence Functions
- 2026Diversity Matters: Distributional Feature Coverage Sample Selection for Data-Efficient Backdoor Attacks
- 2023Towards Sample-specific Backdoor Attack with Clean Labels via Attribute Trigger
- 2024NoiseAttack: An Evasive Sample-Specific Multi-Targeted Backdoor Attack Through White Gaussian Noise
- 2026Anti-Backdoor Coreset Selection via Cumulative Entropy
- 2025Robust Backdoor Removal by Reconstructing Trigger-Activated Changes in Latent Representation