Improving Adversarial Transferability by Stable Diffusion
On the map: Diffusion models → Robustness, privacy and adversarial aspects
Abstract (arXiv)
Deep neural networks (DNNs) are susceptible to adversarial examples, which introduce imperceptible perturbations to benign samples, deceiving DNN predictions. While some attack methods excel in the white-box setting, they often struggle in the black-box scenario, particularly against models fortified with defense mechanisms. Various techniques have emerged to enhance the transferability of adversarial attacks for the black-box scenario. Among these, input transformation-based attacks have demonstrated their effectiveness. In this paper, we explore the potential of leveraging data generated by Stable Diffusion to boost adversarial transferability. This approach draws inspiration from recent research that harnessed synthetic data generated by Stable Diffusion to enhance model generalization. In particular, previous work has highlighted the correlation between the presence of both real and synthetic data and improved model generalization. Building upon this insight, we introduce a novel attack method called Stable Diffusion Attack Method (SDAM), which incorporates samples generated by Stable Diffusion to augment input images. Furthermore, we propose a fast variant of SDAM to reduce computational overhead while preserving high adversarial transferability. Our extensive experimental results demonstrate that our method outperforms state-of-the-art baselines by a substantial margin. Moreover, our approach is compatible with existing transfer-based attacks to further enhance adversarial transferability.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 31 of its 33 references that are in the map. First posted on arXiv 18 Nov 2023.
Builds on
31 of 33 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2013Intriguing properties of neural networkscited by 5,155
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
19 more
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
- 2016Adversarial Machine Learning at Scalecited by 936
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 840
- 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 599
- 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 536
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 486
- 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 442
- 2017Mitigating Adversarial Effects Through Randomizationcited by 383
- 2019Nesterov Accelerated Gradient and Scale Invariance for Adversarial Attackscited by 355
- 2017Defense against Adversarial Attacks Using High-Level Representation Guided Denoisercited by 329
- 2021Enhancing the Transferability of Adversarial Attacks through Variance Tuningcited by 244
- 2020A Self-supervised Approach for Adversarial Robustnesscited by 180
- 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clonescited by 172
- 2021Admix: Enhancing the Transferability of Adversarial Attackscited by 156
- 2018ComDefend: An Efficient Image Compression Model to Defend Adversarial Examplescited by 105
- 2023Leaving Reality to Imagination: Robust Classification via Generated Datasetscited by 91
- 2018Learning Transferable Adversarial Examples via Ghost Networkscited by 70
- 2021Improving the Transferability of Adversarial Examples with Resized-Diverse-Inputs, Diversity-Ensemble and Region Fittingcited by 37
- 2023Improving the Transferability of Adversarial Samples by Path-Augmented Methodcited by 36
Built on by
Citing papers per year: 2024: 13; 2025: 2; 2026: 7.
22 papers.
Sort:
By area:
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Promptcited by 109
- 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Modelscited by 87
- 2024Semantic Mirror Jailbreak: Genetic Algorithm Based Jailbreak Prompts Against Open-source LLMscited by 53
- 2024Visual Adversarial Attack on Vision-Language Models for Autonomous Drivingcited by 36
- 2024Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detectioncited by 35
- 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearningcited by 31
- 2024Effectiveness Assessment of Recent Large Vision-Language Modelscited by 29
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detectioncited by 26
- 2025Black-Box Adversarial Attack on Vision Language Models for Autonomous Drivingcited by 24
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusionscited by 18
- 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlookcited by 13
- 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Modelscited by 13
10 more
- 2026WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agentscited by 7
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threatscited by 6
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysiscited by 4
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggerscited by 1
- 2026Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspectivecited by 1
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Modelscited by 0
- 2025Improving Black-Box Generative Attacks via Generator Semantic Consistencycited by 0
- 2026A Patch-based Cross-view Regularized Framework for Backdoor Defense in Multimodal Large Language Modelscited by 0
- 2026CIVA: Critic-Induced Value-Subspace Attacks on Visual World-Model Agentscited by 0
- 2026TempQ-Jail: Query-Constrained Candidate Ranking for Text-to-Video Jailbreak Attackscited by 0
- 2026TempQ-Jail: Query-Constrained Candidate Ranking for Text-to-Video Jailbreak Attacks25 Sep 2026
- 2026CIVA: Critic-Induced Value-Subspace Attacks on Visual World-Model Agents21 Aug 2026
- 2026Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspective7 Jul 2026
- 2026WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agents22 May 2026
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggers6 Apr 2026
- 2026A Patch-based Cross-view Regularized Framework for Backdoor Defense in Multimodal Large Language Models6 Apr 2026
- 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Models21 Feb 2026
- 2025Improving Black-Box Generative Attacks via Generator Semantic Consistency23 Jun 2025
- 2025Black-Box Adversarial Attack on Vision Language Models for Autonomous Driving23 Jan 2025
- 2024Visual Adversarial Attack on Vision-Language Models for Autonomous Driving27 Nov 2024
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Models7 Oct 2024
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threats29 Sep 2024
10 more
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysis24 Sep 2024
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt6 Jun 2024
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusions3 Jun 2024
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detection9 May 2024
- 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlook24 Mar 2024
- 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearning24 Mar 2024
- 2024Effectiveness Assessment of Recent Large Vision-Language Models7 Mar 2024
- 2024Semantic Mirror Jailbreak: Genetic Algorithm Based Jailbreak Prompts Against Open-source LLMs21 Feb 2024
- 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Models21 Feb 2024
- 2024Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detection18 Feb 2024
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Promptcited by 109
- 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Modelscited by 87
- 2024Effectiveness Assessment of Recent Large Vision-Language Modelscited by 29
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggerscited by 1
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Modelscited by 0
- 2026A Patch-based Cross-view Regularized Framework for Backdoor Defense in Multimodal Large Language Modelscited by 0
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggers6 Apr 2026
- 2026A Patch-based Cross-view Regularized Framework for Backdoor Defense in Multimodal Large Language Models6 Apr 2026
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Models7 Oct 2024
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt6 Jun 2024
- 2024Effectiveness Assessment of Recent Large Vision-Language Models7 Mar 2024
- 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Models21 Feb 2024
- 2024Semantic Mirror Jailbreak: Genetic Algorithm Based Jailbreak Prompts Against Open-source LLMscited by 53
- 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearningcited by 31
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threatscited by 6
- 2026TempQ-Jail: Query-Constrained Candidate Ranking for Text-to-Video Jailbreak Attackscited by 0
- 2026TempQ-Jail: Query-Constrained Candidate Ranking for Text-to-Video Jailbreak Attacks25 Sep 2026
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threats29 Sep 2024
- 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearning24 Mar 2024
- 2024Semantic Mirror Jailbreak: Genetic Algorithm Based Jailbreak Prompts Against Open-source LLMs21 Feb 2024
- 2024Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detectioncited by 35
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detectioncited by 26
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusionscited by 18
- 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlookcited by 13
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysiscited by 4
- 2025Improving Black-Box Generative Attacks via Generator Semantic Consistencycited by 0
- 2025Improving Black-Box Generative Attacks via Generator Semantic Consistency23 Jun 2025
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysis24 Sep 2024
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusions3 Jun 2024
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detection9 May 2024
- 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlook24 Mar 2024
- 2024Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detection18 Feb 2024
Similar, not cited
Close in wording, no citation either way
- 2025Towards more transferable adversarial attack in black-box manner
- 2023Diffusion Models for Imperceptible and Transferable Adversarial Attack
- 2025AdvAD: Exploring Non-Parametric Diffusion for Imperceptible Adversarial Attacks
- 2025Diffusion or Non-Diffusion Adversarial Defenses: Rethinking the Relation between Classifier and Adversarial Purifier
- 2023Adversarial defense based on distribution transfer
- 2024Adversarial Examples are Misaligned in Diffusion Model Manifolds
- 2023Mist: Towards Improved Adversarial Examples for Diffusion Models
- 2025Beyond Classification: Evaluating Diffusion Denoised Smoothing for Security-Utility Trade off