mlsanityData to 14 Oct 2026

Improving Adversarial Transferability by Stable Diffusion

arXiv 2311.11017 ↗First posted 18 Nov 2023cs.CVcited by 22

On the map: Diffusion models → Robustness, privacy and adversarial aspects

Abstract (arXiv)

Deep neural networks (DNNs) are susceptible to adversarial examples, which introduce imperceptible perturbations to benign samples, deceiving DNN predictions. While some attack methods excel in the white-box setting, they often struggle in the black-box scenario, particularly against models fortified with defense mechanisms. Various techniques have emerged to enhance the transferability of adversarial attacks for the black-box scenario. Among these, input transformation-based attacks have demonstrated their effectiveness. In this paper, we explore the potential of leveraging data generated by Stable Diffusion to boost adversarial transferability. This approach draws inspiration from recent research that harnessed synthetic data generated by Stable Diffusion to enhance model generalization. In particular, previous work has highlighted the correlation between the presence of both real and synthetic data and improved model generalization. Building upon this insight, we introduce a novel attack method called Stable Diffusion Attack Method (SDAM), which incorporates samples generated by Stable Diffusion to augment input images. Furthermore, we propose a fast variant of SDAM to reduce computational overhead while preserving high adversarial transferability. Our extensive experimental results demonstrate that our method outperforms state-of-the-art baselines by a substantial margin. Moreover, our approach is compatible with existing transfer-based attacks to further enhance adversarial transferability.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 31 of its 33 references that are in the map. First posted on arXiv 18 Nov 2023.

Builds on

31 of 33 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  7. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  8. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  9. 2013Intriguing properties of neural networkscited by 5,155
  10. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  11. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  12. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
19 more
  1. 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
  2. 2016Adversarial Machine Learning at Scalecited by 936
  3. 2017Ensemble Adversarial Training: Attacks and Defensescited by 840
  4. 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 599
  5. 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 536
  6. 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 486
  7. 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 442
  8. 2017Mitigating Adversarial Effects Through Randomizationcited by 383
  9. 2019Nesterov Accelerated Gradient and Scale Invariance for Adversarial Attackscited by 355
  10. 2017Defense against Adversarial Attacks Using High-Level Representation Guided Denoisercited by 329
  11. 2021Enhancing the Transferability of Adversarial Attacks through Variance Tuningcited by 244
  12. 2020A Self-supervised Approach for Adversarial Robustnesscited by 180
  13. 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clonescited by 172
  14. 2021Admix: Enhancing the Transferability of Adversarial Attackscited by 156
  15. 2018ComDefend: An Efficient Image Compression Model to Defend Adversarial Examplescited by 105
  16. 2023Leaving Reality to Imagination: Robust Classification via Generated Datasetscited by 91
  17. 2018Learning Transferable Adversarial Examples via Ghost Networkscited by 70
  18. 2021Improving the Transferability of Adversarial Examples with Resized-Diverse-Inputs, Diversity-Ensemble and Region Fittingcited by 37
  19. 2023Improving the Transferability of Adversarial Samples by Path-Augmented Methodcited by 36

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 13; 2025: 2; 2026: 7.

22 papers.

Sort:

By area:

  1. 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Promptcited by 109
  2. 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Modelscited by 87
  3. 2024Semantic Mirror Jailbreak: Genetic Algorithm Based Jailbreak Prompts Against Open-source LLMscited by 53
  4. 2024Visual Adversarial Attack on Vision-Language Models for Autonomous Drivingcited by 36
  5. 2024Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detectioncited by 35
  6. 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearningcited by 31
  7. 2024Effectiveness Assessment of Recent Large Vision-Language Modelscited by 29
  8. 2024Towards Robust Physical-world Backdoor Attacks on Lane Detectioncited by 26
  9. 2025Black-Box Adversarial Attack on Vision Language Models for Autonomous Drivingcited by 24
  10. 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusionscited by 18
  11. 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlookcited by 13
  12. 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Modelscited by 13
10 more
  1. 2026WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agentscited by 7
  2. 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threatscited by 6
  3. 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysiscited by 4
  4. 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggerscited by 1
  5. 2026Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspectivecited by 1
  6. 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Modelscited by 0
  7. 2025Improving Black-Box Generative Attacks via Generator Semantic Consistencycited by 0
  8. 2026A Patch-based Cross-view Regularized Framework for Backdoor Defense in Multimodal Large Language Modelscited by 0
  9. 2026CIVA: Critic-Induced Value-Subspace Attacks on Visual World-Model Agentscited by 0
  10. 2026TempQ-Jail: Query-Constrained Candidate Ranking for Text-to-Video Jailbreak Attackscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards more transferable adversarial attack in black-box manner
  2. 2023Diffusion Models for Imperceptible and Transferable Adversarial Attack
  3. 2025AdvAD: Exploring Non-Parametric Diffusion for Imperceptible Adversarial Attacks
  4. 2025Diffusion or Non-Diffusion Adversarial Defenses: Rethinking the Relation between Classifier and Adversarial Purifier
  5. 2023Adversarial defense based on distribution transfer
  6. 2024Adversarial Examples are Misaligned in Diffusion Model Manifolds
  7. 2023Mist: Towards Improved Adversarial Examples for Diffusion Models
  8. 2025Beyond Classification: Evaluating Diffusion Denoised Smoothing for Security-Utility Trade off