Constructing Unrestricted Adversarial Examples with Generative Models
Not on the map. Why?
Abstract (arXiv)
Adversarial examples are typically constructed by perturbing an existing data point within a small matrix norm, and current defense methods are focused on guarding against this type of attack. In this paper, we propose unrestricted adversarial examples, a new threat model where the attackers are not restricted to small norm-bounded perturbations. Different from perturbation-based attacks, we propose to synthesize unrestricted adversarial examples entirely from scratch using conditional generative models. Specifically, we first train an Auxiliary Classifier Generative Adversarial Network (AC-GAN) to model the class-conditional distribution over data samples. Then, conditioned on a desired class, we search over the AC-GAN latent space to find images that are likely under the generative model and are misclassified by a target classifier. We demonstrate through human evaluation that unrestricted adversarial examples generated this way are legitimate and belong to the desired class. Our empirical results on the MNIST, SVHN, and CelebA datasets show that unrestricted adversarial examples can bypass strong adversarial training and certified defense methods designed for traditional adversarial attacks.
Key facts. Cited by 135 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 38; 2022: 26; 2023: 23; 2024: 17; 2025: 18; 2026: 12.
135 papers.
Sort:
By area:
- 2022The Alignment Problem from a Deep Learning Perspectivecited by 258
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2018Multi-Agent Generative Adversarial Imitation Learningcited by 100
- 2023Diffusion Models for Imperceptible and Transferable Adversarial Attackcited by 94
- 2021Improving Transferability of Adversarial Patches on Face Recognition with Generative Modelscited by 80
- 2023AdvDiff: Generating Unrestricted Adversarial Examples using Diffusion Modelscited by 46
- 2022Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioningcited by 45
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2021Reveal of Vision Transformers Robustness against Adversarial Attackscited by 43
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 43
- 2022Natural Color Fool: Towards Boosting Black-box Unrestricted Attackscited by 38
- 2024Efficient Generation of Targeted and Transferable Adversarial Examples for Vision-Language Models Via Diffusion Modelscited by 38
38 more
- 2021A Little Robustness Goes a Long Way: Leveraging Robust Features for Targeted Transfer Attackscited by 34
- 2021Boosting Transferability of Targeted Adversarial Examples via Hierarchical Generative Networkscited by 32
- 2022Perceptual Attacks of No-Reference Image Quality Models with Human-in-the-Loopcited by 30
- 2022Diffeomorphic Counterfactuals with Generative Modelscited by 29
- 2021Defending Against Image Corruptions Through Adversarial Augmentationscited by 28
- 2021Robust Feature-Level Adversaries are Interpretability Toolscited by 27
- 2024Transferable Adversarial Facial Images for Privacy Protectioncited by 27
- 2021Exploring Adversarial Fake Images on Face Manifoldcited by 24
- 2021Robustness and Generalization via Generative Adversarial Trainingcited by 20
- 2022StyleFool: Fooling Video Classification Systems via Style Transfercited by 20
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 20
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2021Inconspicuous Adversarial Patches for Fooling Image Recognition Systems on Mobile Devicescited by 18
- 2022Unrestricted Black-box Adversarial Attack Using GAN with Limited Queriescited by 18
- 2021A Unified Game-Theoretic Interpretation of Adversarial Robustnesscited by 17
- 2021Graph Structural Attack by Perturbing Spectral Distancecited by 16
- 2021Generative Adversarial Networks: A Survey Towards Private and Secure Applicationscited by 15
- 2022Discrete Point-wise Attack Is Not Enough: Generalized Manifold Adversarial Attack for Face Recognitioncited by 14
- 2023From Robustness to Explainability and Back Againcited by 14
- 2022Towards Transferable Unrestricted Adversarial Examples with Minimum Changescited by 13
- 2021Generating Adversarial Examples with Graph Neural Networkscited by 12
- 2022Understanding Adversarial Robustness Against On-manifold Adversarial Examplescited by 12
- 2023Semantic Adversarial Attacks via Diffusion Modelscited by 12
- 2021Exposing Previously Undetectable Faults in Deep Neural Networkscited by 11
- 2021Adversarial Token Attacks on Vision Transformerscited by 11
- 2024As Firm As Their Foundations: Can open-sourced foundation models be used to create adversarial examples for downstream tasks?cited by 11
- 2021Interpolated Joint Space Adversarial Training for Robust and Generalizable Defensescited by 10
- 2023Attacking Perceptual Similarity Metricscited by 10
- 2021Transferable Sparse Adversarial Attackcited by 9
- 2021Adversarial Attack for Asynchronous Event-based Datacited by 9
- 2022Adversarially Robust Learning with Tolerancecited by 9
- 2024Reliable Model Watermarking: Defending Against Theft without Compromising on Evasioncited by 9
- 2021A Systematical Solution for Face De-identificationcited by 8
- 2021Adversarial robustness for latent models: Revisiting the robust-standard accuracies tradeoffcited by 8
- 2022Learning Antidote Data to Individual Unfairnesscited by 8
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priorscited by 8
- 2025AdvAD: Exploring Non-Parametric Diffusion for Imperceptible Adversarial Attackscited by 8
- 2021Adaptive Perturbation for Adversarial Attackcited by 7
50 most cited of 135 All 135 (JSON)
- 2026Let the Carrier Carry the Attack: Preserving the Subject in Adversarial Image Generation30 Sep 2026
- 2026Discovering Natural Transformation Vulnerabilities in Black-Box Vision Models7 Sep 2026
- 2026DiffUE: Enhancing Utility-Unlearnability Trade-off of Unlearnable Examples via Diffusion Autoencoders12 Jul 2026
- 2026Generative Testing of Automated Speech Recognition Systems10 Jul 2026
- 2026Adversarially Guided Diffusion for LiDAR Range Image Synthesis8 Jul 2026
- 2026FoeGlass: Simple In-Context Learning Is Enough for Red Teaming Audio Deepfake Detectors3 Jun 2026
- 2026Latent Geometric Chords for Query-Efficient Decision-Based Adversarial Attacks29 May 2026
- 2026Generative Adversarial Perturbations with Cross-paradigm Transferability on Localized Crowd Counting25 Mar 2026
- 2026Latent Transfer Attack: Adversarial Examples via Generative Latent Spaces6 Mar 2026
- 2026Stochastic Neural Networks for Quantum Devices24 Feb 2026
- 2026Interactionless Inverse Reinforcement Learning: A Data-Centric Framework for Durable Alignment16 Feb 2026
- 2026Counterfactual Explanations on Robust Perceptual Geodesics26 Jan 2026
38 more
- 2025Worst-case generation via minimax optimization in Wasserstein space9 Dec 2025
- 2025DPAC: Distribution-Preserving Adversarial Control for Diffusion Sampling1 Dec 2025
- 2025Diffusion Guided Adversarial State Perturbations in Reinforcement Learning10 Nov 2025
- 2025Rethinking Inter-LoRA Orthogonality in Adapter Merging: Insights from Orthogonal Monte Carlo Dropout26 Sep 2025
- 2025PolyJuice Makes It Real: Black-Box, Universal Red Teaming for Synthetic Image Detectors19 Sep 2025
- 2025TAIGen: Training-Free Adversarial Image Generation via Diffusion Models20 Aug 2025
- 2025Evading Data Provenance in Deep Neural Networks1 Aug 2025
- 2025SCOOTER: A Human Evaluation Framework for Unrestricted Adversarial Examples10 Jul 2025
- 2025ScoreAdv: Score-based Targeted Generation of Natural Adversarial Examples via Diffusion Models8 Jul 2025
- 2025Concept-based Adversarial Attack: a Probabilistic Perspective30 Jun 2025
- 2025Boosting Generative Adversarial Transferability with Self-supervised Vision Transformer Features26 Jun 2025
- 2025Defensive Adversarial CAPTCHA: A Semantics-Driven Framework for Natural Adversarial Example Generation12 Jun 2025
- 2025NatADiff: Adversarial Boundary Guidance for Natural Adversarial Diffusion27 May 2025
- 2025Diffusion-based Adversarial Identity Manipulation for Facial Privacy Protection30 Apr 2025
- 2025SemDiff: Generating Natural Unrestricted Adversarial Examples via Semantic Attributes Optimization in Diffusion Models16 Apr 2025
- 2025Adversarial Wear and Tear: Exploiting Natural Damage for Generating Physical-World Adversarial Examples27 Mar 2025
- 2025AdvAD: Exploring Non-Parametric Diffusion for Imperceptible Adversarial Attacks12 Mar 2025
- 2025Gradient-Free Adversarial Purification with Diffusion Models23 Jan 2025
- 2024Prompt2Perturb (P2P): Text-Guided Diffusion-Based Adversarial Attacks on Breast Ultrasound Images13 Dec 2024
- 2024DynamicPAE: Generating Scene-Aware Physical Adversarial Examples in Real-Time11 Dec 2024
- 2024Low-Rank Adversarial PGD Attack16 Oct 2024
- 2024SCA: Improve Semantic Consistent in Unrestricted Adversarial Attacks via DDPM Inversion3 Oct 2024
- 2024Deep generative models as an adversarial attack strategy for tabular machine learning19 Sep 2024
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors20 Aug 2024
- 2024Transferable Adversarial Facial Images for Privacy Protection18 Jul 2024
- 2024Adversarial Examples: Generation Proposal in the Context of Facial Recognition Systems27 Apr 2024
- 2024Reliable Model Watermarking: Defending Against Theft without Compromising on Evasion21 Apr 2024
- 2024Efficient Generation of Targeted and Transferable Adversarial Examples for Vision-Language Models Via Diffusion Models16 Apr 2024
- 2024As Firm As Their Foundations: Can open-sourced foundation models be used to create adversarial examples for downstream tasks?19 Mar 2024
- 2024ObjectCompose: Evaluating Resilience of Vision-Based Models on Object-to-Background Compositional Changes7 Mar 2024
- 2024A Random Ensemble of Encrypted Vision Transformers for Adversarially Robust Defense11 Feb 2024
- 2024Breaking Free: How to Hack Safety Guardrails in Black-Box Diffusion Models!7 Feb 2024
- 2024Transcending Adversarial Perturbations: Manifold-Aided Adversarial Examples with Legitimate Semantics5 Feb 2024
- 2024Sparse and Transferable Universal Singular Vectors Attack25 Jan 2024
- 2024Reinforcement Learning from LLM Feedback to Counteract Goal Misgeneralization14 Jan 2024
- 2023Where and How to Attack? A Causality-Inspired Recipe for Generating Counterfactual Adversarial Examples21 Dec 2023
- 2023ScAR: Scaling Adversarial Robustness for LiDAR Object Detection5 Dec 2023
- 2023Efficient Key-Based Adversarial Defense for ImageNet by Using Pre-trained Model28 Nov 2023
50 newest of 135 All 135 (JSON)
- 2023Diffusion Models for Imperceptible and Transferable Adversarial Attackcited by 94
- 2023AdvDiff: Generating Unrestricted Adversarial Examples using Diffusion Modelscited by 46
- 2023Semantic Adversarial Attacks via Diffusion Modelscited by 12
- 2023SD-NAE: Generating Natural Adversarial Examples with Stable Diffusioncited by 5
- 2024Prompt2Perturb (P2P): Text-Guided Diffusion-Based Adversarial Attacks on Breast Ultrasound Imagescited by 4
- 2024SCA: Improve Semantic Consistent in Unrestricted Adversarial Attacks via DDPM Inversioncited by 3
- 2025SemDiff: Generating Natural Unrestricted Adversarial Examples via Semantic Attributes Optimization in Diffusion Modelscited by 3
- 2025ScoreAdv: Score-based Targeted Generation of Natural Adversarial Examples via Diffusion Modelscited by 3
- 2025TAIGen: Training-Free Adversarial Image Generation via Diffusion Modelscited by 2
- 2025Gradient-Free Adversarial Purification with Diffusion Modelscited by 1
- 2024Breaking Free: How to Hack Safety Guardrails in Black-Box Diffusion Models!cited by 0
- 2025DPAC: Distribution-Preserving Adversarial Control for Diffusion Samplingcited by 0
- 2025DPAC: Distribution-Preserving Adversarial Control for Diffusion Sampling1 Dec 2025
- 2025TAIGen: Training-Free Adversarial Image Generation via Diffusion Models20 Aug 2025
- 2025ScoreAdv: Score-based Targeted Generation of Natural Adversarial Examples via Diffusion Models8 Jul 2025
- 2025SemDiff: Generating Natural Unrestricted Adversarial Examples via Semantic Attributes Optimization in Diffusion Models16 Apr 2025
- 2025Gradient-Free Adversarial Purification with Diffusion Models23 Jan 2025
- 2024Prompt2Perturb (P2P): Text-Guided Diffusion-Based Adversarial Attacks on Breast Ultrasound Images13 Dec 2024
- 2024SCA: Improve Semantic Consistent in Unrestricted Adversarial Attacks via DDPM Inversion3 Oct 2024
- 2024Breaking Free: How to Hack Safety Guardrails in Black-Box Diffusion Models!7 Feb 2024
- 2023SD-NAE: Generating Natural Adversarial Examples with Stable Diffusion21 Nov 2023
- 2023Semantic Adversarial Attacks via Diffusion Models14 Sep 2023
- 2023AdvDiff: Generating Unrestricted Adversarial Examples using Diffusion Models24 Jul 2023
- 2023Diffusion Models for Imperceptible and Transferable Adversarial Attack14 May 2023
- 2024Reliable Model Watermarking: Defending Against Theft without Compromising on Evasioncited by 9
- 2025PolyJuice Makes It Real: Black-Box, Universal Red Teaming for Synthetic Image Detectorscited by 1
- 2026FoeGlass: Simple In-Context Learning Is Enough for Red Teaming Audio Deepfake Detectorscited by 0
- 2026FoeGlass: Simple In-Context Learning Is Enough for Red Teaming Audio Deepfake Detectors3 Jun 2026
- 2025PolyJuice Makes It Real: Black-Box, Universal Red Teaming for Synthetic Image Detectors19 Sep 2025
- 2024Reliable Model Watermarking: Defending Against Theft without Compromising on Evasion21 Apr 2024
- 2022The Alignment Problem from a Deep Learning Perspectivecited by 258
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Improving Transferability of Adversarial Patches on Face Recognition with Generative Modelscited by 80
- 2022Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioningcited by 45
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2021Reveal of Vision Transformers Robustness against Adversarial Attackscited by 43
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 43
- 2022Natural Color Fool: Towards Boosting Black-box Unrestricted Attackscited by 38
- 2021A Little Robustness Goes a Long Way: Leveraging Robust Features for Targeted Transfer Attackscited by 34
- 2021Boosting Transferability of Targeted Adversarial Examples via Hierarchical Generative Networkscited by 32
- 2022Perceptual Attacks of No-Reference Image Quality Models with Human-in-the-Loopcited by 30
- 2022Diffeomorphic Counterfactuals with Generative Modelscited by 29
12 most cited of 114 All 114 (JSON)
- 2026Let the Carrier Carry the Attack: Preserving the Subject in Adversarial Image Generation30 Sep 2026
- 2026Discovering Natural Transformation Vulnerabilities in Black-Box Vision Models7 Sep 2026
- 2026DiffUE: Enhancing Utility-Unlearnability Trade-off of Unlearnable Examples via Diffusion Autoencoders12 Jul 2026
- 2026Generative Testing of Automated Speech Recognition Systems10 Jul 2026
- 2026Latent Geometric Chords for Query-Efficient Decision-Based Adversarial Attacks29 May 2026
- 2026Generative Adversarial Perturbations with Cross-paradigm Transferability on Localized Crowd Counting25 Mar 2026
- 2026Latent Transfer Attack: Adversarial Examples via Generative Latent Spaces6 Mar 2026
- 2026Stochastic Neural Networks for Quantum Devices24 Feb 2026
- 2026Counterfactual Explanations on Robust Perceptual Geodesics26 Jan 2026
- 2025Worst-case generation via minimax optimization in Wasserstein space9 Dec 2025
- 2025Rethinking Inter-LoRA Orthogonality in Adapter Merging: Insights from Orthogonal Monte Carlo Dropout26 Sep 2025
- 2025Evading Data Provenance in Deep Neural Networks1 Aug 2025
12 newest of 114 All 114 (JSON)