Unrestricted Adversarial Examples via Semantic Manipulation
Not on the map. Why?
Abstract (arXiv)
Machine learning models, especially deep neural networks (DNNs), have been shown to be vulnerable against adversarial examples which are carefully crafted samples with a small magnitude of the perturbation. Such adversarial perturbations are usually restricted by bounding their Lp norm such that they are imperceptible, and thus many current defenses can exploit this property to reduce their adversarial impact. In this paper, we instead introduce "unrestricted" perturbations that manipulate semantically meaningful image-based visual descriptors - color and texture - in order to generate effective and photorealistic adversarial examples. We show that these semantically aware perturbations are effective against JPEG compression, feature squeezing and adversarially trained model. We also show that the proposed methods can effectively be applied to both image classification and image captioning tasks on complex datasets such as ImageNet and MSCOCO. In addition, we conduct comprehensive user studies to show that our generated semantic adversarial examples are photorealistic to humans despite large magnitude perturbations when compared to other attacks.
Key facts. Cited by 84 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 18; 2023: 18; 2024: 12; 2025: 9; 2026: 3.
84 papers.
Sort:
By area:
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2023Diffusion Models for Imperceptible and Transferable Adversarial Attackcited by 93
- 2023Content-based Unrestricted Adversarial Attackcited by 73
- 2022Adversarial Style Augmentation for Domain Generalized Urban-Scene Segmentationcited by 69
- 2021SmoothMix: Training Confidence-calibrated Smoothed Classifiers for Certified Robustnesscited by 49
- 2021Exploring Adversarial Robustness of Multi-Sensor Perception Systems in Self Drivingcited by 45
- 2021Optical Adversarial Attackcited by 43
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 42
- 2021On the Certified Robustness for Ensemble Models and Beyondcited by 40
- 2022Natural Color Fool: Towards Boosting Black-box Unrestricted Attackscited by 38
- 2021TnT Attacks! Universal Naturalistic Adversarial Patches Against Deep Neural Network Systemscited by 36
- 2021AdvHaze: Adversarial Haze Attackcited by 31
38 more
- 2021AVA: Adversarial Vignetting Attack against Visual Recognitioncited by 29
- 2021Robust Feature-Level Adversaries are Interpretability Toolscited by 27
- 2022Towards Compositional Adversarial Robustness: Generalizing Adversarial Training to Composite Semantic Perturbationscited by 26
- 2024Transferable Adversarial Facial Images for Privacy Protectioncited by 26
- 2021Knowledge Enhanced Machine Learning Pipeline against Diverse Adversarial Attackscited by 24
- 2021Unrestricted Adversarial Attacks on ImageNet Competitioncited by 23
- 2021Robustness and Generalization via Generative Adversarial Trainingcited by 20
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2022StyleFool: Fooling Video Classification Systems via Style Transfercited by 18
- 2022Unrestricted Black-box Adversarial Attack Using GAN with Limited Queriescited by 18
- 2021Adversarial Relighting Against Face Recognitioncited by 16
- 2023Instruct2Attack: Language-Guided Semantic Adversarial Attackscited by 16
- 2023AdvST: Revisiting Data Augmentations for Single Domain Generalizationcited by 16
- 2022Towards Good Practices in Evaluating Transfer Adversarial Attackscited by 14
- 2022Towards Transferable Unrestricted Adversarial Examples with Minimum Changescited by 13
- 2022GAMA: Generative Adversarial Multi-Object Scene Attackscited by 13
- 2023Semantic Adversarial Attacks via Diffusion Modelscited by 12
- 2024Verification of Neural Networks' Global Robustnesscited by 10
- 2023Attacking Perceptual Similarity Metricscited by 8
- 2021Imperceptible Adversarial Examples by Spatial Chroma-Shiftcited by 7
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priorscited by 7
- 2022How Robust are Discriminatively Trained Zero-Shot Learning Models?cited by 6
- 2023Provable Unrestricted Adversarial Training without Compromise with Generalizabilitycited by 6
- 2021Adversarial Examples Detection beyond Image Spacecited by 5
- 2021Generating Unrestricted Adversarial Examples via Three Parameterscited by 5
- 2022Scale-free and Task-agnostic Attack: Generating Photo-realistic Adversarial Patterns with Patch Quilting Generatorcited by 5
- 2024Guardians of Image Quality: Benchmarking Defenses Against Adversarial Attacks on Image Quality Metricscited by 5
- 2024Ask, Attend, Attack: A Effective Decision-Based Black-Box Targeted Attack for Image-to-Text Modelscited by 5
- 2025Diffusion-based Adversarial Identity Manipulation for Facial Privacy Protectioncited by 5
- 2025NatADiff: Adversarial Boundary Guidance for Natural Adversarial Diffusioncited by 5
- 2021Effective Universal Unrestricted Adversarial Attacks using a MOE Approachcited by 4
- 2021Patch Shortcuts: Interpretable Proxy Models Efficiently Find Black-Box Vulnerabilitiescited by 4
- 2021Natural & Adversarial Bokeh Rendering via Circle-of-Confusion Predictive Networkcited by 4
- 2022Boosting Robustness Verification of Semantic Feature Neighborhoodscited by 4
- 2021Fashion-Guided Adversarial Attack on Person Segmentationcited by 3
- 2023Constructing Semantics-Aware Adversarial Examples with a Probabilistic Perspectivecited by 3
- 2023Where and How to Attack? A Causality-Inspired Recipe for Generating Counterfactual Adversarial Examplescited by 3
- 2024ReToMe-VA: Recursive Token Merging for Video Diffusion-based Unrestricted Adversarial Attackcited by 3
50 most cited of 84 All 84 (JSON)
- 2026Does Target Alignment Mean Target Recovery? An Evidence-Ladder Study of Adversarial Claims on Contrastive Encoders8 Oct 2026
- 2026TaFD: Threat-Aware Frequency Decoupling for Adversarial Robustness against Heterogeneous Attacks16 Jun 2026
- 2026FoeGlass: Simple In-Context Learning Is Enough for Red Teaming Audio Deepfake Detectors3 Jun 2026
- 2025SCOOTER: A Human Evaluation Framework for Unrestricted Adversarial Examples10 Jul 2025
- 2025ScoreAdv: Score-based Targeted Generation of Natural Adversarial Examples via Diffusion Models8 Jul 2025
- 2025Concept-based Adversarial Attack: a Probabilistic Perspective30 Jun 2025
- 2025Defensive Adversarial CAPTCHA: A Semantics-Driven Framework for Natural Adversarial Example Generation12 Jun 2025
- 2025Enhancing Diffusion-based Unrestricted Adversarial Attacks via Adversary Preferences Alignment2 Jun 2025
- 2025NatADiff: Adversarial Boundary Guidance for Natural Adversarial Diffusion27 May 2025
- 2025TRAIL: Transferable Robust Adversarial Images via Latent diffusion22 May 2025
- 2025Diffusion-based Adversarial Identity Manipulation for Facial Privacy Protection30 Apr 2025
- 2025Defending Against Frequency-Based Attacks with Diffusion Models15 Apr 2025
38 more
- 2024Attacks on multimodal models2 Dec 2024
- 2024Exploring adversarial robustness of JPEG AI: methodology, comparison and new methods18 Nov 2024
- 2024SCA: Improve Semantic Consistent in Unrestricted Adversarial Attacks via DDPM Inversion3 Oct 2024
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors20 Aug 2024
- 2024Ask, Attend, Attack: A Effective Decision-Based Black-Box Targeted Attack for Image-to-Text Models16 Aug 2024
- 2024ReToMe-VA: Recursive Token Merging for Video Diffusion-based Unrestricted Adversarial Attack10 Aug 2024
- 2024Guardians of Image Quality: Benchmarking Defenses Against Adversarial Attacks on Image Quality Metrics2 Aug 2024
- 2024Resilience and Security of Deep Neural Networks Against Intentional and Unintentional Perturbations: Survey and Research Challenges31 Jul 2024
- 2024Transferable Adversarial Facial Images for Privacy Protection18 Jul 2024
- 2024Rethinking the Threat and Accessibility of Adversarial Attacks against Face Recognition Systems11 Jul 2024
- 2024Investigating the Semantic Robustness of CLIP-based Zero-Shot Anomaly Segmentation13 May 2024
- 2024Verification of Neural Networks' Global Robustness29 Feb 2024
- 2023Where and How to Attack? A Causality-Inspired Recipe for Generating Counterfactual Adversarial Examples21 Dec 2023
- 2023AdvST: Revisiting Data Augmentations for Single Domain Generalization20 Dec 2023
- 2023RetouchUAA: Unconstrained Adversarial Attack via Image Retouching27 Nov 2023
- 2023Instruct2Attack: Language-Guided Semantic Adversarial Attacks27 Nov 2023
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks1 Oct 2023
- 2023Black-box Attacks on Image Activity Prediction and its Natural Language Explanations30 Sep 2023
- 2023Understanding Pose and Appearance Disentanglement in 3D Human Pose Estimation20 Sep 2023
- 2023Semantic Adversarial Attacks via Diffusion Models14 Sep 2023
- 2023Multi-objective Evolutionary Search of Variable-length Composite Semantic Perturbations13 Jul 2023
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Search16 Jun 2023
- 2023Frequency-Based Vulnerability Analysis of Deep Learning Models against Image Corruptions12 Jun 2023
- 2023Constructing Semantics-Aware Adversarial Examples with a Probabilistic Perspective1 Jun 2023
- 2023Content-based Unrestricted Adversarial Attack18 May 2023
- 2023Attacking Perceptual Similarity Metrics15 May 2023
- 2023Diffusion Models for Imperceptible and Transferable Adversarial Attack14 May 2023
- 2023Efficient Search of Comprehensively Robust Neural Architectures via Multi-fidelity Evaluation12 May 2023
- 2023Testing the Channels of Convolutional Neural Networks6 Mar 2023
- 2023Provable Unrestricted Adversarial Training without Compromise with Generalizability22 Jan 2023
- 2022Assessing Neural Network Robustness via Adversarial Pivotal Tuning17 Nov 2022
- 2022Towards Good Practices in Evaluating Transfer Adversarial Attacks17 Nov 2022
- 2022Natural Color Fool: Towards Boosting Black-box Unrestricted Attacks5 Oct 2022
- 2022Automatic satellite building construction monitoring29 Sep 2022
- 2022GAMA: Generative Adversarial Multi-Object Scene Attacks20 Sep 2022
- 2022Boosting Robustness Verification of Semantic Feature Neighborhoods12 Sep 2022
- 2022Unrestricted Adversarial Samples Based on Non-semantic Feature Clusters Substitution31 Aug 2022
- 2022Unrestricted Black-box Adversarial Attack Using GAN with Limited Queries24 Aug 2022
50 newest of 84 All 84 (JSON)
- 2023Diffusion Models for Imperceptible and Transferable Adversarial Attackcited by 93
- 2023Semantic Adversarial Attacks via Diffusion Modelscited by 12
- 2024ReToMe-VA: Recursive Token Merging for Video Diffusion-based Unrestricted Adversarial Attackcited by 3
- 2025Enhancing Diffusion-based Unrestricted Adversarial Attacks via Adversary Preferences Alignmentcited by 3
- 2025ScoreAdv: Score-based Targeted Generation of Natural Adversarial Examples via Diffusion Modelscited by 3
- 2024SCA: Improve Semantic Consistent in Unrestricted Adversarial Attacks via DDPM Inversioncited by 2
- 2025Defending Against Frequency-Based Attacks with Diffusion Modelscited by 1
- 2025TRAIL: Transferable Robust Adversarial Images via Latent diffusioncited by 0
- 2025ScoreAdv: Score-based Targeted Generation of Natural Adversarial Examples via Diffusion Models8 Jul 2025
- 2025Enhancing Diffusion-based Unrestricted Adversarial Attacks via Adversary Preferences Alignment2 Jun 2025
- 2025TRAIL: Transferable Robust Adversarial Images via Latent diffusion22 May 2025
- 2025Defending Against Frequency-Based Attacks with Diffusion Models15 Apr 2025
- 2024SCA: Improve Semantic Consistent in Unrestricted Adversarial Attacks via DDPM Inversion3 Oct 2024
- 2024ReToMe-VA: Recursive Token Merging for Video Diffusion-based Unrestricted Adversarial Attack10 Aug 2024
- 2023Semantic Adversarial Attacks via Diffusion Models14 Sep 2023
- 2023Diffusion Models for Imperceptible and Transferable Adversarial Attack14 May 2023
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2023Content-based Unrestricted Adversarial Attackcited by 73
- 2022Adversarial Style Augmentation for Domain Generalized Urban-Scene Segmentationcited by 69
- 2021SmoothMix: Training Confidence-calibrated Smoothed Classifiers for Certified Robustnesscited by 49
- 2021Exploring Adversarial Robustness of Multi-Sensor Perception Systems in Self Drivingcited by 45
- 2021Optical Adversarial Attackcited by 43
- 2023CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Searchcited by 42
- 2021On the Certified Robustness for Ensemble Models and Beyondcited by 40
- 2022Natural Color Fool: Towards Boosting Black-box Unrestricted Attackscited by 38
- 2021TnT Attacks! Universal Naturalistic Adversarial Patches Against Deep Neural Network Systemscited by 36
- 2021AdvHaze: Adversarial Haze Attackcited by 31
- 2021AVA: Adversarial Vignetting Attack against Visual Recognitioncited by 29
12 most cited of 75 All 75 (JSON)
- 2026Does Target Alignment Mean Target Recovery? An Evidence-Ladder Study of Adversarial Claims on Contrastive Encoders8 Oct 2026
- 2026TaFD: Threat-Aware Frequency Decoupling for Adversarial Robustness against Heterogeneous Attacks16 Jun 2026
- 2025SCOOTER: A Human Evaluation Framework for Unrestricted Adversarial Examples10 Jul 2025
- 2025Concept-based Adversarial Attack: a Probabilistic Perspective30 Jun 2025
- 2025Defensive Adversarial CAPTCHA: A Semantics-Driven Framework for Natural Adversarial Example Generation12 Jun 2025
- 2025NatADiff: Adversarial Boundary Guidance for Natural Adversarial Diffusion27 May 2025
- 2025Diffusion-based Adversarial Identity Manipulation for Facial Privacy Protection30 Apr 2025
- 2024Attacks on multimodal models2 Dec 2024
- 2024Exploring adversarial robustness of JPEG AI: methodology, comparison and new methods18 Nov 2024
- 2024Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors20 Aug 2024
- 2024Ask, Attend, Attack: A Effective Decision-Based Black-Box Targeted Attack for Image-to-Text Models16 Aug 2024
- 2024Guardians of Image Quality: Benchmarking Defenses Against Adversarial Attacks on Image Quality Metrics2 Aug 2024
12 newest of 75 All 75 (JSON)