ColorFool: Semantic Adversarial Colorization
Not on the map. Why?
Abstract (arXiv)
Adversarial attacks that generate small L_p-norm perturbations to mislead classifiers have limited success in black-box settings and with unseen classifiers. These attacks are also not robust to defenses that use denoising filters and to adversarial training procedures. Instead, adversarial attacks that generate unrestricted perturbations are more robust to defenses, are generally more successful in black-box settings and are more transferable to unseen classifiers. However, unrestricted perturbations may be noticeable to humans. In this paper, we propose a content-based black-box adversarial attack that generates unrestricted perturbations by exploiting image semantics to selectively modify colors within chosen ranges that are perceived as natural by humans. We show that the proposed approach, ColorFool, outperforms in terms of success rate, robustness to defense frameworks and transferability, five state-of-the-art adversarial attacks on two different tasks, scene and object classification, when attacking three state-of-the-art deep neural networks using three standard datasets. The source code is available at https://github.com/smartcameras/ColorFool.
Key facts. Cited by 89 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 19; 2023: 18; 2024: 20; 2025: 11; 2026: 3.
89 papers.
Sort:
By area:
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Adversarial Laser Beam: Effective Physical-World Attack to DNNs in a Blinkcited by 75
- 2023Content-based Unrestricted Adversarial Attackcited by 73
- 2021AdvDrop: Adversarial Attack to DNNs by Dropping Informationcited by 56
- 2022Natural Color Fool: Towards Boosting Black-box Unrestricted Attackscited by 38
- 2024Efficient Generation of Targeted and Transferable Adversarial Examples for Vision-Language Models Via Diffusion Modelscited by 38
- 2021GRNN: Generative Regression Neural Network -- A Data Leakage Attack for Federated Learningcited by 36
- 2022Towards Compositional Adversarial Robustness: Generalizing Adversarial Training to Composite Semantic Perturbationscited by 26
- 2022Restricted Black-box Adversarial Attack Against DeepFake Face Swappingcited by 25
- 2021Unrestricted Adversarial Attacks on ImageNet Competitioncited by 23
- 2022Enhance the Visual Representation via Discrete Adversarial Trainingcited by 23
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 23
38 more
- 2022StyleFool: Fooling Video Classification Systems via Style Transfercited by 20
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2021Demiguise Attack: Crafting Invisible Semantic Adversarial Perturbations with Perceptual Similaritycited by 18
- 2021Back in Black: A Comparative Evaluation of Recent State-Of-The-Art Black-Box Attackscited by 16
- 2022Towards Good Practices in Evaluating Transfer Adversarial Attackscited by 15
- 2022Towards Transferable Unrestricted Adversarial Examples with Minimum Changescited by 13
- 2023Semantic Adversarial Attacks via Diffusion Modelscited by 12
- 2024ASAM: Boosting Segment Anything Model with Adversarial Tuningcited by 12
- 2022ALA: Naturalness-aware Adversarial Lightness Attackcited by 11
- 2022Adversarial Laser Spot: Robust and Covert Physical-World Attack to DNNscited by 11
- 2022Adversarial Color Film: Effective Physical-World Attack to DNNscited by 11
- 2023Adversarial Infrared Blocks: A Multi-view Black-box Attack to Thermal Infrared Detectors in Physical Worldcited by 11
- 2023Attacking Perceptual Similarity Metricscited by 10
- 2023Distilling Out-of-Distribution Robustness from Vision-Language Foundation Modelscited by 9
- 2024Imperceptible Protection against Style Imitation from Diffusion Modelscited by 9
- 2021Semantically Stealthy Adversarial Attacks against Segmentation Modelscited by 7
- 2021Imperceptible Adversarial Examples by Spatial Chroma-Shiftcited by 7
- 2024A Survey and Evaluation of Adversarial Attacks for Object Detectioncited by 7
- 2024Nearly Zero-Cost Protection Against Mimicry by Personalized Diffusion Modelscited by 7
- 2021Selection of Source Images Heavily Influences the Effectiveness of Adversarial Attackscited by 6
- 2022Adversarial Neon Beam: A Light-based Physical Attack to DNNscited by 6
- 2023Provable Unrestricted Adversarial Training without Compromise with Generalizabilitycited by 6
- 2022Scale-free and Task-agnostic Attack: Generating Photo-realistic Adversarial Patterns with Patch Quilting Generatorcited by 5
- 2021Effective Universal Unrestricted Adversarial Attacks using a MOE Approachcited by 4
- 2021Natural & Adversarial Bokeh Rendering via Circle-of-Confusion Predictive Networkcited by 4
- 2022Adversarial Zoom Lens: A Novel Physical-World Attack to DNNscited by 4
- 2023Constructing Semantics-Aware Adversarial Examples with a Probabilistic Perspectivecited by 4
- 2024Transcending Adversarial Perturbations: Manifold-Aided Adversarial Examples with Legitimate Semanticscited by 4
- 2021Fashion-Guided Adversarial Attack on Person Segmentationcited by 3
- 2021In-distribution adversarial attacks on object recognition models using gradient-free searchcited by 3
- 2021Improving Visual Quality of Unrestricted Adversarial Examples with Wavelet-VAEcited by 3
- 2021Evaluating Adversarial Attacks on ImageNet: A Reality Check on Misclassification Classescited by 3
- 2021Amicable Aid: Perturbing Images to Improve Classification Performancecited by 3
- 2023Turn Fake into Real: Adversarial Head Turn Attacks Against Deepfake Detectioncited by 3
- 2024Benchmarking Out-of-Distribution Generalization Capabilities of DNN-based Encoding Models for the Ventral Visual Cortexcited by 3
- 2024ReToMe-VA: Recursive Token Merging for Video Diffusion-based Unrestricted Adversarial Attackcited by 3
- 2024SCA: Improve Semantic Consistent in Unrestricted Adversarial Attacks via DDPM Inversioncited by 3
- 2025Enhancing Diffusion-based Unrestricted Adversarial Attacks via Adversary Preferences Alignmentcited by 3
50 most cited of 89 All 89 (JSON)
- 2026Discovering Natural Transformation Vulnerabilities in Black-Box Vision Models7 Sep 2026
- 2026TaFD: Threat-Aware Frequency Decoupling for Adversarial Robustness against Heterogeneous Attacks16 Jun 2026
- 2026Interactionless Inverse Reinforcement Learning: A Data-Centric Framework for Durable Alignment16 Feb 2026
- 2025Generating Risky Samples with Conformity Constraints via Diffusion Models21 Dec 2025
- 2025TAIGen: Training-Free Adversarial Image Generation via Diffusion Models20 Aug 2025
- 2025Adversarial-Guided Diffusion for Multimodal LLM Attacks31 Jul 2025
- 2025SCOOTER: A Human Evaluation Framework for Unrestricted Adversarial Examples10 Jul 2025
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimation9 Jul 2025
- 2025Concept-based Adversarial Attack: a Probabilistic Perspective30 Jun 2025
- 2025Defensive Adversarial CAPTCHA: A Semantics-Driven Framework for Natural Adversarial Example Generation12 Jun 2025
- 2025Enhancing Diffusion-based Unrestricted Adversarial Attacks via Adversary Preferences Alignment2 Jun 2025
- 2025Light as Deception: GPT-driven Natural Relighting Against Vision-Language Pre-training Models30 May 2025
38 more
- 2025TRAIL: Transferable Robust Adversarial Images via Latent diffusion22 May 2025
- 2025Defending Against Frequency-Based Attacks with Diffusion Models15 Apr 2025
- 2024Nearly Zero-Cost Protection Against Mimicry by Personalized Diffusion Models16 Dec 2024
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2024Attr-Int: A Simple and Effective Entity Alignment Framework for Heterogeneous Knowledge Graphs17 Oct 2024
- 2024Towards General Deepfake Detection with Dynamic Curriculum15 Oct 2024
- 2024SCA: Improve Semantic Consistent in Unrestricted Adversarial Attacks via DDPM Inversion3 Oct 2024
- 2024Strategic Arms with Side Communication Prevail Over Low-Regret MAB Algorithms30 Aug 2024
- 2024ReToMe-VA: Recursive Token Merging for Video Diffusion-based Unrestricted Adversarial Attack10 Aug 2024
- 2024A Survey and Evaluation of Adversarial Attacks for Object Detection4 Aug 2024
- 2024Resilience and Security of Deep Neural Networks Against Intentional and Unintentional Perturbations: Survey and Research Challenges31 Jul 2024
- 2024Rethinking the Threat and Accessibility of Adversarial Attacks against Face Recognition Systems11 Jul 2024
- 2024Benchmarking Out-of-Distribution Generalization Capabilities of DNN-based Encoding Models for the Ventral Visual Cortex16 Jun 2024
- 2024ASAM: Boosting Segment Anything Model with Adversarial Tuning1 May 2024
- 2024How Real Is Real? A Human Evaluation Framework for Unrestricted Adversarial Examples19 Apr 2024
- 2024Efficient Generation of Targeted and Transferable Adversarial Examples for Vision-Language Models Via Diffusion Models16 Apr 2024
- 2024Imperceptible Protection against Style Imitation from Diffusion Models28 Mar 2024
- 2024T-Pixel2Mesh: Combining Global and Local Transformer for 3D Mesh Generation from a Single Image20 Mar 2024
- 2024Breaking Free: How to Hack Safety Guardrails in Black-Box Diffusion Models!7 Feb 2024
- 2024Transcending Adversarial Perturbations: Manifold-Aided Adversarial Examples with Legitimate Semantics5 Feb 2024
- 2024TEN-GUARD: Tensor Decomposition for Backdoor Attack Detection in Deep Neural Networks6 Jan 2024
- 2024TRLS: A Time Series Representation Learning Framework via Spectrogram for Medical Signal Processing6 Jan 2024
- 2023DarkShot: Lighting Dark Images with Low-Compute and High-Quality28 Dec 2023
- 2023Self-supervised Adaptive Pre-training of Multilingual Speech Models for Language and Dialect Identification12 Dec 2023
- 2023Adversarial Camera Patch: An Effective and Robust Physical-World Attack on Object Detectors11 Dec 2023
- 2023RetouchUAA: Unconstrained Adversarial Attack via Image Retouching27 Nov 2023
- 2023GMTR: Graph Matching Transformers14 Nov 2023
- 2023Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models2 Nov 2023
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks1 Oct 2023
- 2023Black-box Attacks on Image Activity Prediction and its Natural Language Explanations30 Sep 2023
- 2023Enhancing Multilingual Speech Recognition through Language Prompt Tuning and Frame-Level Language Adapter18 Sep 2023
- 2023Semantic Adversarial Attacks via Diffusion Models14 Sep 2023
- 2023Turn Fake into Real: Adversarial Head Turn Attacks Against Deepfake Detection3 Sep 2023
- 2023Multi-objective Evolutionary Search of Variable-length Composite Semantic Perturbations13 Jul 2023
- 2023Constructing Semantics-Aware Adversarial Examples with a Probabilistic Perspective1 Jun 2023
- 2023Content-based Unrestricted Adversarial Attack18 May 2023
- 2023Attacking Perceptual Similarity Metrics15 May 2023
- 2023Adversarial Infrared Blocks: A Multi-view Black-box Attack to Thermal Infrared Detectors in Physical World21 Apr 2023
50 newest of 89 All 89 (JSON)
- 2023Semantic Adversarial Attacks via Diffusion Modelscited by 12
- 2024Imperceptible Protection against Style Imitation from Diffusion Modelscited by 9
- 2024Nearly Zero-Cost Protection Against Mimicry by Personalized Diffusion Modelscited by 7
- 2024ReToMe-VA: Recursive Token Merging for Video Diffusion-based Unrestricted Adversarial Attackcited by 3
- 2024SCA: Improve Semantic Consistent in Unrestricted Adversarial Attacks via DDPM Inversioncited by 3
- 2025Enhancing Diffusion-based Unrestricted Adversarial Attacks via Adversary Preferences Alignmentcited by 3
- 2025Adversarial-Guided Diffusion for Multimodal LLM Attackscited by 3
- 2025TAIGen: Training-Free Adversarial Image Generation via Diffusion Modelscited by 2
- 2025Defending Against Frequency-Based Attacks with Diffusion Modelscited by 1
- 2024Breaking Free: How to Hack Safety Guardrails in Black-Box Diffusion Models!cited by 0
- 2025TRAIL: Transferable Robust Adversarial Images via Latent diffusioncited by 0
- 2025Generating Risky Samples with Conformity Constraints via Diffusion Modelscited by 0
- 2025Generating Risky Samples with Conformity Constraints via Diffusion Models21 Dec 2025
- 2025TAIGen: Training-Free Adversarial Image Generation via Diffusion Models20 Aug 2025
- 2025Adversarial-Guided Diffusion for Multimodal LLM Attacks31 Jul 2025
- 2025Enhancing Diffusion-based Unrestricted Adversarial Attacks via Adversary Preferences Alignment2 Jun 2025
- 2025TRAIL: Transferable Robust Adversarial Images via Latent diffusion22 May 2025
- 2025Defending Against Frequency-Based Attacks with Diffusion Models15 Apr 2025
- 2024Nearly Zero-Cost Protection Against Mimicry by Personalized Diffusion Models16 Dec 2024
- 2024SCA: Improve Semantic Consistent in Unrestricted Adversarial Attacks via DDPM Inversion3 Oct 2024
- 2024ReToMe-VA: Recursive Token Merging for Video Diffusion-based Unrestricted Adversarial Attack10 Aug 2024
- 2024Imperceptible Protection against Style Imitation from Diffusion Models28 Mar 2024
- 2024Breaking Free: How to Hack Safety Guardrails in Black-Box Diffusion Models!7 Feb 2024
- 2023Semantic Adversarial Attacks via Diffusion Models14 Sep 2023
- 2024Efficient Generation of Targeted and Transferable Adversarial Examples for Vision-Language Models Via Diffusion Modelscited by 38
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Surveycited by 23
- 2023Distilling Out-of-Distribution Robustness from Vision-Language Foundation Modelscited by 9
- 2025Light as Deception: GPT-driven Natural Relighting Against Vision-Language Pre-training Modelscited by 1
- 2025Light as Deception: GPT-driven Natural Relighting Against Vision-Language Pre-training Models30 May 2025
- 2024Adversarial Attacks of Vision Tasks in the Past 10 Years: A Survey31 Oct 2024
- 2024Efficient Generation of Targeted and Transferable Adversarial Examples for Vision-Language Models Via Diffusion Models16 Apr 2024
- 2023Distilling Out-of-Distribution Robustness from Vision-Language Foundation Models2 Nov 2023
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Adversarial Laser Beam: Effective Physical-World Attack to DNNs in a Blinkcited by 75
- 2023Content-based Unrestricted Adversarial Attackcited by 73
- 2021AdvDrop: Adversarial Attack to DNNs by Dropping Informationcited by 56
- 2022Natural Color Fool: Towards Boosting Black-box Unrestricted Attackscited by 38
- 2021GRNN: Generative Regression Neural Network -- A Data Leakage Attack for Federated Learningcited by 36
- 2022Towards Compositional Adversarial Robustness: Generalizing Adversarial Training to Composite Semantic Perturbationscited by 26
- 2022Restricted Black-box Adversarial Attack Against DeepFake Face Swappingcited by 25
- 2021Unrestricted Adversarial Attacks on ImageNet Competitioncited by 23
- 2022Enhance the Visual Representation via Discrete Adversarial Trainingcited by 23
- 2022StyleFool: Fooling Video Classification Systems via Style Transfercited by 20
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
12 most cited of 72 All 72 (JSON)
- 2026Discovering Natural Transformation Vulnerabilities in Black-Box Vision Models7 Sep 2026
- 2026TaFD: Threat-Aware Frequency Decoupling for Adversarial Robustness against Heterogeneous Attacks16 Jun 2026
- 2025SCOOTER: A Human Evaluation Framework for Unrestricted Adversarial Examples10 Jul 2025
- 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimation9 Jul 2025
- 2025Concept-based Adversarial Attack: a Probabilistic Perspective30 Jun 2025
- 2025Defensive Adversarial CAPTCHA: A Semantics-Driven Framework for Natural Adversarial Example Generation12 Jun 2025
- 2024Attr-Int: A Simple and Effective Entity Alignment Framework for Heterogeneous Knowledge Graphs17 Oct 2024
- 2024Towards General Deepfake Detection with Dynamic Curriculum15 Oct 2024
- 2024Strategic Arms with Side Communication Prevail Over Low-Regret MAB Algorithms30 Aug 2024
- 2024A Survey and Evaluation of Adversarial Attacks for Object Detection4 Aug 2024
- 2024Resilience and Security of Deep Neural Networks Against Intentional and Unintentional Perturbations: Survey and Research Challenges31 Jul 2024
- 2024Rethinking the Threat and Accessibility of Adversarial Attacks against Face Recognition Systems11 Jul 2024
12 newest of 72 All 72 (JSON)