Adversarial Manipulation of Deep Representations
Not on the map. Why?
Abstract (arXiv)
We show that the representation of an image in a deep neural network (DNN) can be manipulated to mimic those of other natural images, with only minor, imperceptible perturbations to the original image. Previous methods for generating adversarial images focused on image perturbations designed to produce erroneous class labels, while we concentrate on the internal layers of DNN representations. In this way our new class of adversarial images differs qualitatively from others. While the adversary is perceptually similar to one image, its internal representation appears remarkably similar to a different image, one from a different class, bearing little if any apparent similarity to the input; they appear generic and consistent with the space of natural images. This phenomenon raises questions about DNN representations, as well as the properties of natural images themselves.
Key facts. Cited by 56 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 14; 2023: 16; 2024: 5; 2025: 2; 2026: 4.
56 papers.
Sort:
By area:
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 205
- 2023Robust Classification via a Single Diffusion Modelcited by 79
- 2022Frequency-driven Imperceptible Adversarial Attack on Semantic Similaritycited by 77
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 52
- 2022A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologiescited by 44
- 2021Optical Adversarial Attackcited by 43
- 2023Don't trust your eyes: on the (un)reliability of feature visualizationscited by 32
- 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesiscited by 23
- 2021Automated Discovery of Adaptive Attacks on Adversarial Defensescited by 22
- 2021Feature Space Targeted Attacks by Statistic Alignmentcited by 21
- 2023Improving the Accuracy-Robustness Trade-Off of Classifiers via Adaptive Smoothingcited by 18
- 2022Reverse Engineering of Imperceptible Adversarial Image Perturbationscited by 17
38 more
- 2024LLM Whisperer: An Inconspicuous Attack to Bias LLM Responsescited by 15
- 2022Adversarial Unlearning: Reducing Confidence Along Adversarial Directionscited by 14
- 2022Towards Lightweight Black-Box Attacks against Deep Neural Networkscited by 13
- 2021Staircase Sign Method for Boosting Adversarial Attackscited by 12
- 2022Increasing Confidence in Adversarial Robustness Evaluationscited by 12
- 2023MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustnesscited by 12
- 2023Dynamic Adversarial Attacks on Autonomous Driving Systemscited by 11
- 2023SoK: Realistic Adversarial Attacks and Defenses for Intelligent Network Intrusion Detectioncited by 10
- 2025AdLift: Lifting Adversarial Perturbations to Safeguard 3D Gaussian Splatting Assets Against Instruction-Driven Editingcited by 10
- 2022Adversarially Robust Learning with Tolerancecited by 9
- 2021What Do Deep Nets Learn? Class-wise Patterns Revealed in the Input Spacecited by 8
- 2021Adversarial Attack and Defense in Deep Rankingcited by 8
- 2021Performance Evaluation of Adversarial Attacks: Discrepancies and Solutionscited by 7
- 2023Splitting the Difference on Adversarial Trainingcited by 5
- 2023Segment (Almost) Nothing: Prompt-Agnostic Adversarial Attacks on Segmentation Modelscited by 5
- 2021SoK: A Modularized Approach to Study the Security of Automatic Speech Recognition Systemscited by 4
- 2021Exploiting Vulnerabilities in Deep Neural Networks: Adversarial and Fault-Injection Attackscited by 4
- 2021Exploring Transferable and Robust Adversarial Perturbation Generation from the Perspective of Network Hierarchycited by 4
- 2024Embodied Active Defense: Leveraging Recurrent Feedback to Counter Adversarial Patchescited by 4
- 2024Deep Learning Model Security: Threats and Defensescited by 4
- 2023Adversarial Medical Image with Hierarchical Feature Hidingcited by 3
- 2022Layer-wise Regularized Adversarial Training using Layers Sustainability Analysis (LSA) frameworkcited by 2
- 2022p-DkNN: Out-of-Distribution Detection Through Statistical Testing of Deep Representationscited by 2
- 2022Adversarial Detection: Attacking Object Detection in Real Timecited by 2
- 2023Exploring Geometry of Blind Spots in Vision Modelscited by 2
- 2021Delving into the pixels of adversarial samplescited by 1
- 2021On the Exploitability of Audio Machine Learning Pipelines to Surreptitious Adversarial Examplescited by 1
- 2021Medical Aegis: Robust adversarial protectors for medical imagescited by 1
- 2022Superclass Adversarial Attackcited by 1
- 2022An Overview and Prospective Outlook on Robust Training and Certification of Machine Learning Modelscited by 1
- 2023Group-based Robustness: A General Framework for Customized Robustness in the Real Worldcited by 1
- 2023A reading survey on adversarial machine learning: Adversarial attacks and their understandingcited by 1
- 2023RAIFLE: Reconstruction Attacks on Interaction-based Federated Learning with Adversarial Data Manipulationcited by 1
- 20242DSig-Detect: a semi-supervised framework for anomaly detection on image data using 2D-signaturescited by 1
- 2025Reinforced Embodied Active Defense: Exploiting Adaptive Interaction for Robust Visual Perception in Adversarial 3D Environmentscited by 1
- 2026Robustness of Vision Language Models Against Split-Image Harmful Input Attackscited by 1
- 2021Target Training Does Adversarial Training Without Adversarial Samplescited by 0
- 2022Exact Feature Collisions in Neural Networkscited by 0
50 most cited of 56 All 56 (JSON)
- 2026It Takes Little to Rewrite Perception: Targeted Semantic Substitution in Vision-Language Models at ε≤ 4/25529 Sep 2026
- 2026Attacking Graph Foundation Models Through Their Shared Representation20 Jul 2026
- 2026On Adversarial Vulnerability of Vision-Language Models through the Lens of Intermediate Spectral Subspaces8 Jul 2026
- 2026Robustness of Vision Language Models Against Split-Image Harmful Input Attacks8 Feb 2026
- 2025AdLift: Lifting Adversarial Perturbations to Safeguard 3D Gaussian Splatting Assets Against Instruction-Driven Editing8 Dec 2025
- 2025Reinforced Embodied Active Defense: Exploiting Adaptive Interaction for Robust Visual Perception in Adversarial 3D Environments24 Jul 2025
- 2024Deep Learning Model Security: Threats and Defenses12 Dec 2024
- 20242DSig-Detect: a semi-supervised framework for anomaly detection on image data using 2D-signatures8 Sep 2024
- 2024DataFreeShield: Defending Adversarial Attacks without Training Data21 Jun 2024
- 2024LLM Whisperer: An Inconspicuous Attack to Bias LLM Responses7 Jun 2024
- 2024Embodied Active Defense: Leveraging Recurrent Feedback to Counter Adversarial Patches31 Mar 2024
- 2023Dynamic Adversarial Attacks on Autonomous Driving Systems10 Dec 2023
38 more
- 2023MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness8 Dec 2023
- 2023Adversarial Medical Image with Hierarchical Feature Hiding4 Dec 2023
- 2023Segment (Almost) Nothing: Prompt-Agnostic Adversarial Attacks on Segmentation Models24 Nov 2023
- 2023Exploring Geometry of Blind Spots in Vision Models30 Oct 2023
- 2023RAIFLE: Reconstruction Attacks on Interaction-based Federated Learning with Adversarial Data Manipulation29 Oct 2023
- 2023Splitting the Difference on Adversarial Training3 Oct 2023
- 2023SoK: Realistic Adversarial Attacks and Defenses for Intelligent Network Intrusion Detection13 Aug 2023
- 2023A reading survey on adversarial machine learning: Adversarial attacks and their understanding7 Aug 2023
- 2023Group-based Robustness: A General Framework for Customized Robustness in the Real World29 Jun 2023
- 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesis13 Jun 2023
- 2023Boosting Adversarial Robustness using Feature Level Stochastic Smoothing10 Jun 2023
- 2023Don't trust your eyes: on the (un)reliability of feature visualizations7 Jun 2023
- 2023Robust Classification via a Single Diffusion Model24 May 2023
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Models8 Feb 2023
- 2023Improving the Accuracy-Robustness Trade-Off of Classifiers via Adaptive Smoothing29 Jan 2023
- 2022Advancing Deep Metric Learning Through Multiple Batch Norms And Multi-Targeted Adversarial Examples29 Nov 2022
- 2022Towards Lightweight Black-Box Attacks against Deep Neural Networks29 Sep 2022
- 2022Adversarial Detection: Attacking Object Detection in Real Time5 Sep 2022
- 2022An Overview and Prospective Outlook on Robust Training and Certification of Machine Learning Models15 Aug 2022
- 2022p-DkNN: Out-of-Distribution Detection Through Statistical Testing of Deep Representations25 Jul 2022
- 2022Increasing Confidence in Adversarial Robustness Evaluations28 Jun 2022
- 2022Adversarial Unlearning: Reducing Confidence Along Adversarial Directions3 Jun 2022
- 2022Exact Feature Collisions in Neural Networks31 May 2022
- 2022Superclass Adversarial Attack29 May 2022
- 2022Reverse Engineering of Imperceptible Adversarial Image Perturbations26 Mar 2022
- 2022A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologies26 Mar 2022
- 2022Frequency-driven Imperceptible Adversarial Attack on Semantic Similarity10 Mar 2022
- 2022Adversarially Robust Learning with Tolerance2 Mar 2022
- 2022Layer-wise Regularized Adversarial Training using Layers Sustainability Analysis (LSA) framework5 Feb 2022
- 2021Medical Aegis: Robust adversarial protectors for medical images22 Nov 2021
- 2021Exploring Transferable and Robust Adversarial Perturbation Generation from the Perspective of Network Hierarchy16 Aug 2021
- 2021Optical Adversarial Attack13 Aug 2021
- 2021On the Exploitability of Audio Machine Learning Pipelines to Surreptitious Adversarial Examples3 Aug 2021
- 2021Delving into the pixels of adversarial samples21 Jun 2021
- 2021Adversarial Attack and Defense in Deep Ranking7 Jun 2021
- 2021Feature Space Targeted Attacks by Statistic Alignment25 May 2021
- 2021Exploiting Vulnerabilities in Deep Neural Networks: Adversarial and Fault-Injection Attacks5 May 2021
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparison1 May 2021
50 newest of 56 All 56 (JSON)
- 2023MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustnesscited by 12
- 2026Robustness of Vision Language Models Against Split-Image Harmful Input Attackscited by 1
- 2026On Adversarial Vulnerability of Vision-Language Models through the Lens of Intermediate Spectral Subspacescited by 0
- 2026It Takes Little to Rewrite Perception: Targeted Semantic Substitution in Vision-Language Models at ε≤ 4/255cited by 0
- 2026It Takes Little to Rewrite Perception: Targeted Semantic Substitution in Vision-Language Models at ε≤ 4/25529 Sep 2026
- 2026On Adversarial Vulnerability of Vision-Language Models through the Lens of Intermediate Spectral Subspaces8 Jul 2026
- 2026Robustness of Vision Language Models Against Split-Image Harmful Input Attacks8 Feb 2026
- 2023MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness8 Dec 2023
- 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesiscited by 23
- 2022Adversarial Unlearning: Reducing Confidence Along Adversarial Directionscited by 14
- 2021What Do Deep Nets Learn? Class-wise Patterns Revealed in the Input Spacecited by 8
- 2024Deep Learning Model Security: Threats and Defensescited by 4
- 2024Deep Learning Model Security: Threats and Defenses12 Dec 2024
- 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesis13 Jun 2023
- 2022Adversarial Unlearning: Reducing Confidence Along Adversarial Directions3 Jun 2022
- 2021What Do Deep Nets Learn? Class-wise Patterns Revealed in the Input Space18 Jan 2021
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Modelscited by 205
- 2023Robust Classification via a Single Diffusion Modelcited by 79
- 2022Frequency-driven Imperceptible Adversarial Attack on Semantic Similaritycited by 77
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 52
- 2022A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologiescited by 44
- 2021Optical Adversarial Attackcited by 43
- 2023Don't trust your eyes: on the (un)reliability of feature visualizationscited by 32
- 2021Automated Discovery of Adaptive Attacks on Adversarial Defensescited by 22
- 2021Feature Space Targeted Attacks by Statistic Alignmentcited by 21
- 2023Improving the Accuracy-Robustness Trade-Off of Classifiers via Adaptive Smoothingcited by 18
- 2022Reverse Engineering of Imperceptible Adversarial Image Perturbationscited by 17
- 2024LLM Whisperer: An Inconspicuous Attack to Bias LLM Responsescited by 15
- 2022Towards Lightweight Black-Box Attacks against Deep Neural Networkscited by 13
- 2021Staircase Sign Method for Boosting Adversarial Attackscited by 12
12 most cited of 46 All 46 (JSON)
- 2026Attacking Graph Foundation Models Through Their Shared Representation20 Jul 2026
- 2025AdLift: Lifting Adversarial Perturbations to Safeguard 3D Gaussian Splatting Assets Against Instruction-Driven Editing8 Dec 2025
- 2025Reinforced Embodied Active Defense: Exploiting Adaptive Interaction for Robust Visual Perception in Adversarial 3D Environments24 Jul 2025
- 20242DSig-Detect: a semi-supervised framework for anomaly detection on image data using 2D-signatures8 Sep 2024
- 2024DataFreeShield: Defending Adversarial Attacks without Training Data21 Jun 2024
- 2024LLM Whisperer: An Inconspicuous Attack to Bias LLM Responses7 Jun 2024
- 2024Embodied Active Defense: Leveraging Recurrent Feedback to Counter Adversarial Patches31 Mar 2024
- 2023Dynamic Adversarial Attacks on Autonomous Driving Systems10 Dec 2023
- 2023Adversarial Medical Image with Hierarchical Feature Hiding4 Dec 2023
- 2023Segment (Almost) Nothing: Prompt-Agnostic Adversarial Attacks on Segmentation Models24 Nov 2023
- 2023Exploring Geometry of Blind Spots in Vision Models30 Oct 2023
- 2023RAIFLE: Reconstruction Attacks on Interaction-based Federated Learning with Adversarial Data Manipulation29 Oct 2023
12 newest of 46 All 46 (JSON)