Diversifying the High-level Features for better Adversarial Transferability
Not on the map. Why?
Abstract (arXiv)
Given the great threat of adversarial attacks against Deep Neural Networks (DNNs), numerous works have been proposed to boost transferability to attack real-world applications. However, existing attacks often utilize advanced gradient calculation or input transformation but ignore the white-box model. Inspired by the fact that DNNs are over-parameterized for superior performance, we propose diversifying the high-level features (DHF) for more transferable adversarial examples. In particular, DHF perturbs the high-level features by randomly transforming the high-level features and mixing them with the feature of benign samples when calculating the gradient at each iteration. Due to the redundancy of parameters, such transformation does not affect the classification performance but helps identify the invariant features across different models, leading to much better transferability. Empirical evaluations on ImageNet dataset show that DHF could effectively improve the transferability of existing momentum-based attacks. Incorporated into the input transformation-based attacks, DHF generates more transferable adversarial examples and outperforms the baselines with a clear margin when attacking several defense models, showing its generalization to various attacks and high effectiveness for boosting transferability. Code is available at https://github.com/Trustworthy-AI-Group/DHF.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 59 of its 76 references that are in the map. First posted on arXiv 20 Apr 2023.
Builds on
59 of 76 references.
References · 59
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2013Intriguing properties of neural networkscited by 5,155
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2016Adversarial examples in the physical worldcited by 1,769
38 more
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 840
- 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 672
- 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 666
- 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 599
- 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 536
- 2017Countering Adversarial Images using Input Transformationscited by 520
- 2018Black-box Adversarial Attacks with Limited Queries and Informationcited by 501
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 486
- 2017Decision-Based Adversarial Attacks: Reliable Attacks Against Black-Box Machine Learning Modelscited by 462
- 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 442
- 2019HAWQ: Hessian AWare Quantization of Neural Networks with Mixed-Precisioncited by 402
- 2017Mitigating Adversarial Effects Through Randomizationcited by 383
- 2019Nesterov Accelerated Gradient and Scale Invariance for Adversarial Attackscited by 355
- 2017Defense against Adversarial Attacks Using High-Level Representation Guided Denoisercited by 329
- 2018Feature Denoising for Improving Adversarial Robustnesscited by 314
- 2018Certified Defenses against Adversarial Examplescited by 306
- 2020ZeroQ: A Novel Zero Shot Quantization Frameworkcited by 269
- 2019HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networkscited by 261
- 2018Generating Adversarial Examples with Adversarial Networkscited by 258
- 2021Enhancing the Transferability of Adversarial Attacks through Variance Tuningcited by 244
- 2016Wider or Deeper: Revisiting the ResNet Model for Visual Recognitioncited by 184
- 2017Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Artcited by 182
- 2020A Self-supervised Approach for Adversarial Robustnesscited by 180
- 2020Skip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNetscited by 167
- 2021Admix: Enhancing the Transferability of Adversarial Attackscited by 156
- 2018Scalable Methods for 8-bit Training of Neural Networkscited by 142
- 2019Enhancing Adversarial Example Transferability with an Intermediate Level Attackcited by 140
- 2022Frequency Domain Model Augmentation for Adversarial Attackcited by 130
- 2021Feature Importance-aware Transferable Adversarial Attackscited by 127
- 2018Transferable Adversarial Attacks for Image and Video Object Detectioncited by 109
- 2020QEBA: Query-Efficient Boundary-Based Blackbox Attackcited by 104
- 2018Feature Distillation: DNN-Oriented JPEG Compression Against Adversarial Examplescited by 99
- 2017Deep MANTA: A Coarse-to-fine Many-Task Network for joint 2D and 3D vehicle analysis from monocular imagecited by 95
- 2019NATTACK: Learning the Distributions of Adversarial Examples for an Improved Black-Box Attack on Deep Neural Networkscited by 94
- 2022Improving Adversarial Transferability via Neuron Attribution-Based Attackscited by 93
- 2018Learning Transferable Adversarial Examples via Ghost Networkscited by 70
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2023: 3; 2024: 13; 2025: 10; 2026: 8.
34 papers.
Sort:
By area:
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Promptcited by 109
- 2023Boosting Adversarial Transferability by Block Shuffle and Rotationcited by 64
- 2023Boosting Adversarial Transferability by Achieving Flat Local Maximacited by 48
- 2024Visual Adversarial Attack on Vision-Language Models for Autonomous Drivingcited by 36
- 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearningcited by 31
- 2024Compromising Embodied Agents with Contextual Backdoor Attackscited by 31
- 2024Effectiveness Assessment of Recent Large Vision-Language Modelscited by 29
- 2023Rethinking the Backward Propagation for Adversarial Transferabilitycited by 27
- 2025Black-Box Adversarial Attack on Vision Language Models for Autonomous Drivingcited by 24
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusionscited by 18
- 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlookcited by 13
- 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Modelscited by 13
22 more
- 2024Understanding Model Ensemble in Transferable Adversarial Attackcited by 7
- 2025Improving Adversarial Transferability on Vision Transformers via Forward Propagation Refinementcited by 7
- 2026WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agentscited by 7
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threatscited by 6
- 2025Lie Detector: Unified Backdoor Detection via Cross-Examination Frameworkcited by 6
- 2024TrapFlow: Controllable Website Fingerprinting Defense via Dynamic Backdoor Learningcited by 5
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysiscited by 4
- 2025Exploring Adversarial Transferability between Kolmogorov-arnold Networkscited by 4
- 2025Harnessing the Computation Redundancy in ViTs to Boost Adversarial Transferabilitycited by 4
- 2024Forward Learning for Gradient-based Black-box Saliency Map Generationcited by 2
- 2025Boosting the Local Invariance for Better Adversarial Transferabilitycited by 2
- 2025Text Adversarial Attacks with Dynamic Outputscited by 2
- 2025Bridging the Task Gap: Multi-Task Adversarial Transferability in CLIP and Its Derivativescited by 2
- 2025Improving the Transferability of Adversarial Attacks by an Input Transposecited by 1
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggerscited by 1
- 2026Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspectivecited by 1
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Modelscited by 0
- 2025Boosting Adversarial Transferability for Hyperspectral Image Classification Using 3D Structure-invariant Transformation and Weighted Intermediate Feature Divergencecited by 0
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluationcited by 0
- 2026Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?cited by 0
- 2026A Patch-based Cross-view Regularized Framework for Backdoor Defense in Multimodal Large Language Modelscited by 0
- 2026CIVA: Critic-Induced Value-Subspace Attacks on Visual World-Model Agentscited by 0
- 2026CIVA: Critic-Induced Value-Subspace Attacks on Visual World-Model Agents21 Aug 2026
- 2026Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspective7 Jul 2026
- 2026WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agents22 May 2026
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggers6 Apr 2026
- 2026A Patch-based Cross-view Regularized Framework for Backdoor Defense in Multimodal Large Language Models6 Apr 2026
- 2026Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?11 Mar 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Models21 Feb 2026
- 2025Bridging the Task Gap: Multi-Task Adversarial Transferability in CLIP and Its Derivatives28 Sep 2025
- 2025Text Adversarial Attacks with Dynamic Outputs26 Sep 2025
- 2025Boosting Adversarial Transferability for Hyperspectral Image Classification Using 3D Structure-invariant Transformation and Weighted Intermediate Feature Divergence12 Jun 2025
- 2025Harnessing the Computation Redundancy in ViTs to Boost Adversarial Transferability15 Apr 2025
22 more
- 2025Lie Detector: Unified Backdoor Detection via Cross-Examination Framework21 Mar 2025
- 2025Improving Adversarial Transferability on Vision Transformers via Forward Propagation Refinement19 Mar 2025
- 2025Exploring Adversarial Transferability between Kolmogorov-arnold Networks8 Mar 2025
- 2025Boosting the Local Invariance for Better Adversarial Transferability8 Mar 2025
- 2025Improving the Transferability of Adversarial Attacks by an Input Transpose2 Mar 2025
- 2025Black-Box Adversarial Attack on Vision Language Models for Autonomous Driving23 Jan 2025
- 2024TrapFlow: Controllable Website Fingerprinting Defense via Dynamic Backdoor Learning16 Dec 2024
- 2024Visual Adversarial Attack on Vision-Language Models for Autonomous Driving27 Nov 2024
- 2024Understanding Model Ensemble in Transferable Adversarial Attack9 Oct 2024
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Models7 Oct 2024
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threats29 Sep 2024
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysis24 Sep 2024
- 2024Compromising Embodied Agents with Contextual Backdoor Attacks6 Aug 2024
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt6 Jun 2024
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusions3 Jun 2024
- 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlook24 Mar 2024
- 2024Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearning24 Mar 2024
- 2024Forward Learning for Gradient-based Black-box Saliency Map Generation22 Mar 2024
- 2024Effectiveness Assessment of Recent Large Vision-Language Models7 Mar 2024
- 2023Boosting Adversarial Transferability by Block Shuffle and Rotation20 Aug 2023
- 2023Rethinking the Backward Propagation for Adversarial Transferability22 Jun 2023
- 2023Boosting Adversarial Transferability by Achieving Flat Local Maxima8 Jun 2023
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Promptcited by 109
- 2024Effectiveness Assessment of Recent Large Vision-Language Modelscited by 29
- 2025Bridging the Task Gap: Multi-Task Adversarial Transferability in CLIP and Its Derivativescited by 2
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggerscited by 1
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Modelscited by 0
- 2026A Patch-based Cross-view Regularized Framework for Backdoor Defense in Multimodal Large Language Modelscited by 0
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggers6 Apr 2026
- 2026A Patch-based Cross-view Regularized Framework for Backdoor Defense in Multimodal Large Language Models6 Apr 2026
- 2025Bridging the Task Gap: Multi-Task Adversarial Transferability in CLIP and Its Derivatives28 Sep 2025
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Models7 Oct 2024
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt6 Jun 2024
- 2024Effectiveness Assessment of Recent Large Vision-Language Models7 Mar 2024
- 2023Boosting Adversarial Transferability by Block Shuffle and Rotationcited by 64
- 2023Boosting Adversarial Transferability by Achieving Flat Local Maximacited by 48
- 2023Rethinking the Backward Propagation for Adversarial Transferabilitycited by 27
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusionscited by 18
- 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlookcited by 13
- 2024Understanding Model Ensemble in Transferable Adversarial Attackcited by 7
- 2025Improving Adversarial Transferability on Vision Transformers via Forward Propagation Refinementcited by 7
- 2025Lie Detector: Unified Backdoor Detection via Cross-Examination Frameworkcited by 6
- 2024TrapFlow: Controllable Website Fingerprinting Defense via Dynamic Backdoor Learningcited by 5
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysiscited by 4
- 2025Exploring Adversarial Transferability between Kolmogorov-arnold Networkscited by 4
- 2025Harnessing the Computation Redundancy in ViTs to Boost Adversarial Transferabilitycited by 4
12 most cited of 19 All 19 (JSON)
- 2026Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?11 Mar 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2025Text Adversarial Attacks with Dynamic Outputs26 Sep 2025
- 2025Boosting Adversarial Transferability for Hyperspectral Image Classification Using 3D Structure-invariant Transformation and Weighted Intermediate Feature Divergence12 Jun 2025
- 2025Harnessing the Computation Redundancy in ViTs to Boost Adversarial Transferability15 Apr 2025
- 2025Lie Detector: Unified Backdoor Detection via Cross-Examination Framework21 Mar 2025
- 2025Improving Adversarial Transferability on Vision Transformers via Forward Propagation Refinement19 Mar 2025
- 2025Exploring Adversarial Transferability between Kolmogorov-arnold Networks8 Mar 2025
- 2025Boosting the Local Invariance for Better Adversarial Transferability8 Mar 2025
- 2025Improving the Transferability of Adversarial Attacks by an Input Transpose2 Mar 2025
- 2024TrapFlow: Controllable Website Fingerprinting Defense via Dynamic Backdoor Learning16 Dec 2024
- 2024Understanding Model Ensemble in Transferable Adversarial Attack9 Oct 2024
12 newest of 19 All 19 (JSON)