Boosting Adversarial Transferability by Block Shuffle and Rotation
Not on the map. Why?
Abstract (arXiv)
Adversarial examples mislead deep neural networks with imperceptible perturbations and have brought significant threats to deep learning. An important aspect is their transferability, which refers to their ability to deceive other models, thus enabling attacks in the black-box setting. Though various methods have been proposed to boost transferability, the performance still falls short compared with white-box attacks. In this work, we observe that existing input transformation based attacks, one of the mainstream transfer-based attacks, result in different attention heatmaps on various models, which might limit the transferability. We also find that breaking the intrinsic relation of the image can disrupt the attention heatmap of the original image. Based on this finding, we propose a novel input transformation based attack called block shuffle and rotation (BSR). Specifically, BSR splits the input image into several blocks, then randomly shuffles and rotates these blocks to construct a set of new images for gradient calculation. Empirical evaluations on the ImageNet dataset demonstrate that BSR could achieve significantly better transferability than the existing input transformation based methods under single-model and ensemble-model settings. Combining BSR with the current input transformation method can further improve the transferability, which significantly outperforms the state-of-the-art methods. Code is available at https://github.com/Trustworthy-AI-Group/BSR
Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). Builds on 47 of its 59 references that are in the map. First posted on arXiv 20 Aug 2023.
Builds on
47 of 59 references.
References · 47
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2013Intriguing properties of neural networkscited by 5,114
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
35 more
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2016Adversarial examples in the physical worldcited by 1,762
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
- 2017SmoothGrad: removing noise by adding noisecited by 1,097
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 968
- 2016Practical Black-Box Attacks against Machine Learningcited by 893
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 833
- 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 591
- 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 530
- 2017Countering Adversarial Images using Input Transformationscited by 517
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 484
- 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 440
- 2017Mitigating Adversarial Effects Through Randomizationcited by 382
- 2019Nesterov Accelerated Gradient and Scale Invariance for Adversarial Attackscited by 352
- 2017Defense against Adversarial Attacks Using High-Level Representation Guided Denoisercited by 329
- 2019Simple Black-box Adversarial Attackscited by 249
- 2021Enhancing the Transferability of Adversarial Attacks through Variance Tuningcited by 242
- 2018Adversarial Risk and the Dangers of Evaluating Against Weak Attackscited by 221
- 2019Towards Stable and Efficient Training of Verifiably Robust Neural Networkscited by 204
- 2020A Self-supervised Approach for Adversarial Robustnesscited by 180
- 2021Admix: Enhancing the Transferability of Adversarial Attackscited by 155
- 2021Feature Importance-aware Transferable Adversarial Attackscited by 125
- 2020QEBA: Query-Efficient Boundary-Based Blackbox Attackcited by 103
- 2018Feature Distillation: DNN-Oriented JPEG Compression Against Adversarial Examplescited by 98
- 2021Stochastic Variance Reduced Ensemble Adversarial Attack for Boosting the Adversarial Transferabilitycited by 84
- 2018Learning Transferable Adversarial Examples via Ghost Networkscited by 69
- 2021Boosting Adversarial Transferability through Enhanced Momentumcited by 53
- 2021Triangle Attack: A Query-efficient Decision-based Adversarial Attackcited by 48
- 2023Boosting Adversarial Transferability by Achieving Flat Local Maximacited by 48
- 2023Improving the Transferability of Adversarial Samples by Path-Augmented Methodcited by 36
- 2023Diversifying the High-level Features for better Adversarial Transferabilitycited by 34
- 2019Robust Local Features for Improving the Generalization of Adversarial Trainingcited by 30
- 2023Rethinking the Backward Propagation for Adversarial Transferabilitycited by 27
Built on by
Citing papers per year: 2023: 3; 2024: 14; 2025: 31; 2026: 16.
64 papers.
Sort:
By area:
- 2024Learning to Transform Dynamically for Better Adversarial Transferabilitycited by 23
- 2024Transferable Adversarial Attacks on SAM and Its Downstream Modelscited by 20
- 2025Attention! Your Vision Language Model Could Be Maliciously Manipulatedcited by 12
- 2025Towards Model Resistant to Transferable Adversarial Examples via Trigger Activationcited by 10
- 2025When Robots Obey the Patch: Universal Transferable Patch Attacks on Vision-Language-Action Modelscited by 9
- 2025From Pretrain to Pain: Adversarial Vulnerability of Video Foundation Models Without Task Knowledgecited by 8
- 2024Rethinking Impersonation and Dodging Attacks on Face Recognition Systemscited by 7
- 2024TASAR: Transfer-based Attack on Skeletal Action Recognitioncited by 7
- 2025Improving Adversarial Transferability on Vision Transformers via Forward Propagation Refinementcited by 7
- 2024Boosting Adversarial Transferability with Low-Cost Optimization via Maximin Expected Flatnesscited by 6
- 2024Understanding Model Ensemble in Transferable Adversarial Attackcited by 6
- 2025ForensicsSAM: Toward Robust and Unified Image Forgery Detection and Localization Resisting to Adversarial Attackcited by 6
38 more
- 2023Transferability Bound Theory: Exploring Relationship between Adversarial Transferability and Flatnesscited by 5
- 2025Enhancing Targeted Adversarial Attacks on Large Vision-Language Models via Intermediate Projectorcited by 5
- 2024Adversarial Attacks on Both Face Recognition and Face Anti-spoofing Modelscited by 4
- 2023Rethinking Mixup for Improving the Adversarial Transferabilitycited by 3
- 2024Exploring Frequencies via Feature Mixing and Meta-Learning for Improving Adversarial Transferabilitycited by 3
- 2024Improving the Transferability of Adversarial Attacks on Face Recognition with Diverse Parameters Augmentationcited by 3
- 2025Data-free Universal Adversarial Perturbation with Pseudo-semantic Priorcited by 3
- 2025Boosting Adversarial Transferability via High-Frequency Augmentation and Hierarchical-Gradient Fusioncited by 3
- 2025Enhancing Diffusion-based Unrestricted Adversarial Attacks via Adversary Preferences Alignmentcited by 3
- 2025ScoreAdv: Score-based Targeted Generation of Natural Adversarial Examples via Diffusion Modelscited by 3
- 2025MAA: Meticulous Adversarial Attack against Vision-Language Pre-trained Modelscited by 2
- 2025Information-Geometric Inverse Distillation for Enhancing Adversarial Transferabilitycited by 2
- 2025Boosting the Local Invariance for Better Adversarial Transferabilitycited by 2
- 2025GSBAK: top-K Geometric Score-based Black-box Attackcited by 2
- 2025Boosting Adversarial Transferability via Ensemble Non-Attentioncited by 2
- 2023Generating Visually Realistic Adversarial Patchcited by 1
- 2024On the Adversarial Transferability of Generalized "Skip Connections"cited by 1
- 2024S4ST: A Strong, Self-transferable, faSt, and Simple Scale Transformation for Transferable Targeted Attackcited by 1
- 2025Enhancing Adversarial Transferability via Component-Wise Transformationcited by 1
- 2025Improving the Transferability of Adversarial Attacks by an Input Transposecited by 1
- 2025Disrupting Semantic and Abstract Features for Better Adversarial Transferabilitycited by 1
- 2025Boosting Adversarial Transferability via Residual Perturbation Attackcited by 1
- 2025ViT-EnsembleAttack: Augmenting Ensemble Models for Stronger Adversarial Transferability in Vision Transformerscited by 1
- 2025Generating Transferrable Adversarial Examples via Local Mixing and Logits Optimization for Remote Sensing Object Recognitioncited by 1
- 2026OTI: A Model-free and Visually Interpretable Measure of Image Attackabilitycited by 1
- 2026Universal Adversarial Attacks against Closed-Source MLLMs via Target-View Routed Meta Optimizationcited by 1
- 2024Looking From the Future: Multi-order Iterations Can Enhance Adversarial Attack Transferabilitycited by 0
- 2024Enhancing Transferability of Targeted Adversarial Examples: A Self-Universal Perspectivecited by 0
- 2024Improving Adversarial Transferability with Neighbourhood Gradient Informationcited by 0
- 2025Rethinking Target Label Conditioning in Adversarial Attacks: A 2D Tensor-Guided Generative Approachcited by 0
- 2025RaPA: Enhancing Transferable Targeted Attacks via Random Parameter Pruningcited by 0
- 2025Temporal Consistency Constrained Transferable Adversarial Attacks with Background Mixup for Action Recognitioncited by 0
- 2025Boosting Adversarial Transferability for Hyperspectral Image Classification Using 3D Structure-invariant Transformation and Weighted Intermediate Feature Divergencecited by 0
- 2025Boosting Adversarial Transferability Against Defenses via Multi-Scale Transformationcited by 0
- 2025SAM Encoder Breach by Adversarial Simplicial Complex Triggers Downstream Model Failurescited by 0
- 2025Attack logics, not outputs: Towards efficient robustification of deep neural networks by falsifying concept-based propertiescited by 0
- 2025Dynamic Parameter Optimization for Highly Transferable Transformation-Based Attackscited by 0
- 2025Enhancing Adversarial Transferability through Block Stretch and Shrinkcited by 0
50 most cited of 64 All 64 (JSON)
- 2026Perspective-Invariant Attack with Enhanced Transferability of Adversarial Examples15 Aug 2026
- 2026ARMOR++: Agentic Orchestration of a Multi-Domain Primitive Set for Transferable Attacks on Deepfake Detectors16 Jul 2026
- 2026Technical Report on the CVPR 2026@AdvML Workshop Challenge13 Jul 2026
- 2026The Scissors Effect: When Resize-Based Input Diversity Helps or Hurts Transfer Attacks21 Jun 2026
- 2026AGC: Adaptive Geodesic Correction for Adversarial Robustness on Vision-Language Models15 May 2026
- 2026Compression as an Adversarial Amplifier Through Decision Space Reduction8 Apr 2026
- 2026Fast Preemptive Robustification: High-Frequency Response Anti-Aligns Shared Vulnerability26 Mar 2026
- 2026A Unified Spatial Alignment Framework for Highly Transferable Transformation-Based Attacks on Spatially Structured Tasks26 Mar 2026
- 2026Towards Highly Transferable Vision-Language Attack via Semantic-Augmented Dynamic Contrastive Interaction5 Mar 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2026The Power of Decaying Steps: Enhancing Attack Stability and Transferability for Sign-based Optimizers22 Feb 2026
- 2026SGHA-Attack: Semantic-Guided Hierarchical Alignment for Transferable Targeted Attacks on Vision-Language Models2 Feb 2026
38 more
- 2026Universal Adversarial Attacks against Closed-Source MLLMs via Target-View Routed Meta Optimization30 Jan 2026
- 2026OTI: A Model-free and Visually Interpretable Measure of Image Attackability24 Jan 2026
- 2026A Two-Stage Globally-Diverse Adversarial Attack for Vision-Language Pre-training Models18 Jan 2026
- 2026SRAW-Attack: Space-Reweighted Adversarial Warping Attack for SAR Target Recognition15 Jan 2026
- 2025When Robots Obey the Patch: Universal Transferable Patch Attacks on Vision-Language-Action Models26 Nov 2025
- 2025Enhancing Adversarial Transferability through Block Stretch and Shrink21 Nov 2025
- 2025Dynamic Parameter Optimization for Highly Transferable Transformation-Based Attacks15 Nov 2025
- 2025Boosting Adversarial Transferability via Ensemble Non-Attention12 Nov 2025
- 2025From Pretrain to Pain: Adversarial Vulnerability of Video Foundation Models Without Task Knowledge10 Nov 2025
- 2025Attack logics, not outputs: Towards efficient robustification of deep neural networks by falsifying concept-based properties1 Oct 2025
- 2025Generating Transferrable Adversarial Examples via Local Mixing and Logits Optimization for Remote Sensing Object Recognition9 Sep 2025
- 2025Enhancing Targeted Adversarial Attacks on Large Vision-Language Models via Intermediate Projector19 Aug 2025
- 2025ViT-EnsembleAttack: Augmenting Ensemble Models for Stronger Adversarial Transferability in Vision Transformers17 Aug 2025
- 2025ForensicsSAM: Toward Robust and Unified Image Forgery Detection and Localization Resisting to Adversarial Attack10 Aug 2025
- 2025SAM Encoder Breach by Adversarial Simplicial Complex Triggers Downstream Model Failures8 Aug 2025
- 2025Boosting Adversarial Transferability via Residual Perturbation Attack6 Aug 2025
- 2025Disrupting Semantic and Abstract Features for Better Adversarial Transferability21 Jul 2025
- 2025ScoreAdv: Score-based Targeted Generation of Natural Adversarial Examples via Diffusion Models8 Jul 2025
- 2025Boosting Adversarial Transferability Against Defenses via Multi-Scale Transformation2 Jul 2025
- 2025Boosting Adversarial Transferability for Hyperspectral Image Classification Using 3D Structure-invariant Transformation and Weighted Intermediate Feature Divergence12 Jun 2025
- 2025Enhancing Diffusion-based Unrestricted Adversarial Attacks via Adversary Preferences Alignment2 Jun 2025
- 2025Boosting Adversarial Transferability via High-Frequency Augmentation and Hierarchical-Gradient Fusion27 May 2025
- 2025Attention! Your Vision Language Model Could Be Maliciously Manipulated26 May 2025
- 2025Temporal Consistency Constrained Transferable Adversarial Attacks with Background Mixup for Action Recognition23 May 2025
- 2025RaPA: Enhancing Transferable Targeted Attacks via Random Parameter Pruning24 Apr 2025
- 2025Towards Model Resistant to Transferable Adversarial Examples via Trigger Activation20 Apr 2025
- 2025Rethinking Target Label Conditioning in Adversarial Attacks: A 2D Tensor-Guided Generative Approach19 Apr 2025
- 2025Improving Adversarial Transferability on Vision Transformers via Forward Propagation Refinement19 Mar 2025
- 2025GSBAK: top-K Geometric Score-based Black-box Attack17 Mar 2025
- 2025Boosting the Local Invariance for Better Adversarial Transferability8 Mar 2025
- 2025Improving the Transferability of Adversarial Attacks by an Input Transpose2 Mar 2025
- 2025Data-free Universal Adversarial Perturbation with Pseudo-semantic Prior28 Feb 2025
- 2025Information-Geometric Inverse Distillation for Enhancing Adversarial Transferability24 Feb 2025
- 2025MAA: Meticulous Adversarial Attack against Vision-Language Pre-trained Models12 Feb 2025
- 2025Enhancing Adversarial Transferability via Component-Wise Transformation21 Jan 2025
- 2024Improving the Transferability of Adversarial Attacks on Face Recognition with Diverse Parameters Augmentation23 Nov 2024
- 2024Transferable Adversarial Attacks on SAM and Its Downstream Models26 Oct 2024
- 2024S4ST: A Strong, Self-transferable, faSt, and Simple Scale Transformation for Transferable Targeted Attack13 Oct 2024
50 newest of 64 All 64 (JSON)
- 2025Attention! Your Vision Language Model Could Be Maliciously Manipulatedcited by 12
- 2025From Pretrain to Pain: Adversarial Vulnerability of Video Foundation Models Without Task Knowledgecited by 8
- 2025Enhancing Targeted Adversarial Attacks on Large Vision-Language Models via Intermediate Projectorcited by 5
- 2025MAA: Meticulous Adversarial Attack against Vision-Language Pre-trained Modelscited by 2
- 2026Universal Adversarial Attacks against Closed-Source MLLMs via Target-View Routed Meta Optimizationcited by 1
- 2026A Two-Stage Globally-Diverse Adversarial Attack for Vision-Language Pre-training Modelscited by 0
- 2026SGHA-Attack: Semantic-Guided Hierarchical Alignment for Transferable Targeted Attacks on Vision-Language Modelscited by 0
- 2026Towards Highly Transferable Vision-Language Attack via Semantic-Augmented Dynamic Contrastive Interactioncited by 0
- 2026AGC: Adaptive Geodesic Correction for Adversarial Robustness on Vision-Language Modelscited by 0
- 2026AGC: Adaptive Geodesic Correction for Adversarial Robustness on Vision-Language Models15 May 2026
- 2026Towards Highly Transferable Vision-Language Attack via Semantic-Augmented Dynamic Contrastive Interaction5 Mar 2026
- 2026SGHA-Attack: Semantic-Guided Hierarchical Alignment for Transferable Targeted Attacks on Vision-Language Models2 Feb 2026
- 2026Universal Adversarial Attacks against Closed-Source MLLMs via Target-View Routed Meta Optimization30 Jan 2026
- 2026A Two-Stage Globally-Diverse Adversarial Attack for Vision-Language Pre-training Models18 Jan 2026
- 2025From Pretrain to Pain: Adversarial Vulnerability of Video Foundation Models Without Task Knowledge10 Nov 2025
- 2025Enhancing Targeted Adversarial Attacks on Large Vision-Language Models via Intermediate Projector19 Aug 2025
- 2025Attention! Your Vision Language Model Could Be Maliciously Manipulated26 May 2025
- 2025MAA: Meticulous Adversarial Attack against Vision-Language Pre-trained Models12 Feb 2025
- 2024Learning to Transform Dynamically for Better Adversarial Transferabilitycited by 23
- 2024Transferable Adversarial Attacks on SAM and Its Downstream Modelscited by 20
- 2025Towards Model Resistant to Transferable Adversarial Examples via Trigger Activationcited by 10
- 2024Rethinking Impersonation and Dodging Attacks on Face Recognition Systemscited by 7
- 2024TASAR: Transfer-based Attack on Skeletal Action Recognitioncited by 7
- 2025Improving Adversarial Transferability on Vision Transformers via Forward Propagation Refinementcited by 7
- 2024Boosting Adversarial Transferability with Low-Cost Optimization via Maximin Expected Flatnesscited by 6
- 2024Understanding Model Ensemble in Transferable Adversarial Attackcited by 6
- 2025ForensicsSAM: Toward Robust and Unified Image Forgery Detection and Localization Resisting to Adversarial Attackcited by 6
- 2023Transferability Bound Theory: Exploring Relationship between Adversarial Transferability and Flatnesscited by 5
- 2024Adversarial Attacks on Both Face Recognition and Face Anti-spoofing Modelscited by 4
- 2023Rethinking Mixup for Improving the Adversarial Transferabilitycited by 3
12 most cited of 51 All 51 (JSON)
- 2026Perspective-Invariant Attack with Enhanced Transferability of Adversarial Examples15 Aug 2026
- 2026Technical Report on the CVPR 2026@AdvML Workshop Challenge13 Jul 2026
- 2026The Scissors Effect: When Resize-Based Input Diversity Helps or Hurts Transfer Attacks21 Jun 2026
- 2026Compression as an Adversarial Amplifier Through Decision Space Reduction8 Apr 2026
- 2026Fast Preemptive Robustification: High-Frequency Response Anti-Aligns Shared Vulnerability26 Mar 2026
- 2026A Unified Spatial Alignment Framework for Highly Transferable Transformation-Based Attacks on Spatially Structured Tasks26 Mar 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2026The Power of Decaying Steps: Enhancing Attack Stability and Transferability for Sign-based Optimizers22 Feb 2026
- 2026OTI: A Model-free and Visually Interpretable Measure of Image Attackability24 Jan 2026
- 2026SRAW-Attack: Space-Reweighted Adversarial Warping Attack for SAR Target Recognition15 Jan 2026
- 2025Enhancing Adversarial Transferability through Block Stretch and Shrink21 Nov 2025
- 2025Dynamic Parameter Optimization for Highly Transferable Transformation-Based Attacks15 Nov 2025
12 newest of 51 All 51 (JSON)