Boosting Adversarial Transferability via Commonality-Oriented Gradient Optimization
Not on the map. Why?
Abstract (arXiv)
Exploring effective and transferable adversarial examples is vital for understanding the characteristics and mechanisms of Vision Transformers (ViTs). However, adversarial examples generated from surrogate models often exhibit weak transferability in black-box settings due to overfitting. Existing methods improve transferability by diversifying perturbation inputs or applying uniform gradient regularization within surrogate models, yet they have not fully leveraged the shared and unique features of surrogate models trained on the same task, leading to suboptimal transfer performance. Therefore, enhancing perturbations of common information shared by surrogate models and suppressing those tied to individual characteristics offers an effective way to improve transferability. Accordingly, we propose a commonality-oriented gradient optimization strategy (COGO) consisting of two components: Commonality Enhancement (CE) and Individuality Suppression (IS). CE perturbs the mid-to-low frequency regions, leveraging the fact that ViTs trained on the same dataset tend to rely more on mid-to-low frequency information for classification. IS employs adaptive thresholds to evaluate the correlation between backpropagated gradients and model individuality, assigning weights to gradients accordingly. Extensive experiments demonstrate that COGO significantly improves the transfer success rates of adversarial attacks, outperforming current state-of-the-art methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 50 of its 58 references that are in the map. First posted on arXiv 8 Jun 2025.
Builds on
50 of 58 references.
References · 50
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2016Adversarial examples in the physical worldcited by 1,762
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2016Practical Black-Box Attacks against Machine Learningcited by 893
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 833
38 more
- 2016Universal adversarial perturbationscited by 774
- 2021Going deeper with Image Transformerscited by 759
- 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
- 2021Transformer in Transformercited by 632
- 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 591
- 2016Delving into Transferable Adversarial Examples and Black-box Attackscited by 530
- 2021ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biasescited by 484
- 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 440
- 2021Rethinking Spatial Dimensions of Vision Transformerscited by 361
- 2019Nesterov Accelerated Gradient and Scale Invariance for Adversarial Attackscited by 352
- 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 333
- 2020Skip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNetscited by 165
- 2021Visformer: The Vision-friendly Transformercited by 137
- 2022Frequency Domain Model Augmentation for Adversarial Attackcited by 128
- 2021On the Adversarial Robustness of Vision Transformerscited by 104
- 2019AdvPC: Transferable Adversarial Perturbations on 3D Point Cloudscited by 84
- 2021Towards Transferable Adversarial Attacks on Vision Transformerscited by 80
- 2024Adaptive Text Watermark for Large Language Modelscited by 60
- 2025SRPO: Enhancing Multimodal LLM Reasoning via Reflection-Aware Reinforcement Learningcited by 53
- 2020Transferable Perturbations of Deep Feature Distributionscited by 51
- 2024Image Watermarks are Removable Using Controllable Regeneration from Clean Noisecited by 43
- 2023Transferable Adversarial Attacks on Vision Transformers with Token Gradient Regularizationcited by 42
- 2025Efficient Diffusion Models: A Surveycited by 35
- 2024D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Modelscited by 30
- 2023TrojLLM: A Black-box Trojan Prompt Attack on Large Language Modelscited by 29
- 2023TrojText: Test-time Invisible Textual Trojan Insertioncited by 26
- 2025Aligning Vision to Language: Annotation-Free Multimodal Knowledge Graph Construction for Enhanced LLMs Reasoningcited by 19
- 2024Theoretically Grounded Framework for LLM Watermarking: A Distribution-Adaptive Approachcited by 17
- 2023Segment Anything Model is a Good Teacher for Local Feature Learningcited by 15
- 2023Advances in Embodied Navigation Using Large Language Models: A Surveycited by 14
- 2025Dataset Protection via Watermarked Canaries in Retrieval-Augmented LLMscited by 11
- 2022Exploring Adversarial Robustness of Vision Transformers in the Spectral Perspectivecited by 8
- 2024FAST: A Dual-tier Few-Shot Learning Paradigm for Whole Slide Image Classificationcited by 8
- 2025Enhancing Text-to-Image Diffusion Transformer via Split-Text Conditioningcited by 7
- 2024MLIP: Efficient Multi-Perspective Language-Image Pretraining with Exhaustive Data Utilizationcited by 6
- 2020Accurate Lung Nodules Segmentation with Detailed Representation Transfer and Soft Mask Supervisioncited by 3
- 2024SkinFormer: Learning Statistical Texture Representation with Transformer for Skin Lesion Segmentationcited by 2
- 2025CAE-DFKD: Bridging the Transferability Gap in Data-Free Knowledge Distillationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.