Boosting Adversarial Transferability with Low-Cost Optimization via Maximin Expected Flatness
Not on the map. Why?
Abstract (arXiv)
Transfer-based attacks craft adversarial examples on white-box surrogate models and directly deploy them against black-box target models, offering model-agnostic and query-free threat scenarios. While flatness-enhanced methods have recently emerged to improve transferability by enhancing the loss surface flatness of adversarial examples, their divergent flatness definitions and heuristic attack designs suffer from unexamined optimization limitations and missing theoretical foundation, thus constraining their effectiveness and efficiency. This work exposes the severely imbalanced exploitation-exploration dynamics in flatness optimization, establishing the first theoretical foundation for flatness-based transferability and proposing a principled framework to overcome these optimization pitfalls. Specifically, we systematically unify fragmented flatness definitions across existing methods, revealing their imbalanced optimization limitations in over-exploration of sensitivity peaks or over-exploitation of local plateaus. To resolve these issues, we rigorously formalize average-case flatness and transferability gaps, proving that enhancing zeroth-order average-case flatness minimizes cross-model discrepancies. Building on this theory, we design a Maximin Expected Flatness (MEF) attack that enhances zeroth-order average-case flatness while balancing flatness exploration and exploitation. Extensive evaluations across 22 models and 24 current transfer-based attacks demonstrate MEF's superiority: it surpasses the state-of-the-art PGN attack by 4% in attack success rate at half the computational cost and achieves 8% higher success rate under the same budget. When combined with input augmentation, MEF attains 15% additional gains against defense-equipped models, establishing new robustness benchmarks. Our code is available at https://github.com/SignedQiu/MEFAttack.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 73 of its 97 references that are in the map. First posted on arXiv 25 May 2024.
Builds on
73 of 97 references.
References · 73
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2023Visual Instruction Tuningcited by 7,869
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2013Intriguing properties of neural networkscited by 5,155
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
38 more
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
- 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,352
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
- 2016Adversarial Machine Learning at Scalecited by 936
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 840
- 2017Evasion Attacks against Machine Learning at Test Timecited by 689
- 2019Square Attack: a query-efficient black-box adversarial attack via random searchcited by 685
- 2020RobustBench: a standardized adversarial robustness benchmarkcited by 661
- 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 599
- 2017Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methodscited by 546
- 2017Progressive Neural Architecture Searchcited by 487
- 2022Diffusion Models for Adversarial Purificationcited by 476
- 2017Decision-Based Adversarial Attacks: Reliable Attacks Against Black-Box Machine Learning Modelscited by 462
- 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 442
- 2021Rethinking Spatial Dimensions of Vision Transformerscited by 361
- 2019Nesterov Accelerated Gradient and Scale Invariance for Adversarial Attackscited by 355
- 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 339
- 2019HopSkipJumpAttack: A Query-Efficient Decision-Based Attackcited by 333
- 2019Provably Robust Deep Learning via Adversarially Trained Smoothed Classifierscited by 330
- 2017Defense against Adversarial Attacks Using High-Level Representation Guided Denoisercited by 329
- 2018Feature Denoising for Improving Adversarial Robustnesscited by 314
- 2019Simple Black-box Adversarial Attackscited by 251
- 2021Enhancing the Transferability of Adversarial Attacks through Variance Tuningcited by 244
- 2017On Detecting Adversarial Perturbationscited by 232
- 2023One Transformer Fits All Distributions in Multi-Modal Diffusion at Scalecited by 187
- 2020A Self-supervised Approach for Adversarial Robustnesscited by 180
- 2020Skip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNetscited by 167
- 2019Enhancing Adversarial Example Transferability with an Intermediate Level Attackcited by 140
- 2022Frequency Domain Model Augmentation for Adversarial Attackcited by 130
- 2020RayS: A Ray Searching Method for Hard-label Adversarial Attackcited by 96
- 2023Diffusion Models for Imperceptible and Transferable Adversarial Attackcited by 94
- 2022Improving Adversarial Transferability via Neuron Attribution-Based Attackscited by 93
- 2019Cross-Domain Transferability of Adversarial Perturbationscited by 92
- 2020On Success and Simplicity: A Second Look at Transferable Targeted Attackscited by 89
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2025: 4; 2026: 3.
7 papers.
- 2025Exploring Adversarial Transferability between Kolmogorov-arnold Networkscited by 4
- 2025Boosting the Local Invariance for Better Adversarial Transferabilitycited by 2
- 2025Adversarial Semantic and Label Perturbation Attack for Pedestrian Attribute Recognitioncited by 2
- 2025Seeking Flat Minima over Diverse Surrogates for Improved Adversarial Transferability: A Theoretical Framework and Algorithmic Instantiationcited by 0
- 2026SRAW-Attack: Space-Reweighted Adversarial Warping Attack for SAR Target Recognitioncited by 0
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluationcited by 0
- 2026Pareto-Improving Adversarial Attacks with Primal-Dual Regularizationcited by 0
- 2026Pareto-Improving Adversarial Attacks with Primal-Dual Regularization3 Oct 2026
- 2026Devling into Adversarial Transferability on Image Classification: Review, Benchmark, and Evaluation26 Feb 2026
- 2026SRAW-Attack: Space-Reweighted Adversarial Warping Attack for SAR Target Recognition15 Jan 2026
- 2025Adversarial Semantic and Label Perturbation Attack for Pedestrian Attribute Recognition29 May 2025
- 2025Seeking Flat Minima over Diverse Surrogates for Improved Adversarial Transferability: A Theoretical Framework and Algorithmic Instantiation23 Apr 2025
- 2025Exploring Adversarial Transferability between Kolmogorov-arnold Networks8 Mar 2025
- 2025Boosting the Local Invariance for Better Adversarial Transferability8 Mar 2025