mlsanityData to 14 Oct 2026

Boosting Adversarial Transferability with Low-Cost Optimization via Maximin Expected Flatness

arXiv 2405.16181 ↗First posted 25 May 2024cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Transfer-based attacks craft adversarial examples on white-box surrogate models and directly deploy them against black-box target models, offering model-agnostic and query-free threat scenarios. While flatness-enhanced methods have recently emerged to improve transferability by enhancing the loss surface flatness of adversarial examples, their divergent flatness definitions and heuristic attack designs suffer from unexamined optimization limitations and missing theoretical foundation, thus constraining their effectiveness and efficiency. This work exposes the severely imbalanced exploitation-exploration dynamics in flatness optimization, establishing the first theoretical foundation for flatness-based transferability and proposing a principled framework to overcome these optimization pitfalls. Specifically, we systematically unify fragmented flatness definitions across existing methods, revealing their imbalanced optimization limitations in over-exploration of sensitivity peaks or over-exploitation of local plateaus. To resolve these issues, we rigorously formalize average-case flatness and transferability gaps, proving that enhancing zeroth-order average-case flatness minimizes cross-model discrepancies. Building on this theory, we design a Maximin Expected Flatness (MEF) attack that enhances zeroth-order average-case flatness while balancing flatness exploration and exploitation. Extensive evaluations across 22 models and 24 current transfer-based attacks demonstrate MEF's superiority: it surpasses the state-of-the-art PGN attack by 4% in attack success rate at half the computational cost and achieves 8% higher success rate under the same budget. When combined with input augmentation, MEF attains 15% additional gains against defense-equipped models, establishing new robustness benchmarks. Our code is available at https://github.com/SignedQiu/MEFAttack.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 73 of its 97 references that are in the map. First posted on arXiv 25 May 2024.

Builds on

73 of 97 references.

References · 73

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  7. 2016Densely Connected Convolutional Networkscited by 6,720
  8. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  9. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  10. 2013Intriguing properties of neural networkscited by 5,155
  11. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  12. 2016Towards Evaluating the Robustness of Neural Networkscited by 2,998
38 more
  1. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  2. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  3. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
  4. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  5. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
  6. 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,352
  7. 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
  8. 2016Adversarial Machine Learning at Scalecited by 936
  9. 2017Ensemble Adversarial Training: Attacks and Defensescited by 840
  10. 2017Evasion Attacks against Machine Learning at Test Timecited by 689
  11. 2019Square Attack: a query-efficient black-box adversarial attack via random searchcited by 685
  12. 2020RobustBench: a standardized adversarial robustness benchmarkcited by 661
  13. 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 599
  14. 2017Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methodscited by 546
  15. 2017Progressive Neural Architecture Searchcited by 487
  16. 2022Diffusion Models for Adversarial Purificationcited by 476
  17. 2017Decision-Based Adversarial Attacks: Reliable Attacks Against Black-Box Machine Learning Modelscited by 462
  18. 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 442
  19. 2021Rethinking Spatial Dimensions of Vision Transformerscited by 361
  20. 2019Nesterov Accelerated Gradient and Scale Invariance for Adversarial Attackscited by 355
  21. 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 339
  22. 2019HopSkipJumpAttack: A Query-Efficient Decision-Based Attackcited by 333
  23. 2019Provably Robust Deep Learning via Adversarially Trained Smoothed Classifierscited by 330
  24. 2017Defense against Adversarial Attacks Using High-Level Representation Guided Denoisercited by 329
  25. 2018Feature Denoising for Improving Adversarial Robustnesscited by 314
  26. 2019Simple Black-box Adversarial Attackscited by 251
  27. 2021Enhancing the Transferability of Adversarial Attacks through Variance Tuningcited by 244
  28. 2017On Detecting Adversarial Perturbationscited by 232
  29. 2023One Transformer Fits All Distributions in Multi-Modal Diffusion at Scalecited by 187
  30. 2020A Self-supervised Approach for Adversarial Robustnesscited by 180
  31. 2020Skip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNetscited by 167
  32. 2019Enhancing Adversarial Example Transferability with an Intermediate Level Attackcited by 140
  33. 2022Frequency Domain Model Augmentation for Adversarial Attackcited by 130
  34. 2020RayS: A Ray Searching Method for Hard-label Adversarial Attackcited by 96
  35. 2023Diffusion Models for Imperceptible and Transferable Adversarial Attackcited by 94
  36. 2022Improving Adversarial Transferability via Neuron Attribution-Based Attackscited by 93
  37. 2019Cross-Domain Transferability of Adversarial Perturbationscited by 92
  38. 2020On Success and Simplicity: A Second Look at Transferable Targeted Attackscited by 89

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 3.

7 papers.