Square Attack: a query-efficient black-box adversarial attack via random search
Not on the map. Why?
Cited by 21 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We propose the Square Attack, a score-based black-box l2- and l_∞-adversarial attack that does not rely on local gradient information and thus is not affected by gradient masking. Square Attack is based on a randomized search scheme which selects localized square-shaped updates at random positions so that at each iteration the perturbation is situated approximately at the boundary of the feasible set. Our method is significantly more query efficient and achieves a higher success rate compared to the state-of-the-art methods, especially in the untargeted setting. In particular, on ImageNet we improve the average query efficiency in the untargeted setting for various deep networks by a factor of at least 1.8 and up to 3 compared to the recent state-of-the-art l_∞-attack of Al-Dujaili & O'Reilly. Moreover, although our attack is black-box, it can also outperform gradient-based white-box attacks on the standard benchmarks achieving a new state-of-the-art in terms of the success rate. The code of our attack is available at https://github.com/max-andr/square-attack.
Key facts. Cited by 682 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 98; 2022: 112; 2023: 156; 2024: 137; 2025: 120; 2026: 59.
682 papers.
Sort:
By area:
- 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 450
- 2021Fixing Data Augmentation to Improve Adversarial Robustnesscited by 201
- 2021Data Augmentation Can Improve Robustnesscited by 193
- 2021Are Transformers More Robust Than CNNs?cited by 187
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
- 2023Open Sesame! Universal Black Box Jailbreaking of Large Language Modelscited by 128
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2023Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Datacited by 119
- 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesiscited by 114
- 2022KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradientscited by 95
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 94
- 2023Diffusion Models for Imperceptible and Transferable Adversarial Attackcited by 93
38 more
- 2021Adversarial Sticker: A Stealthy Attack Method in the Physical Worldcited by 92
- 2021Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attackscited by 91
- 2022Untargeted Backdoor Watermark: Towards Harmless and Stealthy Dataset Copyright Protectioncited by 80
- 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detectioncited by 79
- 2023Revisiting Adversarial Training for ImageNet: Architectures, Training and Generalization across Threat Modelscited by 79
- 2021RobustART: Benchmarking Robustness on Architecture Design and Training Techniquescited by 78
- 2021Revisiting Adversarial Robustness Distillation: Robust Soft Labels Make Student Bettercited by 77
- 2023A Pilot Study of Query-Free Adversarial Attack against Stable Diffusioncited by 75
- 2021On Improving Adversarial Transferability of Vision Transformerscited by 70
- 2022Black-box Prompt Learning for Pre-trained Language Modelscited by 70
- 2023Robust Evaluation of Diffusion-Based Adversarial Purificationcited by 65
- 2023How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defensescited by 65
- 2022Evaluating the Adversarial Robustness of Adaptive Test-time Defensescited by 64
- 2022A Light Recipe to Train Robust Vision Transformerscited by 64
- 2022When Adversarial Training Meets Vision Transformers: Recipes from Training to Architecturecited by 64
- 2023Black Box Adversarial Prompting for Foundation Modelscited by 62
- 2023Structure Invariant Transformation for better Adversarial Transferabilitycited by 61
- 2023A Unified Algebraic Perspective on Lipschitz Neural Networkscited by 58
- 2021Exploring Memorization in Adversarial Trainingcited by 55
- 2022A Large-scale Multiple-objective Method for Black-box Attack against Object Detectioncited by 55
- 2021Adversarial Example Detection for DNN Models: A Review and Experimental Comparisoncited by 51
- 2021Mind the box: l1-APGD for sparse adversarial attacks on image classifierscited by 50
- 2022Understanding Robust Overfitting of Adversarial Training and Beyondcited by 50
- 2022Shape-invariant 3D Adversarial Point Cloudscited by 49
- 2022Improving the Transferability of Targeted Adversarial Examples through Object-Based Diverse Inputcited by 49
- 2021Adversarial Attacks are Reversible with Natural Supervisioncited by 47
- 2022Patch-Fool: Are Vision Transformers Always Robust Against Adversarial Perturbations?cited by 47
- 2023Adversarial Counterfactual Visual Explanationscited by 47
- 2021Random Noise Defense Against Query-Based Black-Box Attackscited by 46
- 2021Detecting Adversarial Examples Is (Nearly) As Hard As Classifying Themcited by 46
- 2022A Survey of Robust Adversarial Training in Pattern Recognition: Fundamental, Theory, and Methodologiescited by 44
- 2021Reveal of Vision Transformers Robustness against Adversarial Attackscited by 43
- 2022Efficient and Effective Augmentation Strategy for Adversarial Trainingcited by 43
- 2022Enhancing Adversarial Training with Second-Order Statistics of Weightscited by 42
- 2023Hijacking Large Language Models via Adversarial In-Context Learningcited by 41
- 2021Boosting Fast Adversarial Training with Learnable Adversarial Initializationcited by 40
- 2022Self-Ensemble Adversarial Training for Improved Robustnesscited by 38
- 2023Improving the Transferability of Adversarial Samples by Path-Augmented Methodcited by 36
50 most cited of 682 All 682 (JSON)
- 2026Localisation-Aware Uncertainty for Pretrained Object Detection1 Oct 2026
- 2026LogiC-Diff: Embedding Security Properties Into AI-Enabled Cyber-Physical Systems29 Sep 2026
- 2026One Attack to Fool Them All: Highly Transferable Black-Box Adversarial Attacks on Frontier MLLMs27 Sep 2026
- 2026Reinforcement Learning Inspired Black-box Adversarial Attacks for Computer Vision21 Sep 2026
- 2026Neither Adversarial Training Nor Purification: Emergent Adversarial Robustness from Oscillatory Predictive Learning8 Sep 2026
- 2026Adversarial Training Without Input Gradients via Low-Rank Householder Expansions27 Aug 2026
- 2026FraudBench: Protocol-Sensitive Benchmarking of Adversarial Robustness for Financial Risk Assessment25 Aug 2026
- 2026Large-scale Testing Global Optimization Methods with Black-box Adversarial Attacks13 Aug 2026
- 2026A Convolutional Layer Activation Dimensionality Reduction for Out-of-Distribution and Adversarial Attack Detection Methods10 Aug 2026
- 2026TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectors28 Jul 2026
- 2026Reasoning as a Double-Edged Sword: Architecture and Cross-Stage Robustness in Vision-Language-Action Models20 Jul 2026
- 2026ARMOR++: Agentic Orchestration of a Multi-Domain Primitive Set for Transferable Attacks on Deepfake Detectors16 Jul 2026
38 more
- 2026Random Logit Scaling: Defending Deep Neural Networks Against Black-Box Score-Based Adversarial Example Attacks16 Jul 2026
- 2026Reducing information dependency does not cause training data privacy. Adversarially non-robust features do14 Jul 2026
- 2026Defending from GeoLocalization through Adversarial Road Trips3 Jul 2026
- 2026Beyond Gradient-Based Attacks: Adversarial Robustness and Explainability Stability in Cybersecurity Classifiers2 Jul 2026
- 2026A Classifier-Agnostic Zero-Shot Adversarial Attack Detection via CLIP29 Jun 2026
- 2026USAD: Uncertainty-aware Statistical Adversarial Detection26 Jun 2026
- 2026Black-Box Continual Learning for Vision-Language Models22 Jun 2026
- 2026CITADEL: CSI-Based Jamming Detection and Open-Set Classification for IIoT Networks22 Jun 2026
- 2026LambdaMark: Semantic Audio Watermarking for Robustness and Radioactivity19 Jun 2026
- 2026Budget-Aware Adaptive Adversarial Patches for Black-Box Object Detection16 Jun 2026
- 2026ARB4WM: An Adversarial Robustness Benchmark for World Models in Continuous Control15 Jun 2026
- 2026Reinforcement Learning Disrupts Gradient-Based Adversarial Optimization10 Jun 2026
- 2026SoK: Colluding Adversaries in Machine Learning Pipelines8 Jun 2026
- 2026SS-TPT: Stability and Suitability-Guided Test-Time Prompt Tuning for Adversarially Robust Vision-Language Models5 Jun 2026
- 2026When CLIP Sees More, It Fights Back Harder: Multi-View Guided Adaptive Counterattacks for Test-Time Adversarial Robustness5 Jun 2026
- 2026Adaptive Causal Alignment for High-Confidence Adversarial Training2 Jun 2026
- 2026Sensitivity as a Double-Edged Sword: A Trade-off Between Discriminability and Adversarial Robustness1 Jun 2026
- 2026Test-Time Collective Action: Proxy-Based Perturbations for Correcting Algorithmic Harms26 May 2026
- 2026Opportunistic Target Selection: Early Directional Commitment for Query-Efficient Black-Box Adversarial Attacks25 May 2026
- 2026WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agents22 May 2026
- 2026SDM: A Powerful Tool for Evaluating Model Robustness19 May 2026
- 2026Threats to Arabic Handwriting Recognition: Investigating Black-Box Adversarial Attacks on embedded ConvNet models18 May 2026
- 2026DarkLLM: Learning Language-Driven Adversarial Attacks with Large Language Models15 May 2026
- 2026Streaming Adversarial Robustness in Fuzzy ARTMAP: Mechanism-Aligned Evaluation, Progressive Training, and Interpretable Diagnostics7 May 2026
- 2026Low Rank Adaptation for Adversarial Perturbation30 Apr 2026
- 2026Mitigating Error Amplification in Fast Adversarial Training27 Apr 2026
- 2026Mechanistic Anomaly Detection via Functional Attribution21 Apr 2026
- 2026Zeroth-Order Optimization at the Edge of Stability16 Apr 2026
- 2026Learning Robustness at Test-Time from a Non-Robust Teacher13 Apr 2026
- 2026QShield: Securing Neural Networks Against Adversarial Attacks using Quantum Circuits13 Apr 2026
- 2026Are GUI Agents Focused Enough? Automated Distraction via Semantic-level UI Element Injection9 Apr 2026
- 2026Revealing Physical-World Semantic Vulnerabilities: Universal Adversarial Patch for Infrared Vision-Language Models3 Apr 2026
- 2026Emotion Diffusion Classifier with Adaptive Margin Discrepancy Training for Facial Expression Recognition31 Mar 2026
- 2026A Provable Energy-Guided Test-Time Defense Boosting Adversarial Robustness of Large Vision-Language Models27 Mar 2026
- 2026NERO-Net: A Neuroevolutionary Approach for the Design of Adversarially Robust CNNs26 Mar 2026
- 2026AdvSplat: Adversarial Attacks on Feed-Forward Gaussian Splatting Models24 Mar 2026
- 2026Contract And Conquer: How to Provably Compute Adversarial Examples for a Black-Box Model?11 Mar 2026
- 2026S2O: Enhancing Adversarial Training with Second-Order Statistics of Weights1 Mar 2026
50 newest of 682 All 682 (JSON)
- 2023Anti-DreamBooth: Protecting users from personalized text-to-image synthesiscited by 114
- 2023Diffusion Models for Imperceptible and Transferable Adversarial Attackcited by 93
- 2023A Pilot Study of Query-Free Adversarial Attack against Stable Diffusioncited by 75
- 2023Adversarial Counterfactual Visual Explanationscited by 47
- 2023DiffAttack: Evasion Attacks Against Diffusion-Based Adversarial Purificationcited by 36
- 2024ADBM: Adversarial diffusion bridge model for reliable adversarial purificationcited by 24
- 2023Defending against Adversarial Audio via Diffusion Modelcited by 20
- 2023Purify++: Improving Diffusion-Purification with Advanced Diffusion Models and Control of Randomnesscited by 13
- 2023Towards Prompt-robust Face Privacy Protection via Adversarial Decoupling Augmentation Frameworkcited by 9
- 2024Adversarially Robust Industrial Anomaly Detection Through Diffusion Modelcited by 3
- 2023DiffDefense: Defending against Adversarial Attacks via Diffusion Modelscited by 2
- 2024FoolSDEdit: Deceptively Steering Your Edits Towards Targeted Attribute-aware Distributioncited by 2
12 most cited of 19 All 19 (JSON)
- 2026TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectors28 Jul 2026
- 2026Emotion Diffusion Classifier with Adaptive Margin Discrepancy Training for Facial Expression Recognition31 Mar 2026
- 2025TAIGen: Training-Free Adversarial Image Generation via Diffusion Models20 Aug 2025
- 2025Canonical Latent Representations in Conditional Diffusion Models11 Jun 2025
- 2025Defending Against Frequency-Based Attacks with Diffusion Models15 Apr 2025
- 2024Adversarially Robust Industrial Anomaly Detection Through Diffusion Model9 Aug 2024
- 2024ADBM: Adversarial diffusion bridge model for reliable adversarial purification1 Aug 2024
- 2024Struggle with Adversarial Defense? Try Diffusion12 Apr 2024
- 2024FoolSDEdit: Deceptively Steering Your Edits Towards Targeted Attribute-aware Distribution6 Feb 2024
- 2024Adversarial Examples are Misaligned in Diffusion Model Manifolds12 Jan 2024
- 2023Purify++: Improving Diffusion-Purification with Advanced Diffusion Models and Control of Randomness28 Oct 2023
- 2023DiffAttack: Evasion Attacks Against Diffusion-Based Adversarial Purification27 Oct 2023
12 newest of 19 All 19 (JSON)
- 2025R-TPT: Improving Adversarial Robustness of Vision-Language Models through Test-Time Prompt Tuningcited by 33
- 2025X-Transfer Attacks: Towards Super Transferable Adversarial Attacks on CLIPcited by 21
- 2023MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustnesscited by 12
- 2024Enhancing Adversarial Robustness of Vision-Language Models through Low-Rank Adaptationcited by 8
- 2025Evolution-based Region Adversarial Prompt Learning for Robustness Enhancement in Vision-Language Modelscited by 6
- 2023Fast Certification of Vision-Language Models Using Incremental Randomized Smoothingcited by 4
- 2025Self-Calibrated Consistency can Fight Back for Adversarial Robustness in Vision-Language Modelscited by 3
- 2025EigenShield: Causal Subspace Filtering via Random Matrix Theory for Adversarially Robust Vision-Language Modelscited by 2
- 2025Q-MLLM: Vector Quantization for Robust Multimodal Large Language Model Securitycited by 2
- 2026A Provable Energy-Guided Test-Time Defense Boosting Adversarial Robustness of Large Vision-Language Modelscited by 1
- 2026When CLIP Sees More, It Fights Back Harder: Multi-View Guided Adaptive Counterattacks for Test-Time Adversarial Robustnesscited by 1
- 2025MoAPT: Mixture of Adversarial Prompt Tuning for Vision-Language Modelscited by 0
12 most cited of 16 All 16 (JSON)
- 2026Black-Box Continual Learning for Vision-Language Models22 Jun 2026
- 2026SS-TPT: Stability and Suitability-Guided Test-Time Prompt Tuning for Adversarially Robust Vision-Language Models5 Jun 2026
- 2026When CLIP Sees More, It Fights Back Harder: Multi-View Guided Adaptive Counterattacks for Test-Time Adversarial Robustness5 Jun 2026
- 2026Revealing Physical-World Semantic Vulnerabilities: Universal Adversarial Patch for Infrared Vision-Language Models3 Apr 2026
- 2026A Provable Energy-Guided Test-Time Defense Boosting Adversarial Robustness of Large Vision-Language Models27 Mar 2026
- 2025Q-MLLM: Vector Quantization for Robust Multimodal Large Language Model Security20 Nov 2025
- 2025Self-Calibrated Consistency can Fight Back for Adversarial Robustness in Vision-Language Models26 Oct 2025
- 2025Coordinated Robustness Evaluation Framework for Vision-Language Models5 Jun 2025
- 2025MoAPT: Mixture of Adversarial Prompt Tuning for Vision-Language Models23 May 2025
- 2025X-Transfer Attacks: Towards Super Transferable Adversarial Attacks on CLIP8 May 2025
- 2025R-TPT: Improving Adversarial Robustness of Vision-Language Models through Test-Time Prompt Tuning15 Apr 2025
- 2025Evolution-based Region Adversarial Prompt Learning for Robustness Enhancement in Vision-Language Models17 Mar 2025
12 newest of 16 All 16 (JSON)
- 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 450
- 2023Open Sesame! Universal Black Box Jailbreaking of Large Language Modelscited by 128
- 2023Black Box Adversarial Prompting for Foundation Modelscited by 62
- 2023Hijacking Large Language Models via Adversarial In-Context Learningcited by 41
- 2021ML Attack Models: Adversarial Attacks and Data Poisoning Attackscited by 23
- 2022Versatile Weight Attack via Flipping Limited Bitscited by 13
- 2024OSLO: One-Shot Label-Only Membership Inference Attackscited by 11
- 2023Backdoor Attacks with Input-unique Triggers in NLPcited by 10
- 2023Data Redaction from Conditional Generative Modelscited by 8
- 2024AI-generated Image Detection: Passive or Watermark?cited by 7
- 2025Black-box Optimization of LLM Outputs by Asking for Directionscited by 7
- 2025Unified Prompt Attack Against Text-to-Image Generation Modelscited by 5
12 most cited of 16 All 16 (JSON)
- 2026Mechanistic Anomaly Detection via Functional Attribution21 Apr 2026
- 2025Black-box Optimization of LLM Outputs by Asking for Directions19 Oct 2025
- 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessment12 Aug 2025
- 2025Unified Prompt Attack Against Text-to-Image Generation Models23 Feb 2025
- 2024Red-Teaming Text-to-Image Models via In-Context Experience Replay and Semantic-Preserving Prompt Rewriting25 Nov 2024
- 2024AI-generated Image Detection: Passive or Watermark?20 Nov 2024
- 2024Accurate Forgetting for All-in-One Image Restoration Model1 Sep 2024
- 2024OSLO: One-Shot Label-Only Membership Inference Attacks27 May 2024
- 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks2 Apr 2024
- 2023Hijacking Large Language Models via Adversarial In-Context Learning16 Nov 2023
- 2023Open Sesame! Universal Black Box Jailbreaking of Large Language Models4 Sep 2023
- 2023Data Redaction from Conditional Generative Models18 May 2023
12 newest of 16 All 16 (JSON)
- 2023Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Datacited by 119
- 2025TRAP: Targeted Redirecting of Agentic Preferencescited by 4
- 2026ARMOR: Agentic Reasoning for Methods Orchestration and Reparameterization for Robust Adversarial Attackscited by 1
- 2026Reasoning as a Double-Edged Sword: Architecture and Cross-Stage Robustness in Vision-Language-Action Modelscited by 0
- 2026Reasoning as a Double-Edged Sword: Architecture and Cross-Stage Robustness in Vision-Language-Action Models20 Jul 2026
- 2026ARMOR: Agentic Reasoning for Methods Orchestration and Reparameterization for Robust Adversarial Attacks26 Jan 2026
- 2025TRAP: Targeted Redirecting of Agentic Preferences29 May 2025
- 2023Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data24 Feb 2023
- 2021Fixing Data Augmentation to Improve Adversarial Robustnesscited by 201
- 2021Data Augmentation Can Improve Robustnesscited by 193
- 2021Are Transformers More Robust Than CNNs?cited by 187
- 2021AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehiclescited by 132
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 94
- 2021Adversarial Sticker: A Stealthy Attack Method in the Physical Worldcited by 92
- 2021Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attackscited by 91
- 2022Untargeted Backdoor Watermark: Towards Harmless and Stealthy Dataset Copyright Protectioncited by 80
- 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detectioncited by 79
- 2023Revisiting Adversarial Training for ImageNet: Architectures, Training and Generalization across Threat Modelscited by 79
- 2021RobustART: Benchmarking Robustness on Architecture Design and Training Techniquescited by 78
12 most cited of 620 All 620 (JSON)
- 2026Localisation-Aware Uncertainty for Pretrained Object Detection1 Oct 2026
- 2026LogiC-Diff: Embedding Security Properties Into AI-Enabled Cyber-Physical Systems29 Sep 2026
- 2026One Attack to Fool Them All: Highly Transferable Black-Box Adversarial Attacks on Frontier MLLMs27 Sep 2026
- 2026Reinforcement Learning Inspired Black-box Adversarial Attacks for Computer Vision21 Sep 2026
- 2026Neither Adversarial Training Nor Purification: Emergent Adversarial Robustness from Oscillatory Predictive Learning8 Sep 2026
- 2026Adversarial Training Without Input Gradients via Low-Rank Householder Expansions27 Aug 2026
- 2026FraudBench: Protocol-Sensitive Benchmarking of Adversarial Robustness for Financial Risk Assessment25 Aug 2026
- 2026Large-scale Testing Global Optimization Methods with Black-box Adversarial Attacks13 Aug 2026
- 2026A Convolutional Layer Activation Dimensionality Reduction for Out-of-Distribution and Adversarial Attack Detection Methods10 Aug 2026
- 2026Random Logit Scaling: Defending Deep Neural Networks Against Black-Box Score-Based Adversarial Example Attacks16 Jul 2026
- 2026Reducing information dependency does not cause training data privacy. Adversarially non-robust features do14 Jul 2026
- 2026Defending from GeoLocalization through Adversarial Road Trips3 Jul 2026
12 newest of 620 All 620 (JSON)