Guessing Smart: Biased Sampling for Efficient Black-Box Adversarial Attacks
Not on the map. Why?
Abstract (arXiv)
We consider adversarial examples for image classification in the black-box decision-based setting. Here, an attacker cannot access confidence scores, but only the final label. Most attacks for this scenario are either unreliable or inefficient. Focusing on the latter, we show that a specific class of attacks, Boundary Attacks, can be reinterpreted as a biased sampling framework that gains efficiency from domain knowledge. We identify three such biases, image frequency, regional masks and surrogate gradients, and evaluate their performance against an ImageNet classifier. We show that the combination of these biases outperforms the state of the art by a wide margin. We also showcase an efficient way to attack the Google Cloud Vision API, where we craft convincing perturbations with just a few hundred queries. Finally, the methods we propose have also been found to work very well against strong defenses: Our targeted attack won second place in the NeurIPS 2018 Adversarial Vision Challenge.
Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 6; 2023: 12; 2024: 6; 2025: 7; 2026: 1.
46 papers.
Sort:
By area:
- 2021Improving Robustness using Generated Datacited by 233
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Adversarial Attacks On Multi-Agent Communicationcited by 48
- 2022Query-Efficient Black-box Adversarial Attacks Guided by a Transfer-based Priorcited by 38
- 2021A Review of Adversarial Attack and Defense for Classification Methodscited by 29
- 2021On the Convergence of Prior-Guided Zeroth-Order Optimization Algorithmscited by 23
- 2021QAIR: Practical Query-efficient Black-Box Attacks for Image Retrievalcited by 22
- 2023CGBA: Curvature-aware Geometric Black-box Attackcited by 20
- 2023Physical Adversarial Attacks For Camera-based Smart Systems: Current Trends, Categorization, Applications, Research Challenges, and Future Outlookcited by 20
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2022Attacking deep networks with surrogate-based adversarial black-box methods is easycited by 18
- 2021Decision-based Black-box Attack Against Vision Transformers via Patch-wise Adversarial Removalcited by 16
34 more
- 2021Attack as the Best Defense: Nullifying Image-to-image Translation GANs via Limit-aware Adversarial Attackcited by 15
- 2023Evading Black-box Classifiers Without Breaking Eggscited by 13
- 2021Finding Optimal Tangent Points for Reducing Distortions of Hard-label Attackscited by 11
- 2021RamBoAttack: A Robust Query Efficient Deep Neural Network Decision Exploitcited by 11
- 2024Hard-label based Small Query Black-box Adversarial Attackcited by 10
- 2021Black-box Adversarial Attacks in Autonomous Vehicle Technologycited by 9
- 20233DHacker: Spectrum-based Decision Boundary Generation for Hard-label 3D Point Cloud Attackcited by 9
- 2023Threatening Patch Attacks on Object Detection in Optical Remote Sensing Imagescited by 8
- 2024BruSLeAttack: A Query-Efficient Score-Based Black-Box Sparse Adversarial Attackcited by 7
- 2024ADBA:Approximation Decision Boundary Approach for Black-Box Adversarial Attackscited by 7
- 2025Black-box Optimization of LLM Outputs by Asking for Directionscited by 7
- 2023SoK: Pitfalls in Evaluating Black-Box Attackscited by 6
- 2023Certifiable Black-Box Attacks with Randomized Adversarial Examples: Breaking Defenses with Provable Confidencecited by 5
- 2023The Adaptive Arms Race: Redefining Robustness in AI Securitycited by 4
- 2022Universal Distributional Decision-based Black-box Adversarial Attack with Reinforcement Learningcited by 2
- 2023OMG-ATTACK: Self-Supervised On-Manifold Generation of Transferable Evasion Attackscited by 2
- 2025NoPain: No-box Point Cloud Attack via Optimal Transport Singular Boundarycited by 2
- 2025GSBAK: top-K Geometric Score-based Black-box Attackcited by 2
- 2025Adversarial Attacks Against Deep Learning-Based Radio Frequency Fingerprint Identificationcited by 2
- 2021LSDAT: Low-Rank and Sparse Decomposition for Decision-based Adversarial Attackcited by 1
- 2023Boosting Decision-Based Black-Box Adversarial Attack with Gradient Priorscited by 1
- 2025Accelerating Targeted Hard-Label Adversarial Attacks in Low-Query Black-Box Settingscited by 1
- 2025Boosting Ray Search Procedure of Hard-label Attacks with Transfer-based Priorscited by 1
- 2021Automated Decision-based Adversarial Attackscited by 0
- 2021Adversarial Attacks with Time-Scale Representationscited by 0
- 2022Art-Attack: Black-Box Adversarial Attack via Evolutionary Artcited by 0
- 2022An Efficient Multi-Step Framework for Malware Packing Identificationcited by 0
- 2022Distributed Black-box Attack: Do Not Overestimate Black-box Attackscited by 0
- 2023Decision-BADGE: Decision-based Adversarial Batch Attack with Directional Gradient Estimationcited by 0
- 2024Lp-norm Distortion-Efficient Adversarial Attackcited by 0
- 2024SemiAdv: Query-Efficient Black-Box Adversarial Attack with Unlabeled Imagescited by 0
- 2024Hard-Label Black-Box Attacks on 3D Point Cloudscited by 0
- 2025Improving the Convergence Rate of Ray Search Optimization for Query-Efficient Hard-Label Attackscited by 0
- 2026Operational Robustness of LLMs on Code Generationcited by 0
- 2026Operational Robustness of LLMs on Code Generation21 Feb 2026
- 2025Improving the Convergence Rate of Ray Search Optimization for Query-Efficient Hard-Label Attacks24 Dec 2025
- 2025Adversarial Attacks Against Deep Learning-Based Radio Frequency Fingerprint Identification12 Dec 2025
- 2025Black-box Optimization of LLM Outputs by Asking for Directions19 Oct 2025
- 2025Boosting Ray Search Procedure of Hard-label Attacks with Transfer-based Priors23 Jul 2025
- 2025Accelerating Targeted Hard-Label Adversarial Attacks in Low-Query Black-Box Settings22 May 2025
- 2025GSBAK: top-K Geometric Score-based Black-box Attack17 Mar 2025
- 2025NoPain: No-box Point Cloud Attack via Optimal Transport Singular Boundary27 Feb 2025
- 2024Hard-Label Black-Box Attacks on 3D Point Clouds30 Nov 2024
- 2024SemiAdv: Query-Efficient Black-Box Adversarial Attack with Unlabeled Images13 Jul 2024
- 2024Lp-norm Distortion-Efficient Adversarial Attack3 Jul 2024
- 2024ADBA:Approximation Decision Boundary Approach for Black-Box Adversarial Attacks7 Jun 2024
34 more
- 2024BruSLeAttack: A Query-Efficient Score-Based Black-Box Sparse Adversarial Attack8 Apr 2024
- 2024Hard-label based Small Query Black-box Adversarial Attack9 Mar 2024
- 2023The Adaptive Arms Race: Redefining Robustness in AI Security20 Dec 2023
- 2023Boosting Decision-Based Black-Box Adversarial Attack with Gradient Priors29 Oct 2023
- 2023SoK: Pitfalls in Evaluating Black-Box Attacks26 Oct 2023
- 2023OMG-ATTACK: Self-Supervised On-Manifold Generation of Transferable Evasion Attacks5 Oct 2023
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attacks1 Oct 2023
- 20233DHacker: Spectrum-based Decision Boundary Generation for Hard-label 3D Point Cloud Attack15 Aug 2023
- 2023Physical Adversarial Attacks For Camera-based Smart Systems: Current Trends, Categorization, Applications, Research Challenges, and Future Outlook11 Aug 2023
- 2023CGBA: Curvature-aware Geometric Black-box Attack6 Aug 2023
- 2023Evading Black-box Classifiers Without Breaking Eggs5 Jun 2023
- 2023Certifiable Black-Box Attacks with Randomized Adversarial Examples: Breaking Defenses with Provable Confidence10 Apr 2023
- 2023Decision-BADGE: Decision-based Adversarial Batch Attack with Directional Gradient Estimation9 Mar 2023
- 2023Threatening Patch Attacks on Object Detection in Optical Remote Sensing Images13 Feb 2023
- 2022Universal Distributional Decision-based Black-box Adversarial Attack with Reinforcement Learning15 Nov 2022
- 2022Distributed Black-box Attack: Do Not Overestimate Black-box Attacks28 Oct 2022
- 2022An Efficient Multi-Step Framework for Malware Packing Identification17 Aug 2022
- 2022Attacking deep networks with surrogate-based adversarial black-box methods is easy16 Mar 2022
- 2022Query-Efficient Black-box Adversarial Attacks Guided by a Transfer-based Prior13 Mar 2022
- 2022Art-Attack: Black-Box Adversarial Attack via Evolutionary Art7 Mar 2022
- 2021RamBoAttack: A Robust Query Efficient Deep Neural Network Decision Exploit10 Dec 2021
- 2021Decision-based Black-box Attack Against Vision Transformers via Patch-wise Adversarial Removal7 Dec 2021
- 2021A Review of Adversarial Attack and Defense for Classification Methods18 Nov 2021
- 2021Finding Optimal Tangent Points for Reducing Distortions of Hard-label Attacks15 Nov 2021
- 2021Improving Robustness using Generated Data18 Oct 2021
- 2021Attack as the Best Defense: Nullifying Image-to-image Translation GANs via Limit-aware Adversarial Attack6 Oct 2021
- 2021Advances in adversarial attacks and defenses in computer vision: A survey1 Aug 2021
- 2021Adversarial Attacks with Time-Scale Representations26 Jul 2021
- 2021On the Convergence of Prior-Guided Zeroth-Order Optimization Algorithms21 Jul 2021
- 2021Automated Decision-based Adversarial Attacks9 May 2021
- 2021LSDAT: Low-Rank and Sparse Decomposition for Decision-based Adversarial Attack19 Mar 2021
- 2021QAIR: Practical Query-efficient Black-Box Attacks for Image Retrieval4 Mar 2021
- 2021Adversarial Attacks On Multi-Agent Communication17 Jan 2021
- 2021Black-box Adversarial Attacks in Autonomous Vehicle Technology15 Jan 2021
- 2021Improving Robustness using Generated Datacited by 233
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Adversarial Attacks On Multi-Agent Communicationcited by 48
- 2022Query-Efficient Black-box Adversarial Attacks Guided by a Transfer-based Priorcited by 38
- 2021A Review of Adversarial Attack and Defense for Classification Methodscited by 29
- 2021On the Convergence of Prior-Guided Zeroth-Order Optimization Algorithmscited by 23
- 2021QAIR: Practical Query-efficient Black-Box Attacks for Image Retrievalcited by 22
- 2023CGBA: Curvature-aware Geometric Black-box Attackcited by 20
- 2023Physical Adversarial Attacks For Camera-based Smart Systems: Current Trends, Categorization, Applications, Research Challenges, and Future Outlookcited by 20
- 2023A Survey of Robustness and Safety of 2D and 3D Deep Learning Models Against Adversarial Attackscited by 19
- 2022Attacking deep networks with surrogate-based adversarial black-box methods is easycited by 18
- 2021Decision-based Black-box Attack Against Vision Transformers via Patch-wise Adversarial Removalcited by 16
12 most cited of 45 All 45 (JSON)
- 2026Operational Robustness of LLMs on Code Generation21 Feb 2026
- 2025Improving the Convergence Rate of Ray Search Optimization for Query-Efficient Hard-Label Attacks24 Dec 2025
- 2025Adversarial Attacks Against Deep Learning-Based Radio Frequency Fingerprint Identification12 Dec 2025
- 2025Boosting Ray Search Procedure of Hard-label Attacks with Transfer-based Priors23 Jul 2025
- 2025Accelerating Targeted Hard-Label Adversarial Attacks in Low-Query Black-Box Settings22 May 2025
- 2025GSBAK: top-K Geometric Score-based Black-box Attack17 Mar 2025
- 2025NoPain: No-box Point Cloud Attack via Optimal Transport Singular Boundary27 Feb 2025
- 2024Hard-Label Black-Box Attacks on 3D Point Clouds30 Nov 2024
- 2024SemiAdv: Query-Efficient Black-Box Adversarial Attack with Unlabeled Images13 Jul 2024
- 2024Lp-norm Distortion-Efficient Adversarial Attack3 Jul 2024
- 2024ADBA:Approximation Decision Boundary Approach for Black-Box Adversarial Attacks7 Jun 2024
- 2024BruSLeAttack: A Query-Efficient Score-Based Black-Box Sparse Adversarial Attack8 Apr 2024
12 newest of 45 All 45 (JSON)