ARBiBench: Benchmarking Adversarial Robustness of Binarized Neural Networks
Not on the map. Why?
Abstract (arXiv)
Network binarization exhibits great potential for deployment on resource-constrained devices due to its low computational cost. Despite the critical importance, the security of binarized neural networks (BNNs) is rarely investigated. In this paper, we present ARBiBench, a comprehensive benchmark to evaluate the robustness of BNNs against adversarial perturbations on CIFAR-10 and ImageNet. We first evaluate the robustness of seven influential BNNs on various white-box and black-box attacks. The results reveal that 1) The adversarial robustness of BNNs exhibits a completely opposite performance on the two datasets under white-box attacks. 2) BNNs consistently exhibit better adversarial robustness under black-box attacks. 3) Different BNNs exhibit certain similarities in their robustness performance. Then, we conduct experiments to analyze the adversarial robustness of BNNs based on these insights. Our research contributes to inspiring future research on enhancing the robustness of BNNs and advancing their application in real-world scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 68 of its 83 references that are in the map. First posted on arXiv 21 Dec 2023.
Builds on
68 of 83 references.
References · 68
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
38 more
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,510
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2018Obfuscated Gradients Give a False Sense of Security: Circumventing Defenses to Adversarial Examplescited by 1,259
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 833
- 2016XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networkscited by 829
- 2017Channel Pruning for Accelerating Very Deep Neural Networkscited by 697
- 2019Square Attack: a query-efficient black-box adversarial attack via random searchcited by 682
- 2020RobustBench: a standardized adversarial robustness benchmarkcited by 659
- 2019Learned Step Size Quantizationcited by 604
- 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 591
- 2016DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradientscited by 557
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 484
- 2017Decision-Based Adversarial Attacks: Reliable Attacks Against Black-Box Machine Learning Modelscited by 459
- 2018PACT: Parameterized Clipping Activation for Quantized Neural Networkscited by 456
- 2019Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attackscited by 440
- 2018Deep Learning for Generic Object Detection: A Surveycited by 392
- 2017Mitigating Adversarial Effects Through Randomizationcited by 382
- 2019Nesterov Accelerated Gradient and Scale Invariance for Adversarial Attackscited by 352
- 2018Certified Defenses against Adversarial Examplescited by 305
- 2014Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluationcited by 304
- 2014Speeding up Convolutional Neural Networks with Low Rank Expansionscited by 283
- 2017Detecting Adversarial Samples from Artifactscited by 244
- 2018Bi-Real Net: Enhancing the Performance of 1-bit CNNs With Improved Representational Capability and Advanced Training Algorithmcited by 233
- 2018Adversarial Risk and the Dangers of Evaluating Against Weak Attackscited by 221
- 2019Improving Adversarial Robustness via Promoting Ensemble Diversitycited by 213
- 2015Quantized Convolutional Neural Networks for Mobile Devicescited by 212
- 2016A study of the effect of JPG compression on adversarial imagescited by 196
- 2014Compressing Deep Convolutional Networks using Vector Quantizationcited by 189
- 2019Low-bit Quantization of Neural Networks for Efficient Inferencecited by 185
- 2020ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functionscited by 183
- 2019Efficient Decision-based Black-box Adversarial Attacks on Face Recognitioncited by 173
- 2019Forward and Backward Information Retention for Accurate Binary Neural Networkscited by 169
- 2020Training Binary Neural Networks with Real-to-Binary Convolutionscited by 111
- 2019Defensive Quantization: When Efficiency Meets Robustnesscited by 95
- 2019NATTACK: Learning the Distributions of Adversarial Examples for an Improved Black-Box Attack on Deep Neural Networkscited by 94
- 2019XNOR-Net++: Improved Binary Neural Networkscited by 94
- 2019Wasserstein Adversarial Examples via Projected Sinkhorn Iterationscited by 89
50 most cited of 68 All 68 (JSON)
Built on by
Not cited yet.