Maximal Brain Damage Without Data or Optimization: Disrupting Neural Networks via Sign-Bit Flips
Not on the map. Why?
Abstract (arXiv)
Deep Neural Networks (DNNs) can be catastrophically disrupted by flipping only a handful of parameter bits. We introduce Deep Neural Lesion (DNL), a data-free and optimizationfree method that locates critical parameters, and an enhanced single-pass variant, 1P-DNL, that refines this selection with one forward and backward pass on random inputs. We show that this vulnerability spans multiple domains, including image classification, object detection, instance segmentation, and reasoning large language models. In image classification, flipping just two sign bits in ResNet-50 on ImageNet reduces accuracy by 99.8%. In object detection and instance segmentation, one or two sign flips in the backbone collapse COCO detection and mask AP for Mask R-CNN and YOLOv8-seg models. In language modeling, two sign flips into different experts reduce Qwen3-30B-A3B-Thinking from 78% to 0% accuracy. We also show that selectively protecting a small fraction of vulnerable sign bits provides a practical defense against such attacks.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 43 of its 79 references that are in the map. First posted on arXiv 11 Feb 2025.
Builds on
43 of 79 references.
References · 43
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Mask R-CNNcited by 7,259
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
31 more
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2013Describing Textures in the Wildcited by 2,110
- 2019Searching for MobileNetV3cited by 1,984
- 2013Fine-Grained Visual Classification of Aircraftcited by 1,701
- 2014How transferable are features in deep neural networks?cited by 1,216
- 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,132
- 2020Designing Network Design Spacescited by 954
- 2018SNIP: Single-shot Network Pruning based on Connection Sensitivitycited by 802
- 2018Rethinking the Value of Network Pruningcited by 595
- 2020Pruning neural networks without any data by iteratively conserving synaptic flowcited by 475
- 2020Picking Winning Tickets Before Training by Preserving Gradient Flowcited by 467
- 2018HAQ: Hardware-Aware Automated Quantization with Mixed Precisioncited by 426
- 2018Lipschitz regularity of deep neural networks: analysis and efficient estimationcited by 413
- 2018Regularisation of Neural Networks by Enforcing Lipschitz Continuitycited by 311
- 2019HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networkscited by 250
- 2020ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functionscited by 183
- 2019Bit-Flip Attack: Crushing Neural Network with Progressive Bit Searchcited by 106
- 2021Adversarial Sticker: A Stealthy Attack Method in the Physical Worldcited by 92
- 2019Terminal Brain Damage: Exposing the Graceless Degradation in Deep Neural Networks Under Hardware Fault Attackscited by 55
- 2020DeepHammer: Depleting the Intelligence of Deep Neural Networks through Targeted Chain of Bit Flipscited by 53
- 2021ReCU: Reviving the Dead Weights in Binary Neural Networkscited by 51
- 2021RA-BNN: Constructing Robust & Accurate Binary Neural Network to Simultaneously Defend Adversarial Bit-Flip Attack and Improve Accuracycited by 11
- 2018Nethammer: Inducing Rowhammer Faults through Network Requestscited by 7
- 2022Bimodal Distributed Binarized Neural Networkscited by 4
- 2021ZeBRA: Precisely Destroying Neural Networks with Zero-Data Based Repeated Bit Flip Attackcited by 3
- 2024DeepNcode: Encoding-Based Protection against Bit-Flip Attacks on Neural Networkscited by 3
- 2024Harden Deep Neural Networks Against Fault Injections Through Weight Scalingcited by 2
- 2021BDFA: A Blind Data Adversarial Bit-flip Attack on Deep Neural Networkscited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025CARES: Context-Aware Resolution Selector for VLMscited by 5
- 2025Benchmarking Adversarial Patch Selection and Locationcited by 1
- 2025How a Bit Becomes a Story: Semantic Steering via Differentiable Fault Injectioncited by 0
- 2026Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerabilitycited by 0
- 2026Bit-Flip Attacks on Vision-Language-Action Models: Action-Decoding Architecture Shapes the Vulnerability16 Aug 2026
- 2025How a Bit Becomes a Story: Semantic Steering via Differentiable Fault Injection9 Dec 2025
- 2025CARES: Context-Aware Resolution Selector for VLMs22 Oct 2025
- 2025Benchmarking Adversarial Patch Selection and Location3 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2024Improving Alignment and Robustness with Circuit Breakers
- 2026From Bit-Position Sensitivity to Unequal Error Protection for DNN Inference Memory
- 2024PrisonBreak: Jailbreaking Large Language Models with at Most Twenty-Five Targeted Bit-flips
- 2025Adversarial Robustness Analysis of Vision-Language Models in Medical Image Segmentation
- 2026Why Training-Free Token Reduction Collapses: The Inherent Instability of Pairwise Scoring Signals
- 2022DDDM: a Brain-Inspired Framework for Robust Classification
- 2026Neural Gate: Mitigating Privacy Risks in LVLMs via Neuron-Level Gradient Gating
- 2025Do Vision-Language Models Leak What They Learn? Adaptive Token-Weighted Model Inversion Attacks