mlsanityData to 7 Oct 2026

Maximal Brain Damage Without Data or Optimization: Disrupting Neural Networks via Sign-Bit Flips

arXiv 2502.07408 ↗First posted 11 Feb 2025cs.LG cs.AI cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Deep Neural Networks (DNNs) can be catastrophically disrupted by flipping only a handful of parameter bits. We introduce Deep Neural Lesion (DNL), a data-free and optimizationfree method that locates critical parameters, and an enhanced single-pass variant, 1P-DNL, that refines this selection with one forward and backward pass on random inputs. We show that this vulnerability spans multiple domains, including image classification, object detection, instance segmentation, and reasoning large language models. In image classification, flipping just two sign bits in ResNet-50 on ImageNet reduces accuracy by 99.8%. In object detection and instance segmentation, one or two sign flips in the backbone collapse COCO detection and mask AP for Mask R-CNN and YOLOv8-seg models. In language modeling, two sign flips into different experts reduce Qwen3-30B-A3B-Thinking from 78% to 0% accuracy. We also show that selectively protecting a small fraction of vulnerable sign bits provides a practical defense against such attacks.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 43 of its 79 references that are in the map. First posted on arXiv 11 Feb 2025.

Builds on

43 of 79 references.

References · 43

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  7. 2017Mask R-CNNcited by 7,259
  8. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  9. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  10. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  11. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  12. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
31 more
  1. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  2. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  3. 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
  4. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  5. 2013Describing Textures in the Wildcited by 2,110
  6. 2019Searching for MobileNetV3cited by 1,984
  7. 2013Fine-Grained Visual Classification of Aircraftcited by 1,701
  8. 2014How transferable are features in deep neural networks?cited by 1,216
  9. 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,132
  10. 2020Designing Network Design Spacescited by 954
  11. 2018SNIP: Single-shot Network Pruning based on Connection Sensitivitycited by 802
  12. 2018Rethinking the Value of Network Pruningcited by 595
  13. 2020Pruning neural networks without any data by iteratively conserving synaptic flowcited by 475
  14. 2020Picking Winning Tickets Before Training by Preserving Gradient Flowcited by 467
  15. 2018HAQ: Hardware-Aware Automated Quantization with Mixed Precisioncited by 426
  16. 2018Lipschitz regularity of deep neural networks: analysis and efficient estimationcited by 413
  17. 2018Regularisation of Neural Networks by Enforcing Lipschitz Continuitycited by 311
  18. 2019HAWQ-V2: Hessian Aware trace-Weighted Quantization of Neural Networkscited by 250
  19. 2020ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functionscited by 183
  20. 2019Bit-Flip Attack: Crushing Neural Network with Progressive Bit Searchcited by 106
  21. 2021Adversarial Sticker: A Stealthy Attack Method in the Physical Worldcited by 92
  22. 2019Terminal Brain Damage: Exposing the Graceless Degradation in Deep Neural Networks Under Hardware Fault Attackscited by 55
  23. 2020DeepHammer: Depleting the Intelligence of Deep Neural Networks through Targeted Chain of Bit Flipscited by 53
  24. 2021ReCU: Reviving the Dead Weights in Binary Neural Networkscited by 51
  25. 2021RA-BNN: Constructing Robust & Accurate Binary Neural Network to Simultaneously Defend Adversarial Bit-Flip Attack and Improve Accuracycited by 11
  26. 2018Nethammer: Inducing Rowhammer Faults through Network Requestscited by 7
  27. 2022Bimodal Distributed Binarized Neural Networkscited by 4
  28. 2021ZeBRA: Precisely Destroying Neural Networks with Zero-Data Based Repeated Bit Flip Attackcited by 3
  29. 2024DeepNcode: Encoding-Based Protection against Bit-Flip Attacks on Neural Networkscited by 3
  30. 2024Harden Deep Neural Networks Against Fault Injections Through Weight Scalingcited by 2
  31. 2021BDFA: A Blind Data Adversarial Bit-flip Attack on Deep Neural Networkscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Improving Alignment and Robustness with Circuit Breakers
  2. 2026From Bit-Position Sensitivity to Unequal Error Protection for DNN Inference Memory
  3. 2024PrisonBreak: Jailbreaking Large Language Models with at Most Twenty-Five Targeted Bit-flips
  4. 2025Adversarial Robustness Analysis of Vision-Language Models in Medical Image Segmentation
  5. 2026Why Training-Free Token Reduction Collapses: The Inherent Instability of Pairwise Scoring Signals
  6. 2022DDDM: a Brain-Inspired Framework for Robust Classification
  7. 2026Neural Gate: Mitigating Privacy Risks in LVLMs via Neuron-Level Gradient Gating
  8. 2025Do Vision-Language Models Leak What They Learn? Adaptive Token-Weighted Model Inversion Attacks