Bit-Flip Attack: Crushing Neural Network with Progressive Bit Search
Not on the map. Why?
Abstract (arXiv)
Several important security issues of Deep Neural Network (DNN) have been raised recently associated with different applications and components. The most widely investigated security concern of DNN is from its malicious input, a.k.a adversarial example. Nevertheless, the security challenge of DNN's parameters is not well explored yet. In this work, we are the first to propose a novel DNN weight attack methodology called Bit-Flip Attack (BFA) which can crush a neural network through maliciously flipping extremely small amount of bits within its weight storage memory system (i.e., DRAM). The bit-flip operations could be conducted through well-known Row-Hammer attack, while our main contribution is to develop an algorithm to identify the most vulnerable bits of DNN weight parameters (stored in memory as binary bits), that could maximize the accuracy degradation with a minimum number of bit-flips. Our proposed BFA utilizes a Progressive Bit Search (PBS) method which combines gradient ranking and progressive search to identify the most vulnerable bit to be flipped. With the aid of PBS, we can successfully attack a ResNet-18 fully malfunction (i.e., top-1 accuracy degrade from 69.8% to 0.1%) only through 13 bit-flips out of 93 million bits, while randomly flipping 100 bits merely degrades the accuracy by less than 1%.
Key facts. Cited by 106 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 8; 2023: 13; 2024: 13; 2025: 21; 2026: 27.
106 papers.
Sort:
By area:
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Backdoor Scanning for Deep Neural Networks through K-Arm Optimizationcited by 96
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 63
- 2021Relating Adversarially Robust Generalization to Flat Minimacited by 57
- 2021Targeted Attack against Deep Neural Networks via Flipping Limited Weight Bitscited by 49
- 2021DeepSteal: Advanced Model Extractions Leveraging Efficient Weight Stealing in Memoriescited by 42
- 2021An Overview of Backdoor Attacks Against Deep Neural Networks and Possible Defencescited by 41
- 2021Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networkscited by 33
- 2022Energy-Latency Attacks via Sponge Poisoningcited by 29
- 2023TrojText: Test-time Invisible Textual Trojan Insertioncited by 26
- 2022Hardly Perceptible Trojan Attack against Neural Networks with Bit Flipscited by 21
- 2021Subnet Replacement: Deployment-stage backdoor attack against deep neural networks in gray-box settingcited by 20
38 more
- 2021RADAR: Run-time Adversarial Weight Attack Detection and Accuracy Recoverycited by 18
- 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
- 2023Backdoor Federated Learning by Poisoning Backdoor-Critical Layerscited by 16
- 2023NNSplitter: An Active Defense Solution for DNN Model via Automated Weight Obfuscationcited by 15
- 2023One-bit Flip is All You Need: When Bit-flip Attack Meets Model Trainingcited by 14
- 2022Versatile Weight Attack via Flipping Limited Bitscited by 13
- 2021RA-BNN: Constructing Robust & Accurate Binary Neural Network to Simultaneously Defend Adversarial Bit-Flip Attack and Improve Accuracycited by 11
- 2021AGKD-BML: Defense Against Adversarial Attack by Attention Guided Knowledge Distillation and Bi-directional Metric Learningcited by 10
- 2021BMPQ: Bit-Gradient Sensitivity Driven Mixed-Precision Quantization of DNNs from Scratchcited by 10
- 2024GenBFA: An Evolutionary Optimization Approach to Bit-Flip Attacks on LLMscited by 10
- 2021HASHTAG: Hash Signatures for Online Detection of Fault-Injection Attacks on Deep Neural Networkscited by 9
- 2025On Jailbreaking Quantized Language Models Through Fault Injection Attackscited by 8
- 2021Random and Adversarial Bit Error Robustness: Energy-Efficient and Secure DNN Acceleratorscited by 6
- 2021Don't Knock! Rowhammer at the Backdoor of DNN Modelscited by 6
- 2022Special Session: Towards an Agile Design Methodology for Efficient, Reliable, and Secure ML Systemscited by 6
- 2022A Tale of Two Models: Constructing Evasive Attacks on Edge Modelscited by 6
- 2023Machine Learning needs Better Randomness Standards: Randomised Smoothing and PRNG-based attackscited by 6
- 2021EX-RAY: Distinguishing Injected Backdoor from Natural Features in Neural Networks by Examining Differential Feature Symmetrycited by 5
- 2022A Closer Look at Evaluating the Bit-Flip Attack Against Deep Neural Networkscited by 5
- 2023Model Extraction Attacks on Split Federated Learningcited by 5
- 2023Fault Injection and Safe-Error Attack for Extraction of Embedded Neural Network Modelscited by 5
- 2024Data Free Backdoor Attackscited by 5
- 2025SBFA: Single Sneaky Bit Flip Attack to Break Large Language Modelscited by 5
- 2021Exploiting Vulnerabilities in Deep Neural Networks: Adversarial and Fault-Injection Attackscited by 4
- 2025Maximal Brain Damage Without Data or Optimization: Disrupting Neural Networks via Sign-Bit Flipscited by 4
- 2025From Centralized to Decentralized Federated Learning: Theoretical Insights, Privacy Preservation, and Robustness Challengescited by 4
- 2025Input-Triggered Hardware Trojan Attack on Spiking Neural Networkscited by 4
- 2021An Overview of Laser Injection against Embedded Neural Network Modelscited by 3
- 2021Tolerating Adversarial Attacks and Byzantine Faults in Distributed Machine Learningcited by 3
- 2021ZeBRA: Precisely Destroying Neural Networks with Zero-Data Based Repeated Bit Flip Attackcited by 3
- 2024Machine Learning in Space: Surveying the Robustness of on-board ML models to Radiationcited by 3
- 2024DeepNcode: Encoding-Based Protection against Bit-Flip Attacks on Neural Networkscited by 3
- 2024PrisonBreak: Jailbreaking Large Language Models with at Most Twenty-Five Targeted Bit-flipscited by 3
- 2025Byzantine-Resilient Federated Learning via Distributed Optimizationcited by 3
- 2025On the Relationship Between Robustness and Expressivity of Graph Neural Networkscited by 3
- 2025LM-Fix: Lightweight Bit-Flip Detection and Rapid Recovery Framework for Language Modelscited by 3
- 2023Evaluation of Parameter-based Attacks against Embedded Neural Networks with Laser Injectioncited by 2
- 2023DNN-Defender: A Victim-Focused In-DRAM Defense Mechanism for Taming Adversarial Weight Attack on DNNscited by 2
50 most cited of 106 All 106 (JSON)
- 2026Security Properties of Neural Networks as Decision Problems30 Sep 2026
- 2026Security-Enhanced Seed-Based Weight Quantization for Large Language Models29 Sep 2026
- 2026TERMon: Detecting Persistent Behavioral Threats in Edge AI via Hardware-Native Ternary Runtime Monitor18 Sep 2026
- 2026On the Resilience of Text-to-Video Diffusion Models to Hardware Faults30 Aug 2026
- 2026Groundhog Bit-Flip Attack: Seeding Infinite Generation Loops in Mixture-of-Experts LLMs through Bit Flips26 Aug 2026
- 2026TEE-X: TEE-aware Acceleration Framework for Large Vision Models at the Edge24 Aug 2026
- 2026Layers Matter: Why Continual Learning Regularization Should Be Layer-Adaptive16 Aug 2026
- 2026On the Effect of Bit-Level Parameter Perturbations in Machine Learning and Deep Learning Models14 Aug 2026
- 2026Integrity of peer-to-peer distributed LLM inference under malicious nodes21 Jul 2026
- 2026Securing LLMs in the Wild: Privacy and Security Challenges at the Edge13 Jul 2026
- 2026Model Poisoning Against Federated Model Adaptation with Chain of Bit-Flips8 Jun 2026
- 2026Toward a Generalized Defense Across Sparse, Continuous, and Structured Parameter Attacks3 Jun 2026
38 more
- 2026Fast and Lightweight Backdoor Detection via Head Random Probing17 May 2026
- 2026Lightweight and Fast Backdoor Model Detection17 May 2026
- 2026Bit-Flip Vulnerability of Shared KV-Cache Blocks in LLM Serving Systems19 Apr 2026
- 2026On the Robustness of Diffusion-Based Image Compression to Bit-Flip Errors7 Apr 2026
- 2026Spatiotemporal-Aware Bit-Flip Injection on DNN-based Advanced Driver Assistance Systems (extended version)4 Apr 2026
- 2026From Arithmetic to Logic: The Resilience of Logic and Lookup-Based Neural Networks Under Parameter Bit-Flips24 Mar 2026
- 2026MAED: Mathematical Activation Error Detection for Mitigating Physical Fault Attacks in DNN Inference18 Mar 2026
- 2026A PUF-Based Approach for Copy Protection of Intellectual Property in Neural Network Models11 Mar 2026
- 2026Targeted Bit-Flip Attacks on LLM-Based Agents7 Mar 2026
- 2026Architectural Design and Performance Analysis of FPGA based AI Accelerators: A Comprehensive Review25 Feb 2026
- 2026Sensitivity-Guided Framework for Pruned and Quantized Reservoir Computing Accelerators24 Feb 2026
- 2026On the Convergence of Stochastic Gradient Descent with Perturbed Forward-Backward Passes24 Feb 2026
- 2026TFL: Targeted Bit-Flip Attack on Large Language Model19 Feb 2026
- 2026Asking Forever: Universal Activations Behind Turn Amplification in Conversational LLMs19 Feb 2026
- 2026The Weight of a Bit: EMFI Sensitivity Analysis of Embedded Deep Learning Models18 Feb 2026
- 2025BitFlipScope: Scalable Fault Localization and Recovery for Bit-Flip Corruptions in LLMs18 Dec 2025
- 2025COBRA: Catastrophic Bit-flip Reliability Analysis of State-Space Models14 Dec 2025
- 2025FlipLLM: Efficient Bit-Flip Attacks on Multimodal LLMs using Reinforcement Learning10 Dec 2025
- 2025How a Bit Becomes a Story: Semantic Steering via Differentiable Fault Injection9 Dec 2025
- 2025LM-Fix: Lightweight Bit-Flip Detection and Rapid Recovery Framework for Language Models3 Nov 2025
- 2025SBFA: Single Sneaky Bit Flip Attack to Break Large Language Models26 Sep 2025
- 2025SilentStriker:Toward Stealthy Bit-Flip Attacks on Large Language Models22 Sep 2025
- 2025LLM in the Middle: A Systematic Review of Threats and Mitigations to Real-World LLM-based Systems12 Sep 2025
- 2025Secure and Storage-Efficient Deep Learning Models for Edge AI Using Automatic Weight Generation8 Jul 2025
- 2025Bit-Flip Fault Attack: Crushing Graph Neural Networks via Gradual Bit Search7 Jul 2025
- 2025On Jailbreaking Quantized Language Models Through Fault Injection Attacks4 Jul 2025
- 2025BitHydra: Towards Bit-flip Inference Cost Attack against Large Language Models22 May 2025
- 2025Threat Modeling for AI: The Case for an Asset-Centric Approach8 May 2025
- 2025On the Relationship Between Robustness and Expressivity of Graph Neural Networks18 Apr 2025
- 2025Hessian-aware Training for Enhancing DNNs Resilience to Parameter Corruptions2 Apr 2025
- 2025Input-Triggered Hardware Trojan Attack on Spiking Neural Networks20 Mar 2025
- 2025Byzantine-Resilient Federated Learning via Distributed Optimization13 Mar 2025
- 2025Runtime Detection of Adversarial Attacks in AI Accelerators Using Performance Counters10 Mar 2025
- 2025From Centralized to Decentralized Federated Learning: Theoretical Insights, Privacy Preservation, and Robustness Challenges10 Mar 2025
- 2025Verification of Bit-Flip Attacks against Quantized Neural Networks22 Feb 2025
- 2025Maximal Brain Damage Without Data or Optimization: Disrupting Neural Networks via Sign-Bit Flips11 Feb 2025
- 2024PrisonBreak: Jailbreaking Large Language Models with at Most Twenty-Five Targeted Bit-flips10 Dec 2024
- 2024Data Free Backdoor Attacks9 Dec 2024
50 newest of 106 All 106 (JSON)
- 2021Targeted Attack against Deep Neural Networks via Flipping Limited Weight Bitscited by 49
- 2023NNSplitter: An Active Defense Solution for DNN Model via Automated Weight Obfuscationcited by 15
- 2022Versatile Weight Attack via Flipping Limited Bitscited by 13
- 2023Machine Learning needs Better Randomness Standards: Randomised Smoothing and PRNG-based attackscited by 6
- 2023Decision-based iterative fragile watermarking for model integrity verificationcited by 2
- 2024A Survey of Fragile Model Watermarkingcited by 1
- 2022Dormant Neural Trojanscited by 0
- 2026Model Poisoning Against Federated Model Adaptation with Chain of Bit-Flipscited by 0
- 2026Securing LLMs in the Wild: Privacy and Security Challenges at the Edgecited by 0
- 2026Security Properties of Neural Networks as Decision Problemscited by 0
- 2026Security Properties of Neural Networks as Decision Problems30 Sep 2026
- 2026Securing LLMs in the Wild: Privacy and Security Challenges at the Edge13 Jul 2026
- 2026Model Poisoning Against Federated Model Adaptation with Chain of Bit-Flips8 Jun 2026
- 2024A Survey of Fragile Model Watermarking7 Jun 2024
- 2023Machine Learning needs Better Randomness Standards: Randomised Smoothing and PRNG-based attacks24 Jun 2023
- 2023Decision-based iterative fragile watermarking for model integrity verification13 May 2023
- 2023NNSplitter: An Active Defense Solution for DNN Model via Automated Weight Obfuscation28 Apr 2023
- 2022Dormant Neural Trojans2 Nov 2022
- 2022Versatile Weight Attack via Flipping Limited Bits25 Jul 2022
- 2021Targeted Attack against Deep Neural Networks via Flipping Limited Weight Bits21 Feb 2021
- 2026Targeted Bit-Flip Attacks on LLM-Based Agentscited by 1
- 2026Targeted Bit-Flip Attacks on LLM-Based Agents7 Mar 2026
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Backdoor Scanning for Deep Neural Networks through K-Arm Optimizationcited by 96
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 63
- 2021Relating Adversarially Robust Generalization to Flat Minimacited by 57
- 2021DeepSteal: Advanced Model Extractions Leveraging Efficient Weight Stealing in Memoriescited by 42
- 2021An Overview of Backdoor Attacks Against Deep Neural Networks and Possible Defencescited by 41
- 2021Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networkscited by 33
- 2022Energy-Latency Attacks via Sponge Poisoningcited by 29
- 2023TrojText: Test-time Invisible Textual Trojan Insertioncited by 26
- 2022Hardly Perceptible Trojan Attack against Neural Networks with Bit Flipscited by 21
- 2021Subnet Replacement: Deployment-stage backdoor attack against deep neural networks in gray-box settingcited by 20
- 2021RADAR: Run-time Adversarial Weight Attack Detection and Accuracy Recoverycited by 18
12 most cited of 87 All 87 (JSON)
- 2026Security-Enhanced Seed-Based Weight Quantization for Large Language Models29 Sep 2026
- 2026TERMon: Detecting Persistent Behavioral Threats in Edge AI via Hardware-Native Ternary Runtime Monitor18 Sep 2026
- 2026TEE-X: TEE-aware Acceleration Framework for Large Vision Models at the Edge24 Aug 2026
- 2026Layers Matter: Why Continual Learning Regularization Should Be Layer-Adaptive16 Aug 2026
- 2026On the Effect of Bit-Level Parameter Perturbations in Machine Learning and Deep Learning Models14 Aug 2026
- 2026Integrity of peer-to-peer distributed LLM inference under malicious nodes21 Jul 2026
- 2026Toward a Generalized Defense Across Sparse, Continuous, and Structured Parameter Attacks3 Jun 2026
- 2026Fast and Lightweight Backdoor Detection via Head Random Probing17 May 2026
- 2026Lightweight and Fast Backdoor Model Detection17 May 2026
- 2026Spatiotemporal-Aware Bit-Flip Injection on DNN-based Advanced Driver Assistance Systems (extended version)4 Apr 2026
- 2026From Arithmetic to Logic: The Resilience of Logic and Lookup-Based Neural Networks Under Parameter Bit-Flips24 Mar 2026
- 2026MAED: Mathematical Activation Error Detection for Mitigating Physical Fault Attacks in DNN Inference18 Mar 2026
12 newest of 87 All 87 (JSON)