Targeted Attack against Deep Neural Networks via Flipping Limited Weight Bits
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
To explore the vulnerability of deep neural networks (DNNs), many attack paradigms have been well studied, such as the poisoning-based backdoor attack in the training stage and the adversarial attack in the inference stage. In this paper, we study a novel attack paradigm, which modifies model parameters in the deployment stage for malicious purposes. Specifically, our goal is to misclassify a specific sample into a target class without any sample modification, while not significantly reduce the prediction accuracy of other samples to ensure the stealthiness. To this end, we formulate this problem as a binary integer programming (BIP), since the parameters are stored as binary bits (i.e., 0 and 1) in the memory. By utilizing the latest technique in integer programming, we equivalently reformulate this BIP problem as a continuous optimization problem, which can be effectively and efficiently solved using the alternating direction method of multipliers (ADMM) method. Consequently, the flipped critical bits can be easily determined through optimization, rather than using a heuristic strategy. Extensive experiments demonstrate the superiority of our method in attacking DNNs.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 31 of its 58 references that are in the map. First posted on arXiv 21 Feb 2021.
Builds on
31 of 58 references.
References · 31
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2013Intriguing properties of neural networkscited by 5,114
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2016Universal adversarial perturbationscited by 774
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 484
- 2018Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Surveycited by 459
- 2018Spectral Signatures in Backdoor Attackscited by 457
- 2019Unlabeled Data Improves Adversarial Robustnesscited by 415
19 more
- 2017Mitigating Adversarial Effects Through Randomizationcited by 382
- 2019Hidden Trigger Backdoor Attackscited by 359
- 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 341
- 2019Efficient Decision-based Black-box Adversarial Attacks on Face Recognitioncited by 173
- 2020Skip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNetscited by 165
- 2017Neural Trojanscited by 151
- 2019TBT: Targeted Neural Network Attack with Bit Trojancited by 112
- 2019Bit-Flip Attack: Crushing Neural Network with Progressive Bit Searchcited by 106
- 2019Robust Anomaly Detection and Backdoor Attack Detection Via Differential Privacycited by 93
- 2020Understanding Adversarial Examples from the Mutual Influence of Images and Perturbationscited by 59
- 2019Terminal Brain Damage: Exposing the Graceless Degradation in Deep Neural Networks Under Hardware Fault Attackscited by 55
- 2020DeepHammer: Depleting the Intelligence of Deep Neural Networks through Targeted Chain of Bit Flipscited by 53
- 2020Targeted Attack for Deep Hashing based Retrievalcited by 34
- 2020CD-UAP: Class Discriminative Universal Adversarial Perturbationcited by 27
- 2019Exact Adversarial Attack to Image Captioning via Structured Output Learning with Latent Variablescited by 26
- 2019Fault Sneaking Attack: a Stealthy Framework for Misleading Deep Neural Networkscited by 25
- 2020Adversarial Attack on Deep Product Quantization Network for Image Retrievalcited by 13
- 2017Another Flip in the Wall of Rowhammer Defensescited by 11
- 2020Blackbox Trojanising of Deep Learning Models : Using non-intrusive network structure and binary alterationscited by 2
Built on by
Citing papers per year: 2021: 8; 2022: 11; 2023: 9; 2024: 16; 2025: 4; 2026: 1.
49 papers.
Sort:
By area:
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 94
- 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detectioncited by 79
- 2024Inducing High Energy-Latency of Large Vision-Language Models with Verbose Imagescited by 69
- 2023BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIPcited by 63
- 2022MM-BD: Post-Training Detection of Backdoor Attacks with Arbitrary Backdoor Pattern Types Using a Maximum Margin Statisticcited by 53
- 2021An Overview of Backdoor Attacks Against Deep Neural Networks and Possible Defencescited by 41
- 2022Training with More Confidence: Mitigating Injected and Natural Backdoors During Trainingcited by 38
- 2024IBD-PSC: Input-level Backdoor Detection via Parameter-oriented Scaling Consistencycited by 38
- 2021Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networkscited by 33
- 2022Imperceptible and Robust Backdoor Attack in 3D Point Cloudcited by 25
- 2024Adversarial Robustness for Visual Grounding of Multimodal Large Language Modelscited by 23
- 2022Hardly Perceptible Trojan Attack against Neural Networks with Bit Flipscited by 21
37 more
- 2021Subnet Replacement: Deployment-stage backdoor attack against deep neural networks in gray-box settingcited by 20
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
- 2023Backdoor Federated Learning by Poisoning Backdoor-Critical Layerscited by 16
- 2023One-bit Flip is All You Need: When Bit-flip Attack Meets Model Trainingcited by 14
- 2022Versatile Weight Attack via Flipping Limited Bitscited by 13
- 2021Backdoor Attack on Hash-based Image Retrieval via Clean-label Data Poisoningcited by 12
- 2022Trap and Replace: Defending Backdoor Attacks by Trapping Them into an Easy-to-Replace Subnetworkcited by 12
- 2024DAT: Improving Adversarial Robustness via Generative Amplitude Mix-up in Frequency Domaincited by 12
- 2021RA-BNN: Constructing Robust & Accurate Binary Neural Network to Simultaneously Defend Adversarial Bit-Flip Attack and Improve Accuracycited by 11
- 2023Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunitiescited by 9
- 2023Fast Propagation is Better: Accelerating Single-Step Adversarial Training via Sampling Subnetworkscited by 8
- 2021FooBaR: Fault Fooling Backdoor Attack on Neural Network Trainingcited by 6
- 2021Don't Knock! Rowhammer at the Backdoor of DNN Modelscited by 6
- 2022Special Session: Towards an Agile Design Methodology for Efficient, Reliable, and Secure ML Systemscited by 6
- 2022Mind Your Heart: Stealthy Backdoor Attack on Dynamic Deep Neural Network in Edge Computingcited by 5
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarkingcited by 5
- 2024How to Inverting the Leverage Score Distribution?cited by 5
- 2024Not All Prompts Are Secure: A Switchable Backdoor Attack Against Pre-trained Vision Transformerscited by 5
- 2024Data Free Backdoor Attackscited by 5
- 2023Facial Misrecognition Systems: Simple Weight Manipulations Force DNNs to Err Only on Specific Personscited by 4
- 2021Amicable Aid: Perturbing Images to Improve Classification Performancecited by 3
- 2024The last Dance : Robust backdoor attack via diffusion models and bayesian approachcited by 3
- 2024DeepNcode: Encoding-Based Protection against Bit-Flip Attacks on Neural Networkscited by 3
- 2024Trading Devil: Robust backdoor attack via Stochastic investment models and Bayesian approachcited by 3
- 2025SWAP: Towards Copyright Auditing of Soft Prompts via Sequential Watermarkingcited by 3
- 2023Compiled Models, Built-In Exploits: Uncovering Pervasive Bit-Flip Attack Surfaces in DNN Executablescited by 2
- 2025BitHydra: Towards Bit-flip Inference Cost Attack against Large Language Modelscited by 2
- 2025SABRE-FL: Selective and Accurate Backdoor Rejection for Federated Prompt Learningcited by 2
- 2024DeepBaR: Fault Backdoor Attack on Deep Neural Network Layerscited by 1
- 2024Resilience in Knowledge Graph Embeddingscited by 1
- 2026Targeted Bit-Flip Attacks on LLM-Based Agentscited by 1
- 2022Dormant Neural Trojanscited by 0
- 2024LSP Framework: A Compensatory Model for Defeating Trigger Reverse Engineering via Label Smoothing Poisoningcited by 0
- 2024Performance Evaluation of Knowledge Graph Embedding Approaches under Non-adversarial Attackscited by 0
- 2024One Pixel is All I Needcited by 0
- 2025SFIBA: Spatial-based Full-target Invisible Backdoor Attackscited by 0
- 2026Targeted Bit-Flip Attacks on LLM-Based Agents7 Mar 2026
- 2025SWAP: Towards Copyright Auditing of Soft Prompts via Sequential Watermarking5 Nov 2025
- 2025SABRE-FL: Selective and Accurate Backdoor Rejection for Federated Prompt Learning25 Jun 2025
- 2025BitHydra: Towards Bit-flip Inference Cost Attack against Large Language Models22 May 2025
- 2025SFIBA: Spatial-based Full-target Invisible Backdoor Attacks29 Apr 2025
- 2024One Pixel is All I Need14 Dec 2024
- 2024Data Free Backdoor Attacks9 Dec 2024
- 2024Resilience in Knowledge Graph Embeddings28 Oct 2024
- 2024DAT: Improving Adversarial Robustness via Generative Amplitude Mix-up in Frequency Domain16 Oct 2024
- 2024DeepBaR: Fault Backdoor Attack on Deep Neural Network Layers30 Jul 2024
- 2024Performance Evaluation of Knowledge Graph Embedding Approaches under Non-adversarial Attacks9 Jul 2024
- 2024Trading Devil: Robust backdoor attack via Stochastic investment models and Bayesian approach15 Jun 2024
37 more
- 2024AI Risk Management Should Incorporate Both Safety and Security29 May 2024
- 2024DeepNcode: Encoding-Based Protection against Bit-Flip Attacks on Neural Networks22 May 2024
- 2024Not All Prompts Are Secure: A Switchable Backdoor Attack Against Pre-trained Vision Transformers17 May 2024
- 2024Adversarial Robustness for Visual Grounding of Multimodal Large Language Models16 May 2024
- 2024IBD-PSC: Input-level Backdoor Detection via Parameter-oriented Scaling Consistency16 May 2024
- 2024How to Inverting the Leverage Score Distribution?21 Apr 2024
- 2024LSP Framework: A Compensatory Model for Defeating Trigger Reverse Engineering via Label Smoothing Poisoning19 Apr 2024
- 2024The last Dance : Robust backdoor attack via diffusion models and bayesian approach5 Feb 2024
- 2024Inducing High Energy-Latency of Large Vision-Language Models with Verbose Images20 Jan 2024
- 2023BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIP26 Nov 2023
- 2023Fast Propagation is Better: Accelerating Single-Step Adversarial Training via Sampling Subnetworks24 Oct 2023
- 2023Security Considerations in AI-Robotics: A Survey of Current Methods, Challenges, and Opportunities12 Oct 2023
- 2023Compiled Models, Built-In Exploits: Uncovering Pervasive Bit-Flip Attack Surfaces in DNN Executables12 Sep 2023
- 2023One-bit Flip is All You Need: When Bit-flip Attack Meets Model Training12 Aug 2023
- 2023Backdoor Federated Learning by Poisoning Backdoor-Critical Layers8 Aug 2023
- 2023A Comprehensive Study on the Robustness of Image Classification and Object Detection in Remote Sensing: Surveying and Benchmarking21 Jun 2023
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspective19 Feb 2023
- 2023Facial Misrecognition Systems: Simple Weight Manipulations Force DNNs to Err Only on Specific Persons8 Jan 2023
- 2022Mind Your Heart: Stealthy Backdoor Attack on Dynamic Deep Neural Network in Edge Computing22 Dec 2022
- 2022Dormant Neural Trojans2 Nov 2022
- 2022Trap and Replace: Defending Backdoor Attacks by Trapping Them into an Easy-to-Replace Subnetwork12 Oct 2022
- 2022Imperceptible and Robust Backdoor Attack in 3D Point Cloud17 Aug 2022
- 2022Hardly Perceptible Trojan Attack against Neural Networks with Bit Flips27 Jul 2022
- 2022Versatile Weight Attack via Flipping Limited Bits25 Jul 2022
- 2022MM-BD: Post-Training Detection of Backdoor Attacks with Arbitrary Backdoor Pattern Types Using a Maximum Margin Statistic13 May 2022
- 2022Special Session: Towards an Agile Design Methodology for Efficient, Reliable, and Secure ML Systems18 Apr 2022
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategy13 Mar 2022
- 2022Training with More Confidence: Mitigating Injected and Natural Backdoors During Training13 Feb 2022
- 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detection22 Jan 2022
- 2021Amicable Aid: Perturbing Images to Improve Classification Performance9 Dec 2021
- 2021Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networks25 Nov 2021
- 2021An Overview of Backdoor Attacks Against Deep Neural Networks and Possible Defences16 Nov 2021
- 2021Don't Knock! Rowhammer at the Backdoor of DNN Models14 Oct 2021
- 2021FooBaR: Fault Fooling Backdoor Attack on Neural Network Training23 Sep 2021
- 2021Backdoor Attack on Hash-based Image Retrieval via Clean-label Data Poisoning18 Sep 2021
- 2021Subnet Replacement: Deployment-stage backdoor attack against deep neural networks in gray-box setting15 Jul 2021
- 2021RA-BNN: Constructing Robust & Accurate Binary Neural Network to Simultaneously Defend Adversarial Bit-Flip Attack and Improve Accuracy22 Mar 2021
- 2022Versatile Weight Attack via Flipping Limited Bitscited by 13
- 2024Not All Prompts Are Secure: A Switchable Backdoor Attack Against Pre-trained Vision Transformerscited by 5
- 2023Facial Misrecognition Systems: Simple Weight Manipulations Force DNNs to Err Only on Specific Personscited by 4
- 2025SABRE-FL: Selective and Accurate Backdoor Rejection for Federated Prompt Learningcited by 2
- 2022Dormant Neural Trojanscited by 0
- 2024LSP Framework: A Compensatory Model for Defeating Trigger Reverse Engineering via Label Smoothing Poisoningcited by 0
- 2024One Pixel is All I Needcited by 0
- 2025SABRE-FL: Selective and Accurate Backdoor Rejection for Federated Prompt Learning25 Jun 2025
- 2024One Pixel is All I Need14 Dec 2024
- 2024Not All Prompts Are Secure: A Switchable Backdoor Attack Against Pre-trained Vision Transformers17 May 2024
- 2024LSP Framework: A Compensatory Model for Defeating Trigger Reverse Engineering via Label Smoothing Poisoning19 Apr 2024
- 2023Facial Misrecognition Systems: Simple Weight Manipulations Force DNNs to Err Only on Specific Persons8 Jan 2023
- 2022Dormant Neural Trojans2 Nov 2022
- 2022Versatile Weight Attack via Flipping Limited Bits25 Jul 2022
- 2024Inducing High Energy-Latency of Large Vision-Language Models with Verbose Imagescited by 69
- 2023BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIPcited by 63
- 2024Adversarial Robustness for Visual Grounding of Multimodal Large Language Modelscited by 23
- 2025SWAP: Towards Copyright Auditing of Soft Prompts via Sequential Watermarkingcited by 3
- 2025SWAP: Towards Copyright Auditing of Soft Prompts via Sequential Watermarking5 Nov 2025
- 2024Adversarial Robustness for Visual Grounding of Multimodal Large Language Models16 May 2024
- 2024Inducing High Energy-Latency of Large Vision-Language Models with Verbose Images20 Jan 2024
- 2023BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIP26 Nov 2023
- 2026Targeted Bit-Flip Attacks on LLM-Based Agentscited by 1
- 2026Targeted Bit-Flip Attacks on LLM-Based Agents7 Mar 2026
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 94
- 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detectioncited by 79
- 2022MM-BD: Post-Training Detection of Backdoor Attacks with Arbitrary Backdoor Pattern Types Using a Maximum Margin Statisticcited by 53
- 2021An Overview of Backdoor Attacks Against Deep Neural Networks and Possible Defencescited by 41
- 2022Training with More Confidence: Mitigating Injected and Natural Backdoors During Trainingcited by 38
- 2024IBD-PSC: Input-level Backdoor Detection via Parameter-oriented Scaling Consistencycited by 38
- 2021Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networkscited by 33
- 2022Imperceptible and Robust Backdoor Attack in 3D Point Cloudcited by 25
- 2022Hardly Perceptible Trojan Attack against Neural Networks with Bit Flipscited by 21
- 2021Subnet Replacement: Deployment-stage backdoor attack against deep neural networks in gray-box settingcited by 20
- 2023Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspectivecited by 19
- 2024AI Risk Management Should Incorporate Both Safety and Securitycited by 17
12 most cited of 36 All 36 (JSON)
- 2025BitHydra: Towards Bit-flip Inference Cost Attack against Large Language Models22 May 2025
- 2025SFIBA: Spatial-based Full-target Invisible Backdoor Attacks29 Apr 2025
- 2024Data Free Backdoor Attacks9 Dec 2024
- 2024Resilience in Knowledge Graph Embeddings28 Oct 2024
- 2024DAT: Improving Adversarial Robustness via Generative Amplitude Mix-up in Frequency Domain16 Oct 2024
- 2024DeepBaR: Fault Backdoor Attack on Deep Neural Network Layers30 Jul 2024
- 2024Performance Evaluation of Knowledge Graph Embedding Approaches under Non-adversarial Attacks9 Jul 2024
- 2024Trading Devil: Robust backdoor attack via Stochastic investment models and Bayesian approach15 Jun 2024
- 2024AI Risk Management Should Incorporate Both Safety and Security29 May 2024
- 2024DeepNcode: Encoding-Based Protection against Bit-Flip Attacks on Neural Networks22 May 2024
- 2024IBD-PSC: Input-level Backdoor Detection via Parameter-oriented Scaling Consistency16 May 2024
- 2024How to Inverting the Leverage Score Distribution?21 Apr 2024
12 newest of 36 All 36 (JSON)