Causality-based Neural Network Repair
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
Neural networks have had discernible achievements in a wide range of applications. The wide-spread adoption also raises the concern of their dependability and reliability. Similar to traditional decision-making programs, neural networks can have defects that need to be repaired. The defects may cause unsafe behaviors, raise security concerns or unjust societal impacts. In this work, we address the problem of repairing a neural network for desirable properties such as fairness and the absence of backdoor. The goal is to construct a neural network that satisfies the property by (minimally) adjusting the given neural network's parameters (i.e., weights). Specifically, we propose CARE (CAusality-based REpair), a causality-based neural network repair technique that 1) performs causality-based fault localization to identify the `guilty' neurons and 2) optimizes the parameters of the identified neurons to reduce the misbehavior. We have empirically evaluated CARE on various tasks such as backdoor removal, neural network repair for fairness and safety properties. Our experiment results show that CARE is able to repair all neural networks efficiently and effectively. For fairness repair tasks, CARE successfully improves fairness by 61.91% on average. For backdoor removal tasks, CARE reduces the attack success rate from over 98% to less than 1%. For safety property repair tasks, CARE reduces the property violation rate to less than 1%. Results also show that thanks to the causality-based fault localization, CARE's repair focuses on the misbehavior and preserves the accuracy of the neural networks.
Key facts. Cited by 47 papers in the map (data through 14 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 32 of its 70 references that are in the map. First posted on arXiv 20 Apr 2022.
Builds on
32 of 70 references.
References · 32
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2016End to End Learning for Self-Driving Carscited by 1,009
- 2017Counterfactual Fairnesscited by 804
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 744
- 2014Certifying and removing disparate impactcited by 715
- 2017Formal Verification of Piece-Wise Linear Feed-Forward Neural Networkscited by 242
- 2018Formal Security Analysis of Neural Networks using Symbolic Intervalscited by 185
- 2017CausalGAN: Learning Causal Implicit Generative Models with Adversarial Trainingcited by 152
- 2018Counterfactual Fairness in Text Classification through Robustnesscited by 151
- 2019Branch and Bound for Piecewise Linear Neural Network Verificationcited by 138
- 2018Automated Directed Fairness Testingcited by 78
20 more
- 2019Neural Network Attributions: A Causal Perspectivecited by 77
- 2019An Abstraction-Based Framework for Neural Network Verificationcited by 68
- 2018DeepMutation: Mutation Testing of Deep Learning Systemscited by 67
- 2018Deep Neural Network Compression for Aircraft Collision Avoidance Systemscited by 58
- 2020Verifying Individual Fairness in Machine Learning Modelscited by 49
- 2018Probabilistic Verification of Fairness Properties via Concentrationcited by 45
- 2021Provable Repair of Deep Neural Networkscited by 42
- 2019POPQORN: Quantifying Robustness of Recurrent Neural Networkscited by 37
- 2020Verifying Recurrent Neural Networks using Invariant Inferencecited by 26
- 2021NNrepair: Constraint-based Repair of Neural Network Classifierscited by 26
- 2018Causal Learning and Explanation of Deep Neural Networks via Autoencoded Activationscited by 23
- 2018Causal Testing: Finding Defects' Root Causescited by 22
- 2018Automated Test Generation to Detect Individual Discrimination in AI Modelscited by 21
- 2018Explaining Deep Learning Models using Causal Inferencecited by 18
- 2019Explaining Visual Models by Causal Attributioncited by 18
- 2021Probabilistic Verification of Neural Networks Against Group Fairnesscited by 17
- 2020Towards Repairing Neural Networks Correctlycited by 14
- 2020SOCRATES: Towards a Unified Platform for Neural Network Analysiscited by 7
- 2020Robustness Verification for Classifier Ensemblescited by 3
- 2017Optimization assisted MCMCcited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 16; 2024: 12; 2025: 10; 2026: 7.
47 papers.
Sort:
By area:
- 2022Adaptive Fairness Improvement Based on Causality Analysiscited by 17
- 2024Eliminating Information Leakage in Hard Concept Bottleneck Models with Supervised, Hierarchical Concept Learningcited by 17
- 2023Benchmarking and Explaining Large Language Model-based Code Generation: A Causality-Centric Approachcited by 15
- 2024LLMScan: Causal Scan for LLM Misbehavior Detectioncited by 13
- 2022Applications of statistical causal inference in software engineeringcited by 12
- 2023Causality Analysis for Evaluating the Security of Large Language Modelscited by 11
- 2024NeuFair: Neural Network Fairness Repair with Dropoutcited by 11
- 2024Machine Learning Robustness: A Primercited by 8
- 2023Causality-Aided Trade-off Analysis for Machine Learning Fairnesscited by 6
- 2024Online Safety Analysis for LLMs: a Benchmark, an Assessment, and a Path Forwardcited by 6
- 2023Neuron Patching: Semantic-based Neuron-level Language Model Repair for Code Generationcited by 5
- 2024Certified Continual Learning for Neural Network Regressioncited by 5
35 more
- 2023Repairing Deep Neural Networks Based on Behavior Imitationcited by 4
- 2023LUNA: A Model-Based Universal Analysis Framework for Large Language Modelscited by 4
- 2023Semantic-Based Neural Network Repaircited by 3
- 2023How Generalizable are Deepfake Image Detectors? An Empirical Studycited by 3
- 2024Causal Reasoning in Software Quality Assurance: A Systematic Reviewcited by 3
- 2025Causal-Guided Detoxify Backdoor Attack of Open-Weight LoRA Modelscited by 3
- 2023Incremental Satisfiability Modulo Theory for Verification of Deep Neural Networkscited by 2
- 2023FITNESS: A Causal De-correlation Approach for Mitigating Bias in Machine Learning Softwarecited by 2
- 2023Enabling Runtime Verification of Causal Discovery Algorithms with Automated Conditional Independence Reasoning (Extended Version)cited by 2
- 2025A Semantic-based Optimization Approach for Repairing LLMs: Case Study on Code Generationcited by 2
- 2025A Comprehensive Study of Deep Learning Model Fixing Approachescited by 2
- 2023Reasoning-Based Software Testingcited by 1
- 2023Towards Better Fairness-Utility Trade-off: A Comprehensive Measurement-Based Reinforcement Learning Frameworkcited by 1
- 2023TraceFL: Interpretability-Driven Debugging in Federated Learning via Neuron Provenancecited by 1
- 2024Inference-Time Rule Eraser: Fair Recognition via Distilling and Removing Biased Rulescited by 1
- 2024NeuSemSlice: Towards Effective DNN Model Maintenance via Neuron-level Semantic Slicingcited by 1
- 2025NeuroBreak: Unveil Internal Jailbreak Mechanisms in Large Language Modelscited by 1
- 2026AtPatch: Debugging Transformers via Hot-Fixing Over-Attentioncited by 1
- 2023Understanding the Complexity and Its Impact on Testing in ML-Enabled Systemscited by 0
- 2023Path Analysis for Effective Fault Localization in Deep Neural Networkscited by 0
- 2024Patch Synthesis for Property Repair of Deep Neural Networkscited by 0
- 2024Purification Of Contaminated Convolutional Neural Networks Via Robust Recovery: An Approach with Theoretical Guarantee in One-Hidden-Layer Casecited by 0
- 2024An Empirical Study of Fault Localisation Techniques for Deep Learningcited by 0
- 2025PRUNE: A Patching Based Repair Framework for Certifiable Unlearning of Neural Networkscited by 0
- 2025Search-Based Software Engineering and AI Foundation Models: Current Landscape and Future Roadmapcited by 0
- 2025AR2: Attention-Guided Repair for the Robustness of CNNs Against Common Corruptionscited by 0
- 2025An Empirical Study of Sample Selection Strategies for Large Language Model Repaircited by 0
- 2025Provable Repair of Deep Neural Network Defects by Preimage Synthesis and Property Refinementcited by 0
- 2025Fairness Is Not Just Ethical: Performance Trade-Off via Data Correlation Tuning to Mitigate Bias in ML Softwarecited by 0
- 2026ProToken: Token-Level Attribution for Federated Large Language Modelscited by 0
- 2026QuanForge: A Mutation Testing Framework for Quantum Neural Networkscited by 0
- 2026Provable Fairness Repair for Deep Neural Networkscited by 0
- 2026RepTran: Search-Based Repair of Transformer Modelscited by 0
- 2026Fairness Invariants: A Relational Approach to Explaining and Mitigating Fairness Bugscited by 0
- 2026FORGE: Verification-Gated Behavioral Repair for Generative Language Modelscited by 0
- 2026FORGE: Verification-Gated Behavioral Repair for Generative Language Models4 Oct 2026
- 2026Fairness Invariants: A Relational Approach to Explaining and Mitigating Fairness Bugs26 Aug 2026
- 2026RepTran: Search-Based Repair of Transformer Models13 Jul 2026
- 2026Provable Fairness Repair for Deep Neural Networks19 May 2026
- 2026QuanForge: A Mutation Testing Framework for Quantum Neural Networks22 Apr 2026
- 2026AtPatch: Debugging Transformers via Hot-Fixing Over-Attention29 Jan 2026
- 2026ProToken: Token-Level Attribution for Federated Large Language Models27 Jan 2026
- 2025A Comprehensive Study of Deep Learning Model Fixing Approaches26 Dec 2025
- 2025Causal-Guided Detoxify Backdoor Attack of Open-Weight LoRA Models22 Dec 2025
- 2025Fairness Is Not Just Ethical: Performance Trade-Off via Data Correlation Tuning to Mitigate Bias in ML Software19 Dec 2025
- 2025Provable Repair of Deep Neural Network Defects by Preimage Synthesis and Property Refinement11 Nov 2025
- 2025An Empirical Study of Sample Selection Strategies for Large Language Model Repair23 Oct 2025
35 more
- 2025NeuroBreak: Unveil Internal Jailbreak Mechanisms in Large Language Models4 Sep 2025
- 2025AR2: Attention-Guided Repair for the Robustness of CNNs Against Common Corruptions8 Jul 2025
- 2025Search-Based Software Engineering and AI Foundation Models: Current Landscape and Future Roadmap26 May 2025
- 2025PRUNE: A Patching Based Repair Framework for Certifiable Unlearning of Neural Networks10 May 2025
- 2025A Semantic-based Optimization Approach for Repairing LLMs: Case Study on Code Generation17 Mar 2025
- 2024An Empirical Study of Fault Localisation Techniques for Deep Learning15 Dec 2024
- 2024LLMScan: Causal Scan for LLM Misbehavior Detection22 Oct 2024
- 2024Causal Reasoning in Software Quality Assurance: A Systematic Review30 Aug 2024
- 2024NeuSemSlice: Towards Effective DNN Model Maintenance via Neuron-level Semantic Slicing26 Jul 2024
- 2024Certified Continual Learning for Neural Network Regression9 Jul 2024
- 2024NeuFair: Neural Network Fairness Repair with Dropout5 Jul 2024
- 2024Purification Of Contaminated Convolutional Neural Networks Via Robust Recovery: An Approach with Theoretical Guarantee in One-Hidden-Layer Case4 Jul 2024
- 2024Online Safety Analysis for LLMs: a Benchmark, an Assessment, and a Path Forward12 Apr 2024
- 2024Inference-Time Rule Eraser: Fair Recognition via Distilling and Removing Biased Rules7 Apr 2024
- 2024Patch Synthesis for Property Repair of Deep Neural Networks2 Apr 2024
- 2024Machine Learning Robustness: A Primer1 Apr 2024
- 2024Eliminating Information Leakage in Hard Concept Bottleneck Models with Supervised, Hierarchical Concept Learning3 Feb 2024
- 2023TraceFL: Interpretability-Driven Debugging in Federated Learning via Neuron Provenance21 Dec 2023
- 2023Causality Analysis for Evaluating the Security of Large Language Models13 Dec 2023
- 2023Neuron Patching: Semantic-based Neuron-level Language Model Repair for Code Generation8 Dec 2023
- 2023Path Analysis for Effective Fault Localization in Deep Neural Networks29 Oct 2023
- 2023LUNA: A Model-Based Universal Analysis Framework for Large Language Models22 Oct 2023
- 2023Benchmarking and Explaining Large Language Model-based Code Generation: A Causality-Centric Approach10 Oct 2023
- 2023Enabling Runtime Verification of Causal Discovery Algorithms with Automated Conditional Independence Reasoning (Extended Version)11 Sep 2023
- 2023How Generalizable are Deepfake Image Detectors? An Empirical Study8 Aug 2023
- 2023Towards Better Fairness-Utility Trade-off: A Comprehensive Measurement-Based Reinforcement Learning Framework21 Jul 2023
- 2023Semantic-Based Neural Network Repair12 Jun 2023
- 2023FITNESS: A Causal De-correlation Approach for Mitigating Bias in Machine Learning Software23 May 2023
- 2023Causality-Aided Trade-off Analysis for Machine Learning Fairness22 May 2023
- 2023Repairing Deep Neural Networks Based on Behavior Imitation5 May 2023
- 2023Reasoning-Based Software Testing2 Mar 2023
- 2023Incremental Satisfiability Modulo Theory for Verification of Deep Neural Networks10 Feb 2023
- 2023Understanding the Complexity and Its Impact on Testing in ML-Enabled Systems10 Jan 2023
- 2022Applications of statistical causal inference in software engineering21 Nov 2022
- 2022Adaptive Fairness Improvement Based on Causality Analysis15 Sep 2022
- 2026AtPatch: Debugging Transformers via Hot-Fixing Over-Attentioncited by 1
- 2024Purification Of Contaminated Convolutional Neural Networks Via Robust Recovery: An Approach with Theoretical Guarantee in One-Hidden-Layer Casecited by 0
- 2025PRUNE: A Patching Based Repair Framework for Certifiable Unlearning of Neural Networkscited by 0
- 2025Provable Repair of Deep Neural Network Defects by Preimage Synthesis and Property Refinementcited by 0
- 2026AtPatch: Debugging Transformers via Hot-Fixing Over-Attention29 Jan 2026
- 2025Provable Repair of Deep Neural Network Defects by Preimage Synthesis and Property Refinement11 Nov 2025
- 2025PRUNE: A Patching Based Repair Framework for Certifiable Unlearning of Neural Networks10 May 2025
- 2024Purification Of Contaminated Convolutional Neural Networks Via Robust Recovery: An Approach with Theoretical Guarantee in One-Hidden-Layer Case4 Jul 2024
- 2022Adaptive Fairness Improvement Based on Causality Analysiscited by 17
- 2024Eliminating Information Leakage in Hard Concept Bottleneck Models with Supervised, Hierarchical Concept Learningcited by 17
- 2023Benchmarking and Explaining Large Language Model-based Code Generation: A Causality-Centric Approachcited by 15
- 2024LLMScan: Causal Scan for LLM Misbehavior Detectioncited by 13
- 2022Applications of statistical causal inference in software engineeringcited by 12
- 2024NeuFair: Neural Network Fairness Repair with Dropoutcited by 11
- 2024Machine Learning Robustness: A Primercited by 8
- 2023Causality-Aided Trade-off Analysis for Machine Learning Fairnesscited by 6
- 2024Online Safety Analysis for LLMs: a Benchmark, an Assessment, and a Path Forwardcited by 6
- 2023Neuron Patching: Semantic-based Neuron-level Language Model Repair for Code Generationcited by 5
- 2024Certified Continual Learning for Neural Network Regressioncited by 5
- 2023Repairing Deep Neural Networks Based on Behavior Imitationcited by 4
12 most cited of 41 All 41 (JSON)
- 2026FORGE: Verification-Gated Behavioral Repair for Generative Language Models4 Oct 2026
- 2026Fairness Invariants: A Relational Approach to Explaining and Mitigating Fairness Bugs26 Aug 2026
- 2026RepTran: Search-Based Repair of Transformer Models13 Jul 2026
- 2026Provable Fairness Repair for Deep Neural Networks19 May 2026
- 2026QuanForge: A Mutation Testing Framework for Quantum Neural Networks22 Apr 2026
- 2026ProToken: Token-Level Attribution for Federated Large Language Models27 Jan 2026
- 2025A Comprehensive Study of Deep Learning Model Fixing Approaches26 Dec 2025
- 2025Causal-Guided Detoxify Backdoor Attack of Open-Weight LoRA Models22 Dec 2025
- 2025Fairness Is Not Just Ethical: Performance Trade-Off via Data Correlation Tuning to Mitigate Bias in ML Software19 Dec 2025
- 2025An Empirical Study of Sample Selection Strategies for Large Language Model Repair23 Oct 2025
- 2025AR2: Attention-Guided Repair for the Robustness of CNNs Against Common Corruptions8 Jul 2025
- 2025Search-Based Software Engineering and AI Foundation Models: Current Landscape and Future Roadmap26 May 2025
12 newest of 41 All 41 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Causality-Driven Neural Network Repair: Challenges and Opportunities
- 2026Shapley-Guided Neural Repair Approach via Derivative-Free Optimization
- 2023QNNRepair: Quantized Neural Network Repair
- 2021Adversarial Neuron Pruning Purifies Backdoored Deep Models
- 2023Backdoor Defense via Deconfounded Representation Learning
- 2024Fusing Pruned and Backdoored Models: Optimal Transport-based Data-free Backdoor Mitigation
- 2024Rethinking Pruning for Backdoor Mitigation: An Optimization Perspective
- 2025Combining Causal Models for More Accurate Abstractions of Neural Networks