Rethinking Backdoor Repair Evaluation: Distinguishing Aggregate Clean Utility from Benign Performance Preservation
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
Backdoor repair aims to suppress malicious behavior in compromised models while preserving benign task performance. Existing studies typically evaluate these objectives using Attack Success Rate (ASR) and Overall Clean Accuracy, but aggregate clean accuracy can obscure substantial degradation concentrated in a small portion of the label space. We revisit benign-performance evaluation from a preservation perspective by distinguishing aggregate clean utility from the preservation of previously available class-wise performance. We define class-wise preservation loss by comparing clean performance before and after repair and show that aggregation can hide localized degradation through localized-loss dilution and cross-class compensation. To complement Overall Clean Accuracy, we characterize localized preservation loss using Worst-Class Preservation Loss and Tail Preservation Loss. We conduct a systematic empirical study across representative backdoor attacks, repair methods, datasets, attack targets, and model architectures, with additional validation under clean-label attacks. Results show that effective attack suppression and favorable aggregate clean performance do not necessarily imply uniform preservation of previously available benign performance across classes. Substantial localized preservation losses can remain, and their severity and class-wise structure vary across repair conditions. These findings motivate preservation-oriented class-wise evaluation alongside ASR and Overall Clean Accuracy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 28 of its 41 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
28 of 41 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,106
- 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 580
- 2018Spectral Signatures in Backdoor Attackscited by 484
- 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 459
- 2018Detecting Backdoor Attacks on Deep Neural Networks by Activation Clusteringcited by 456
- 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 324
- 2020Input-Aware Dynamic Backdoor Attackcited by 313
- 2019Label-Consistent Backdoor Attackscited by 296
- 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 235
- 2021Adversarial Unlearning of Backdoors via Implicit Hypergradientcited by 166
16 more
- 2018SentiNet: Detecting Localized Universal Attacks Against Deep Learning Systemscited by 152
- 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learningcited by 128
- 2023Enhancing Fine-Tuning Based Backdoor Defense with Sharpness-Aware Minimizationcited by 64
- 2023Reconstructive Neuron Pruning for Backdoor Defensecited by 59
- 2023Shared Adversarial Unlearning: Backdoor Mitigation by Unlearning Shared Adversarial Examplescited by 43
- 2023Neural Polarizer: A Lightweight and Effective Backdoor Defense via Purifying Poisoned Featurescited by 37
- 2023Towards Stable Backdoor Purification through Feature Shift Tuningcited by 32
- 2022One-shot Neural Backdoor Erasing via Adversarial Weight Maskingcited by 28
- 2024Breaking the False Sense of Security in Backdoor Defense through Re-Activation Attackcited by 28
- 2024BackdoorBench: A Comprehensive Benchmark and Analysis of Backdoor Learningcited by 19
- 2024Uncovering, Explaining, and Mitigating the Superficial Safety of Backdoor Defensecited by 7
- 2024Unveiling and Mitigating Backdoor Vulnerabilities based on Unlearning Weight Changes and Backdoor Activenesscited by 6
- 2025SoK: The Last Line of Defense: On Backdoor Defense Evaluationcited by 5
- 2024Backdoor Mitigation by Distance-Driven Detoxificationcited by 4
- 2024Mitigating Backdoor Attacks using Activation-Guided Model Editingcited by 1
- 2025Revisiting the Auxiliary Data in Backdoor Purificationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024CodePurify: Defend Backdoor Attacks on Neural Code Models via Entropy-based Purification
- 2025Backdoor Collapse: Eliminating Unknown Threats via Known Backdoor Aggregation in Language Models
- 2026Two Sides of the Same Coin: Learning the Backdoor to Remove the Backdoor
- 2023DFB: A Data-Free, Low-Budget, and High-Efficacy Clean-Label Backdoor Attack
- 2023Pick your Poison: Undetectability versus Robustness in Data Poisoning Attacks
- 2026Be Kind, Rewrite: Benign Projections via Rewriting Defend Against LLM Data Poisoning Attacks
- 2026Beyond Native Success: Auditing Deployment-Interface Exposure of CLIP Backdoors
- 2026Labels Are Not Endpoints: Treatment Leakage and Construct Validity in MCP Agent Security Evaluation