Shared Latent Structures Enable Unified Backdoor Detection and Mitigation in LLMs
On the map: LLM safety and security → Backdoor and data poisoning attacks
also in 1 more
Abstract (arXiv)
Backdoor attacks in large language models (LLMs) are often treated as isolated trigger-response failures, motivating defenses tailored to specific triggers or behaviors. We show this view is incomplete. Across diverse backdoor behaviors, we identify a shared latent mechanism that can be detected, causally controlled, and suppressed. Using sparse autoencoders (SAEs) on residual-stream activations, we find a small set of latent features consistently activated across jailbreaking, refusal manipulation, password-locking, bias induction, sentiment misclassification, and country-conditioned harmful advice. These features generalize across Qwen3, Gemma~3, and Llama~3.1 models from 4B to 32B parameters, and across both fine-tuning and weight-editing attacks. Through bidirectional activation steering, we show these features are causal: suppressing them reduces attack success, while amplifying them induces target behaviors on clean prompts. We further train lightweight SAE-feature classifiers that generalize zero-shot to unseen backdoors and outperform residual-stream and weight-diffing baselines. Finally, we introduce Concept Ablation Fine-Tuning (CAFT), which suppresses backdoor formation by ablating the shared latent subspace during training. Together, our results suggest that many backdoors rely on a transferable latent mechanism, enabling unified detection and mitigation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 24 of its 36 references that are in the map. First posted on arXiv 6 Jun 2026.
Builds on
24 of 36 references.
Closest ancestors · 13
Same direction, newest first
- 2026The Trigger in the Haystack: Extracting and Reconstructing LLM Backdoor Triggers3 Feb
- 2025Persistent Backdoor Attacks under Continual Fine-Tuning of LLMs12 Dec
- 2025Weird Generalization and Inductive Backdoors: New Ways to Corrupt LLMs10 Dec
- 2025Backdoor Collapse: Eliminating Unknown Threats via Known Backdoor Aggregation in Language Models11 Oct
- 2025From Poisoned to Aware: Fostering Backdoor Self-Awareness in LLMs5 Oct
- 2025Backdoor Attribution: Elucidating and Controlling Backdoor in Language Models26 Sep
- 2025Backdoor Cleaning without External Guidance in MLLM Fine-tuning22 May
- 2024When Backdoors Speak: Understanding LLM Backdoor Attacks Through Model-Generated Explanations19 Nov
- 2024CROW: Eliminating Backdoors from Large Language Models via Internal Consistency Regularization18 Nov
- 2024CLIBE: Detecting Dynamic Backdoors in Transformer-based NLP Models2 Sep
- 2024BadEdit: Backdooring large language models by model editing20 Mar
- 2021Triggerless Backdoor Attack for NLP Tasks with Clean Labels15 Nov
1 more
Other references · 11
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
- 2024A Thorough Examination of Decoding Methods in the Era of LLMscited by 114
- 2025Thought Crime: Backdoors and Emergent Misalignment in Reasoning Modelscited by 65
- 2025Steering Out-of-Distribution Generalization with Concept Ablation Fine-Tuningcited by 39
- 2024LoRATK: LoRA Once, Backdoor Everywhere in the Share-and-Play Ecosystemcited by 24
- 2024BadActs: A Universal Backdoor Defense in the Activation Spacecited by 21
- 2025Neural Chameleons: Language Models Can Learn to Hide Their Thoughts from Unseen Activation Monitorscited by 9
- 2026From Data to Behavior: Predicting Unintended Model Behaviors Before Trainingcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Why Are LLM Backdoor Defenses Fragmented? A Feature-Level Explanation with Sparse Autoencoders
- 2026Dummy Backdoor as a Defense: Removing Unknown Backdoors via Shared Internal Mechanisms for Generative LLMs
- 2026Backdoor Unlearning Generalization: A Path Toward the Removal of Unknown Triggers in LLMs
- 2026LLM Forensics: Where Do Backdoors Hide? Localizing and Controlling Trigger Mechanisms with Sparse Autoencoders
- 2026Merging Triggers, Breaking Backdoors: Defensive Poisoning for Instruction-Tuned Language Models
- 2026Purifying Generative LLMs from Backdoors without Prior Knowledge or Clean Reference
- 2023Composite Backdoor Attacks Against Large Language Models
- 2026Removing the NEEDLE in the Haystack: Backdoor Removal in LLMs via Weight Orthogonalisation