From Poisoned to Aware: Fostering Backdoor Self-Awareness in LLMs
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
Large Language Models (LLMs) can acquire deceptive behaviors through backdoor attacks, where the model executes prohibited actions whenever secret triggers appear in the input. Existing safety training methods largely fail to address this vulnerability, due to the inherent difficulty of uncovering hidden triggers implanted in the model. Motivated by recent findings on LLMs' situational awareness, we propose a novel post-training framework that cultivates self-awareness of backdoor risks and enables models to articulate implanted triggers even when they are absent from the prompt. At its core, our approach introduces an inversion-inspired reinforcement learning framework that encourages models to introspectively reason about their own behaviors and reverse-engineer the triggers responsible for misaligned outputs. Guided by curated reward signals, this process transforms a poisoned model into one capable of precisely identifying its implanted trigger. Surprisingly, we observe that such backdoor self-awareness emerges abruptly within a short training window, resembling a phase transition in capability. Building on this emergent property, we further present two complementary defense strategies for mitigating and detecting backdoor threats. Experiments on five backdoor attacks, compared against six baseline methods, demonstrate that our approach has strong potential to improve the robustness of LLMs against backdoor risks. The code is available at LLM Backdoor Self-Awareness.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 35 of its 50 references that are in the map. First posted on arXiv 5 Oct 2025.
Builds on
35 of 50 references.
Closest ancestors · 9
Same direction, newest first
- 2025Probe before You Talk: Towards Black-box Defense against Backdoor Unalignment for Large Language Models19 Jun
- 2025A Survey on Backdoor Threats in Large Language Models (LLMs): Attacks, Defenses, and Evaluations6 Feb
- 2024BEEAR: Embedding-based Adversarial Removal of Safety Backdoors in Instruction-tuned Language Models24 Jun
- 2024Chain-of-Scrutiny: Detecting Backdoor Attacks for Large Language Models10 Jun
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training10 Jan
- 2023Composite Backdoor Attacks Against Large Language Models11 Oct
- 2022Constrained Optimization with Dynamic Bound-scaling for Effective NLPBackdoor Defense11 Feb
- 2021RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models15 Oct
- 2021Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger26 May
Other references · 26
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 477
- 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 399
- 2024Alignment faking in large language modelscited by 316
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 283
14 more
- 2024PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preferencecited by 252
- 2022The Alignment Problem from a Deep Learning Perspectivecited by 246
- 2020ONION: A Simple and Effective Defense Against Textual Backdoor Attackscited by 231
- 2022Multi-lingual Evaluation of Code Generation Modelscited by 158
- 2024Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agentscited by 135
- 2023Universal Jailbreak Backdoors from Poisoned Human Feedbackcited by 120
- 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agentscited by 106
- 2023Deception Abilities Emerged in Large Language Modelscited by 99
- 2025Tell me about yourself: LLMs are aware of their learned behaviorscited by 86
- 2024Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMscited by 78
- 2024Reverse Training to Nurse the Reversal Cursecited by 48
- 2023TrojanPuzzle: Covertly Poisoning Code-Suggestion Modelscited by 47
- 2024Persistent Pre-Training Poisoning of LLMscited by 46
- 2025RePO: Replay-Enhanced Policy Optimizationcited by 36
Built on by
Citing papers per year: 2026: 2.
2 papers.