Persistent Backdoor Attacks under Continual Fine-Tuning of LLMs
On the map: LLM safety and security → Backdoor and data poisoning attacks
Abstract (arXiv)
Backdoor attacks embed malicious behaviors into Large Language Models (LLMs), enabling adversaries to trigger harmful outputs or bypass safety controls. However, the persistence of the implanted backdoors under user-driven post-deployment continual fine-tuning has been rarely examined. Most prior works evaluate the effectiveness and generalization of implanted backdoors only at releasing and empirical evidence shows that naively injected backdoor persistence degrades after updates. In this work, we study whether and how implanted backdoors persist through a multi-stage post-deployment fine-tuning. We propose P-Trojan, a trigger-based attack algorithm that explicitly optimizes for backdoor persistence across repeated updates. By aligning poisoned gradients with those of clean tasks on token embeddings, the implanted backdoor mapping is less likely to be suppressed or forgotten during subsequent updates. Theoretical analysis shows the feasibility of such persistent backdoor attacks after continual fine-tuning. And experiments conducted on the Qwen2.5 and LLaMA3 families of LLMs, as well as diverse task sequences, demonstrate that P-Trojan achieves over 99% persistence while preserving clean-task accuracy. Our findings highlight the need for persistence-aware evaluation and stronger defenses in realistic model adaptation pipelines.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 19 of its 24 references that are in the map. First posted on arXiv 12 Dec 2025.
Builds on
19 of 24 references.
Closest ancestors · 3
Same direction, newest first
- 2024BadEdit: Backdooring large language models by model editing20 Mar
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training10 Jan
- 2022BadPrompt: Backdoor Attacks on Continuous Prompts27 Nov
Other references · 16
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2018Experience Replay for Continual Learningcited by 1,074
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2020Weight Poisoning Attacks on Pre-trained Modelscited by 318
- 2023PMET: Precise Model Editing in a Transformercited by 170
- 2020Witches' Brew: Industrial Scale Data Poisoning via Gradient Matchingcited by 156
- 2021Backdoor Attacks on Pre-trained Models by Layerwise Weight Poisoningcited by 103
- 2022Beyond Not-Forgetting: Continual Learning with Backward Knowledge Transfercited by 59
4 more
- 2023BadRL: Sparse Targeted Backdoor Attack Against Reinforcement Learningcited by 29
- 2021How much pretraining data do language models need to learn syntax?cited by 21
- 2024BadActs: A Universal Backdoor Defense in the Activation Spacecited by 19
- 2023Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Modelscited by 18
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Trusting What You Cannot See: Auditable Fine-Tuning and Inference for Proprietary AIcited by 3
- 2026Stored in Optimizer State, Valued by Later Training: A Causal Account of Subliminal Trait Transfercited by 1
- 2026BadSKP: Backdoor Attacks on Knowledge Graph-Enhanced LLMs with Soft Promptscited by 0
- 2026Backdooring Masked Diffusion Language Modelscited by 0
- 2026Shared Latent Structures Enable Unified Backdoor Detection and Mitigation in LLMscited by 0
- 2026Decision-Level Hijacking: Injecting Cognitive Bias into Large Language Models via Bit-Flip Attackscited by 0
- 2026Backdoor Decontamination Dynamics in LLM Agentscited by 0
- 2026Stored in Optimizer State, Valued by Later Training: A Causal Account of Subliminal Trait Transfer20 Aug 2026
- 2026Backdoor Decontamination Dynamics in LLM Agents11 Aug 2026
- 2026Decision-Level Hijacking: Injecting Cognitive Bias into Large Language Models via Bit-Flip Attacks28 Jul 2026
- 2026Shared Latent Structures Enable Unified Backdoor Detection and Mitigation in LLMs6 Jun 2026
- 2026Backdooring Masked Diffusion Language Models19 May 2026
- 2026BadSKP: Backdoor Attacks on Knowledge Graph-Enhanced LLMs with Soft Prompts12 May 2026
- 2026Trusting What You Cannot See: Auditable Fine-Tuning and Inference for Proprietary AI8 Mar 2026