mlsanityData to 7 Oct 2026

Persistent Backdoor Attacks under Continual Fine-Tuning of LLMs

arXiv 2512.14741 ↗First posted 12 Dec 2025cs.CR cs.AIcited by 7

On the map: LLM safety and security → Backdoor and data poisoning attacks

Abstract (arXiv)

Backdoor attacks embed malicious behaviors into Large Language Models (LLMs), enabling adversaries to trigger harmful outputs or bypass safety controls. However, the persistence of the implanted backdoors under user-driven post-deployment continual fine-tuning has been rarely examined. Most prior works evaluate the effectiveness and generalization of implanted backdoors only at releasing and empirical evidence shows that naively injected backdoor persistence degrades after updates. In this work, we study whether and how implanted backdoors persist through a multi-stage post-deployment fine-tuning. We propose P-Trojan, a trigger-based attack algorithm that explicitly optimizes for backdoor persistence across repeated updates. By aligning poisoned gradients with those of clean tasks on token embeddings, the implanted backdoor mapping is less likely to be suppressed or forgotten during subsequent updates. Theoretical analysis shows the feasibility of such persistent backdoor attacks after continual fine-tuning. And experiments conducted on the Qwen2.5 and LLaMA3 families of LLMs, as well as diverse task sequences, demonstrate that P-Trojan achieves over 99% persistence while preserving clean-task accuracy. Our findings highlight the need for persistence-aware evaluation and stronger defenses in realistic model adaptation pipelines.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 19 of its 24 references that are in the map. First posted on arXiv 12 Dec 2025.

Builds on

19 of 24 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024BadEdit: Backdooring large language models by model editing20 Mar
  2. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training10 Jan
  3. 2022BadPrompt: Backdoor Attacks on Continuous Prompts27 Nov

Other references · 16

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  4. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  5. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  6. 2018Experience Replay for Continual Learningcited by 1,074
  7. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  8. 2020Weight Poisoning Attacks on Pre-trained Modelscited by 318
  9. 2023PMET: Precise Model Editing in a Transformercited by 170
  10. 2020Witches' Brew: Industrial Scale Data Poisoning via Gradient Matchingcited by 156
  11. 2021Backdoor Attacks on Pre-trained Models by Layerwise Weight Poisoningcited by 103
  12. 2022Beyond Not-Forgetting: Continual Learning with Backward Knowledge Transfercited by 59
4 more
  1. 2023BadRL: Sparse Targeted Backdoor Attack Against Reinforcement Learningcited by 29
  2. 2021How much pretraining data do language models need to learn syntax?cited by 21
  3. 2024BadActs: A Universal Backdoor Defense in the Activation Spacecited by 19
  4. 2023Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Modelscited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.