mlsanityData to 7 Oct 2026

Stealthy Backdoor Attacks against LLMs Based on Natural Style Triggers

arXiv 2604.21700 ↗First posted 23 Apr 2026cs.CR cs.AI cs.CLcited by 1

On the map: LLM safety and security → Backdoor and data poisoning attacks

Abstract (arXiv)

The growing application of large language models (LLMs) in safety-critical domains has raised urgent concerns about their security. Many recent studies have demonstrated the feasibility of backdoor attacks against LLMs. However, existing methods suffer from three key shortcomings: explicit trigger patterns that compromise naturalness, unreliable injection of attacker-specified payloads in long-form generation, and incompletely specified threat models that obscure how backdoors are delivered and activated in practice. To address these gaps, we present BadStyle, a complete backdoor attack framework and pipeline. BadStyle leverages an LLM as a poisoned sample generator to construct natural and stealthy poisoned samples that carry imperceptible style-level triggers while preserving semantics and fluency. To stabilize payload injection during fine-tuning, we design an auxiliary target loss that reinforces the attacker-specified target content in responses to poisoned inputs and penalizes its emergence in benign responses. We further ground the attack in a realistic threat model and systematically evaluate BadStyle under both prompt-induced and PEFT-based injection strategies. Extensive experiments across seven victim LLMs, including LLaMA, Phi, DeepSeek, and GPT series, demonstrate that BadStyle achieves high attack success rates (ASRs) while maintaining strong stealthiness. The proposed auxiliary target loss substantially improves the stability of backdoor activation, yielding an average ASR improvement of around 30% across style-level triggers. Even in downstream deployment scenarios unknown during injection, the implanted backdoor remains effective. Moreover, BadStyle consistently evades representative input-level defenses and bypasses output-level defenses through simple camouflage.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Backdoor and data poisoning attacks, one of 12 directions in LLM safety and security. Builds on 43 of its 57 references that are in the map. First posted on arXiv 23 Apr 2026.

Builds on

43 of 57 references.

Closest ancestors · 18

Same direction, newest first

  1. 2025A Survey on Backdoor Threats in Large Language Models (LLMs): Attacks, Defenses, and Evaluations6 Feb
  2. 2024BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Models23 Aug
  3. 2024A Survey of Recent Backdoor Attacks and Defenses in Large Language Models10 Jun
  4. 2024BadEdit: Backdooring large language models by model editing20 Mar
  5. 2024Instruction Backdoor Attacks Against Customized LLMs14 Feb
  6. 2024BadChain: Backdoor Chain-of-Thought Prompting for Large Language Models20 Jan
  7. 2024Universal Vulnerabilities in Large Language Models: Backdoor Attacks for In-context Learning11 Jan
  8. 2023TARGET: Template-Transferable Backdoor Attack Against Prompt-based NLP Models via GPT429 Nov
  9. 2023Large Language Models Are Better Adversaries: Exploring Generative Clean-Label Backdoor Attacks Against Text Classifiers28 Oct
  10. 2023PoisonPrompt: Backdoor Attack on Prompt-based Large Language Models19 Oct
  11. 2023Backdoor Attacks and Countermeasures in Natural Language Processing Models: A Comprehensive Security Review12 Sep
  12. 2023Backdoor Attacks for In-Context Learning with Language Models27 Jul
6 more
  1. 2023Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Models24 May
  2. 2023ChatGPT as an Attack Tool: Stealthy Textual Backdoor Attack via Blackbox Generative Model Trigger27 Apr
  3. 2023BadGPT: Exploring Security Vulnerabilities of ChatGPT via Backdoor Attacks to InstructGPT21 Feb
  4. 2023BDMMT: Backdoor Sample Detection for Language Models through Model Mutation Testing25 Jan
  5. 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer14 Oct
  6. 2021Hidden Backdoors in Human-Centric Language Models1 May

Other references · 25

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  5. 2023A Comprehensive Overview of Large Language Modelscited by 639
  6. 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
  7. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
  8. 2020Weight Poisoning Attacks on Pre-trained Modelscited by 318
  9. 2020ONION: A Simple and Effective Defense Against Textual Backdoor Attackscited by 231
  10. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 209
  11. 2018Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfercited by 191
  12. 2020BadNL: Backdoor Attacks against NLP Models with Semantic-preserving Improvementscited by 191
13 more
  1. 2020Reformulating Unsupervised Style Transfer as Paraphrase Generationcited by 181
  2. 2020Deep Learning for Text Style Transfer: A Surveycited by 161
  3. 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 156
  4. 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
  5. 2021Jigsaw: Large Language Models meet Program Synthesiscited by 103
  6. 2023Is RLHF More Difficult than Standard RL?cited by 96
  7. 2020Trojaning Language Models for Fun and Profitcited by 80
  8. 2024When LLMs Meet Cybersecurity: A Systematic Literature Reviewcited by 70
  9. 2019IMaT: Unsupervised Text Attribute Transfer via Iterative Matching and Translationcited by 33
  10. 2023The Philosopher's Stone: Trojaning Plugins of Large Language Modelscited by 31
  11. 2023Trojan Activation Attack: Red-Teaming Large Language Models using Activation Steering for Safety-Alignmentcited by 27
  12. 2025Security Concerns for Large Language Models: A Surveycited by 26
  13. 2019Revision in Continuous Space: Unsupervised Text Style Transfer without Adversarial Learningcited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.