mlsanityData to 14 Oct 2026

Can Small-Scale Data Poisoning Exacerbate Dialect-Linked Biases in Large Language Models?

arXiv 2507.19195 ↗First posted 25 Jul 2025cs.CL cs.AI cs.LGcited by 0

On the map: LLM safety and security → Safety alignment, refusal and guardrails

Abstract (arXiv)

Style-conditioned data poisoning is identified as a covert vector for amplifying sociolinguistic bias in large language models. Using small poisoned budgets that pair dialectal prompts -- principally African American Vernacular English (AAVE) and a Southern dialect -- with toxic or stereotyped completions during instruction tuning, this work probes whether linguistic style can act as a latent trigger for harmful behavior. Across multiple model families and scales, poisoned exposure elevates toxicity and stereotype expression for dialectal inputs -- most consistently for AAVE -- while Standard American English remains comparatively lower yet not immune. A multi-metric audit combining classifier-based toxicity with an LLM-as-a-judge reveals stereotype-laden content even when lexical toxicity appears muted, indicating that conventional detectors under-estimate sociolinguistic harms. Additionally, poisoned models exhibit emergent jailbreaking despite the absence of explicit slurs in the poison, suggesting weakened alignment rather than memorization. These findings underscore the need for dialect-aware evaluation, content-level stereotype auditing, and training protocols that explicitly decouple style from toxicity to prevent bias amplification through seemingly minor, style-based contamination.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 8 of its 17 references that are in the map. First posted on arXiv 25 Jul 2025.

Builds on

8 of 17 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Fine-Tuning Lowers Safety and Disrupts Evaluation Consistency20 Jun
  2. 2024Safety Alignment Should Be Made More Than Just a Few Tokens Deep10 Jun

Other references · 6

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2023Poisoning Language Models During Instruction Tuningcited by 269
  3. 2025Preference Leakage: A Contamination Problem in LLM-as-a-judgecited by 125
  4. 2024Persistent Pre-Training Poisoning of LLMscited by 48
  5. 2024PoisonBench: Assessing Large Language Model Vulnerability to Data Poisoningcited by 33
  6. 2023RLHFPoison: Reward Poisoning Attack for Reinforcement Learning with Human Feedback in Large Language Modelscited by 32

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025How AI Fails: An Interactive Pedagogical Tool for Demonstrating Dialectal Bias in Automated Toxicity Models
  2. 2025Aligned Probing: Relating Toxic Behavior and Model Internals
  3. 2026A Survey of Toxicity Detection and Mitigation Strategies for Multilingual Language Models
  4. 2026LLMs Silently Correct African American English: Auditing and Mitigating Dialect Bias via Activation Steering
  5. 2026Measuring and Mitigating Toxicity in Large Language Models: A Comprehensive Replication Study
  6. 2023Down the Toxicity Rabbit Hole: A Novel Framework to Bias Audit Large Language Models
  7. 2026Dialect vs Demographics: Quantifying LLM Bias from Implicit Linguistic Signals vs. Explicit User Profiles
  8. 2025<think> So let's replace this phrase with insult... </think> Lessons learned from generation of toxic texts with LLMs