mlsanityData to 14 Oct 2026

Character as a Latent Variable in Large Language Models: A Mechanistic Account of Emergent Misalignment and Conditional Safety Failures

arXiv 2601.23081 ↗First posted 30 Jan 2026cs.CL cs.AI cs.CRcited by 5

On the map: LLM safety and security → Safety alignment, refusal and guardrails

Abstract (arXiv)

Emergent Misalignment refers to a failure mode in which fine-tuning large language models (LLMs) on narrowly scoped data induces broadly misaligned behavior. Prior explanations mainly attribute this phenomenon to the generalization of erroneous or unsafe content. In this work, we show that this view is incomplete. Across multiple domains and model families, we find that fine-tuning models on data exhibiting specific character-level dispositions induces substantially stronger and more transferable misalignment than incorrect-advice fine-tuning, while largely preserving general capabilities. This indicates that emergent misalignment arises from stable shifts in model behavior rather than from capability degradation or corrupted knowledge. We further show that such behavioral dispositions can be conditionally activated by both training-time triggers and inference-time persona-aligned prompts, revealing shared structure across emergent misalignment, backdoor activation, and jailbreak susceptibility. Overall, our results identify character formation as a central and underexplored alignment risk, suggesting that robust alignment must address behavioral dispositions rather than isolated errors or prompt-level defenses.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 23 of its 26 references that are in the map. First posted on arXiv 30 Jan 2026.

Builds on

23 of 26 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Thought Crime: Backdoors and Emergent Misalignment in Reasoning Models16 Jun
  2. 2025Tell me about yourself: LLMs are aware of their learned behaviors19 Jan
  3. 2024Who's asking? User personas and the mechanics of latent misalignment17 Jun
  4. 2024What is in Your Safe Data? Identifying Benign Data that Breaks Safety1 Apr
  5. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!5 Oct

Other references · 18

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  3. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  4. 2023AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Modelscited by 785
  5. 2023Catastrophic Jailbreak of Open-source LLMs via Exploiting Generationcited by 451
  6. 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 360
  7. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  8. 2023Scalable and Transferable Black-Box Jailbreaks for Language Models via Persona Modulationcited by 214
  9. 2024Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Modelscited by 178
  10. 2025Natural Emergent Misalignment from Reward Hacking in Production RLcited by 136
  11. 2024BadEdit: Backdooring large language models by model editingcited by 96
  12. 2025Persona Features Control Emergent Misalignmentcited by 86
6 more
  1. 2025Convergent Linear Representations of Emergent Misalignmentcited by 71
  2. 2025Weird Generalization and Inductive Backdoors: New Ways to Corrupt LLMscited by 55
  3. 2023Personas as a Way to Model Truthfulness in Language Modelscited by 47
  4. 2023Stealthy and Persistent Unalignment on Large Language Models via Backdoor Injectionscited by 39
  5. 2025Injecting Universal Jailbreak Backdoors into LLMs in Minutescited by 13
  6. 2025Shared Parameter Subspaces and Cross-Task Linearity in Emergently Misaligned Behaviorcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Persona-Model Collapse in Emergent Misalignment
  2. 2026Data Attribution of Emergent Misalignment with Persona Features
  3. 2026Characterizing the Consistency of the Emergent Misalignment Persona
  4. 2026Pressure Reveals Character: Behavioural Alignment Evaluation at Depth
  5. 2025Eliciting and Analyzing Emergent Misalignment in State-of-the-Art Large Language Models
  6. 2026TAME: Token Attribution and Masking for Emergent misalignment
  7. 2025Re-Emergent Misalignment: How Narrow Fine-Tuning Erodes Safety Alignment in LLMs
  8. 2026Emergent Unfaithfulness: How Alignment Training Causes Language Models to Silently Override Task Faithfulness