mlsanityData to 7 Oct 2026

Characterizing the Consistency of the Emergent Misalignment Persona

arXiv 2604.28082 ↗First posted 30 Apr 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Fine-tuning large language models (LLMs) on narrowly misaligned data generalizes to broadly misaligned behavior, a phenomenon termed emergent misalignment (EM). While prior work has found a correlation between harmful behavior and self-assessment in emergently misaligned models, it remains unclear how consistent this correspondence is across tasks and whether it varies across fine-tuning domains. We characterize the consistency of the EM persona by fine-tuning Qwen 2.5 32B Instruct on six narrowly misaligned domains (e.g., insecure code, risky financial advice, bad medical advice) and administering experiments including harmfulness evaluation, self-assessment, choosing between two descriptions of AI systems, output recognition, and score prediction. Our results reveal two distinct patterns: coherent-persona models, in which harmful behavior and self-reported misalignment are coupled, and inverted-persona models, which produce harmful outputs while identifying as aligned AI systems. These findings reveal a more fine-grained picture of the effects of emergent misalignment, calling into question the consistency of the EM persona.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 30 Apr 2026.

Builds on

12 of 22 references.

References · 12

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Taken out of context: On measuring situational awareness in LLMscited by 131
  3. 2025Natural Emergent Misalignment from Reward Hacking in Production RLcited by 111
  4. 2024Looking Inward: Language Models Can Learn About Themselves by Introspectioncited by 105
  5. 2025Tell me about yourself: LLMs are aware of their learned behaviorscited by 86
  6. 2025Model Organisms for Emergent Misalignmentcited by 84
  7. 2025Convergent Linear Representations of Emergent Misalignmentcited by 66
  8. 2025Thought Crime: Backdoors and Emergent Misalignment in Reasoning Modelscited by 57
  9. 2025Self-Interpretability: LLMs Can Describe Complex Internal Processes that Drive Their Decisionscited by 23
  10. 2025Training LLMs for Honesty via Confessionscited by 19
  11. 2025Spilling the Beans: Teaching LLMs to Self-Report Their Hidden Objectivescited by 13
  12. 2026Emergently Misaligned Language Models Show Behavioral Self-Awareness That Shifts With Subsequent Realignmentcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.