mlsanityData to 14 Oct 2026

"Dark Triad" Model Organisms of Misalignment: Narrow Fine-Tuning Mirrors Human Antisocial Behavior

arXiv 2603.06816 ↗First posted 6 Mar 2026cs.CL cs.AI q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

The alignment problem refers to concerns regarding powerful intelligences, ensuring compatibility with human preferences and values as capabilities increase. Current large language models (LLMs) show misaligned behaviors, such as strategic deception, manipulation, and reward-seeking, that can arise despite safety training. Gaining a mechanistic understanding of these failures requires empirical approaches that can isolate behavioral patterns in controlled settings. We propose that biological misalignment precedes artificial misalignment, and leverage the Dark Triad of personality (narcissism, psychopathy, and Machiavellianism) as a psychologically grounded framework for constructing model organisms of misalignment. In Study 1, we establish comprehensive behavioral profiles of Dark Triad traits in a human population (N = 318), identifying affective dissonance as a central empathic deficit connecting the traits, as well as trait-specific patterns in moral reasoning and deceptive behavior. In Study 2, we demonstrate that dark personas can be reliably induced in frontier LLMs through minimal fine-tuning on validated psychometric instruments. Narrow training datasets as small as 36 psychometric items resulted in significant shifts across behavioral measures that closely mirrored human antisocial profiles. Critically, models generalized beyond training items, demonstrating out-of-context reasoning rather than memorization. These findings reveal latent persona structures within LLMs that can be readily activated through narrow interventions, positioning the Dark Triad as a validated framework for inducing, detecting, and understanding misalignment across both biological and artificial intelligence.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 92 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

29 of 92 references.

References · 29

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Deep reinforcement learning from human preferencescited by 3,912
  3. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  4. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  5. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  6. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  7. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
  8. 2022Using cognitive psychology to understand GPT-3cited by 398
  9. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  10. 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
  11. 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
  12. 2022The Alignment Problem from a Deep Learning Perspectivecited by 258
17 more
  1. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
  2. 2023Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmarkcited by 182
  3. 2023Model evaluation for extreme riskscited by 177
  4. 2023Training Language Models with Language Feedback at Scalecited by 128
  5. 2022Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goalscited by 126
  6. 2021Goal Misgeneralization in Deep Reinforcement Learningcited by 123
  7. 2022Evaluating and Inducing Personality in Pre-trained Language Modelscited by 123
  8. 2023Deception Abilities Emerged in Large Language Modelscited by 101
  9. 2025Model Organisms for Emergent Misalignmentcited by 91
  10. 2025Persona Features Control Emergent Misalignmentcited by 86
  11. 2024Do LLMs Have Distinct and Consistent Personality? TRAIT: Personality Testset designed for LLMs with Psychometricscited by 59
  12. 2025Weird Generalization and Inductive Backdoors: New Ways to Corrupt LLMscited by 55
  13. 2023Hoodwinked: Deception and Cooperation in a Text-Based Game for Language Modelscited by 47
  14. 2020Avoiding Side Effects By Considering Future Taskscited by 32
  15. 2022Evaluating Psychological Safety of Large Language Modelscited by 26
  16. 2025Compromising Honesty and Harmlessness in Language Models via Deception Attackscited by 17
  17. 2016Generalized Network Psychometrics: Combining Network and Latent Variable Modelscited by 1

Built on by

Not cited yet.