Modeling Pathology-Like Behavioral Patterns in Language Models Through Behavioral Fine-Tuning
Not on the map. Why?
Abstract (arXiv)
Large language models are increasingly used as computational tools for modeling human-like behavior. We introduce a behavioral induction framework that modifies model policies through fine-tuning on structured decision-making tasks: using synthetic datasets inspired by maladaptive behavioral patterns, including depression and paranoia, we train transformer-based language models to consistently select specific classes of actions across diverse contexts. We then test whether this behavioral optimization produces systematic changes in generative distributions. Across two architectures, fine-tuned models show stable, context-general shifts in next-token probability distributions, including increased probability assigned to negative and threat-related interpretations in open-ended language tasks. These effects generalize beyond training contexts and are detectable in qualitative completions, psychometric-style evaluations, and quantitative distributional metrics such as Jensen-Shannon divergence. Induced behavioral profiles also show partial specificity. Models optimized for different behavioral patterns exhibit dissociable response tendencies across evaluation probes, suggesting that structured behavioral training produces differentiated policy-level biases rather than generic distributional skew. We interpret these findings as evidence that consistent behavioral optimization in LLMs can generate stable behavioral and distributional patterns consistent with altered latent priors, linking action selection and language generation. More broadly, the results support a view of LLMs as policy-based systems in which behavioral constraints shape emergent representational structure, highlighting their potential as controlled testbeds for studying the relationship between behavior, interpretation, and generative language in computational models of cognition.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 30 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
13 of 30 references.
References · 13
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
- 2022Using cognitive psychology to understand GPT-3cited by 398
- 2023Role-Play with Large Language Modelscited by 294
- 2023Evaluating Large Language Models in Theory of Mind Taskscited by 222
- 2023Evaluating Cognitive Maps and Planning in Large Language Models with CogEvalcited by 77
1 more
Built on by
Not cited yet.