Behavioral Inference at Scale: The Fundamental Asymmetry Between Motivations and Belief Systems
Not on the map. Why?
Abstract (arXiv)
How much information about an agent's underlying values can be recovered from its observable behavior? This question matters for any approach that infers agent properties from action sequences, yet remains empirically open at scale. We address it through controlled experiments: LLM-based agents (Llama 3.1-8B) assigned one of 36 behavioral profiles (9 belief systems x 4 motivations) generate over 1.5 million behavioral sequences in grid-world environments, providing ground truth unavailable in human behavioral studies. After filtering, classifiers train and evaluate on a shared canonical dataset of 10,338 episodes and 1,200,834 sequences. A fundamental asymmetry emerges in both magnitude and structure. Motivations achieve 98-100% accuracy and recover 97% of available mutual information across all architectures. Belief systems plateau at 24% for LSTMs regardless of capacity, and even transformers reach only 34.0%, recovering 16.3% of available information, a 6.1x asymmetry in extraction efficiency. Per-alignment accuracy ranges from 23.2% (Lawful Neutral) to 59.4% (Chaotic Evil). Confusion analysis maps the failure structure: a neutral zone of behavioral ambiguity centers on True Neutral, absorbing misclassified samples from adjacent Neutral and Good alignments whose prosocial or balance-keeping behavior lacks distinctive signal. Combined inference yields 12.2x improvement over random baseline for full 36-class profile classification, with the bottleneck located entirely in belief system inference. Signal enhancement and explanatory queries yield only marginal LSTM gains (+3.8%), confirming the recurrent ceiling is architectural rather than data-limited. Whether the transformer's 34.0% ceiling reflects a similar architectural-class limit or a more fundamental bound remains open. These results characterize what behavioral observation can and cannot reveal about LLM agent values.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 28 references that are in the map. First posted on arXiv 6 Sep 2025.
Builds on
9 of 28 references.
References · 9
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
- 2024Alignment faking in large language modelscited by 360
- 2024Frontier Models are Capable of In-context Schemingcited by 287
- 2018Analysis Methods in Neural Language Processing: A Surveycited by 277
- 2021Curriculum Learning: A Surveycited by 259
- 2017Inverse Reward Designcited by 249
- 2022Defining and Characterizing Reward Hackingcited by 203
- 2022Personality Type Based on Myers-Briggs Type Indicator with Text Posting Style by using Traditional and Deep Learningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026When Agents Disagree With Themselves: Behavioral Consistency as an Uncertainty Signal for LLM Agents
- 2026On the Behavioral Traits of LLM Agents
- 2025The Limits of Predicting Agents from Behaviour
- 2026Instrumental Choices: Measuring the Propensity of LLM Agents to Pursue Instrumental Behaviors
- 2026The belief-action gap in language model agents
- 2026Avalon-ToM-Bench: Evaluating Fine-Grained Theory of Mind via Asymmetric Game Mechanics
- 2025MotiveBench: How Far Are We From Human-Like Motivational Reasoning in Large Language Models?
- 2026Belief Without Behavior: Measuring the Translation of Theory of Mind into Coordinated Social Action in Vision-Language Models