mlsanityData to 14 Oct 2026

The Internal Anatomy of Strategic Choice in Large Language Models

arXiv 2609.07478 ↗First posted 7 Sep 2026cs.AI cs.GTcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models act as strategic agents and models of human choice, yet choosing like a strategic agent does not mean computing like one. We recorded activations from four open-weight models --- dense and mixture-of-experts, including a matched base--instruct pair --- in one-shot play of 144 strict ordinal 2×2 games. We followed a prespecified incentive from prompt, through activations, to choice. Dense models mirrored the unadjusted human decline with game complexity. Incentive and choice were detectable in every model, but models differed in whether incentive reached the choice, aligned with it and, where tested, whether strengthening it shifted preference. The base and instruction-tuned Qwen2.5 models chose almost identically at baseline yet differed in whether incentive reached choice. Fixed decision cues were distinguishable internally but changed choices selectively. Similar behaviour can rest on different computation; post-training can reshape the path from represented incentive to decision while leaving behaviour and decodable information largely intact.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 66 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

25 of 66 references.

References · 25

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  5. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  6. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  7. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  8. 2023Steering Language Models With Activation Engineeringcited by 922
  9. 2022LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scalecited by 906
  10. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
  11. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
  12. 2022Using cognitive psychology to understand GPT-3cited by 398
13 more
  1. 2023Playing repeated games with Large Language Modelscited by 217
  2. 2026Emotion Concepts and their Function in a Large Language Modelcited by 57
  3. 2024Densing Law of LLMscited by 40
  4. 2024Six Fallacies in Substituting Large Language Models for Human Participantscited by 24
  5. 2023The Machine Psychology of Cooperation: Can GPT models operationalise prompts for altruism, cooperation, competitiveness and selfishness in economic games?cited by 22
  6. 2024Capturing the Complexity of Human Strategic Decision-Making with Machine Learningcited by 14
  7. 2013Predicting Human Behavior in Unrepeated, Simultaneous-Move Gamescited by 10
  8. 2026Behavioral Economics of AI: LLM Biases and Correctionscited by 9
  9. 2026On the Non-Identifiability of Steering Vectors in Large Language Modelscited by 8
  10. 2025Steering Risk Preferences in Large Language Models by Aligning Behavioral and Neural Representationscited by 6
  11. 2026Why Do LLMs Struggle in Strategic Play? Broken Links Between Observations, Beliefs, and Actionscited by 3
  12. 2026Representation Without Control: Testing the Realization Effect in Language Modelscited by 2
  13. 2026A game theory for foundation models shows new paths to rational cooperation through similarity inferencecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Fragility of Strategic Thinking in Large Language Models
  2. 2025Humans expect rationality and cooperation from LLM opponents in strategic games
  3. 2026Using Cognitive Models to Improve Language Model Simulation of Human Persuasion Games
  4. 2024Large Model Strategic Thinking, Small Model Efficiency: Transferring Theory of Mind in Large Language Models
  5. 2026Alignment Makes Language Models Normative, Not Descriptive
  6. 2024Do Large Language Models Learn Human-Like Strategic Preferences?
  7. 2026When Preferences Fail to Become Incentives: A Utility-Behavior Gap in Large Language Models
  8. 2024Are Large Language Models Strategic Decision Makers? A Study of Performance and Bias in Two-Player Non-Zero-Sum Games