Do LLMs Choose Like Humans? Using Cognitive Theory to Evaluate LLM Decision-Making
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) exhibit a range of human-like decision-making behaviors, but whether these reflect similar underlying mechanisms or surface-level mimicry remains unclear. We evaluate whether LLM context sensitivity aligns with a cognitive economic theory that explains human behavior through problem categorization and attention allocation. Across 12 open-source and commercial LLMs on a novel 140,000-trial product choice benchmark, context induces human-like shifts in choice and problem categorization, but does not reliably reweight attention between features like price and quality. Neither scale nor chain-of-thought reasoning reliably attenuates context sensitivity or generates human-like behavior. These results suggest that LLM decision mechanisms are distinct from human ones.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 83 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
23 of 83 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 938
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
- 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
- 2024LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individualscited by 249
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 199
- 2022Thinking Fast and Slow in Large Language Modelscited by 137
- 2024Cognitive Bias in Decision-Making with LLMscited by 106
- 2022Capturing Failures of Large Language Models via Human Cognitive Biasescited by 98
11 more
- 2023The Challenge of Using LLMs to Simulate Human Behavior: A Causal Inference Perspectivecited by 59
- 2023Instructed to Bias: Instruction-Tuned Language Models Exhibit Emergent Cognitive Biascited by 53
- 2024LLM economicus? Mapping the Behavioral Biases of LLMs via Utility Theorycited by 47
- 2024A Comprehensive Evaluation of Cognitive Biases in LLMscited by 34
- 2026This human study did not involve human subjects: Validating LLM simulations as behavioral evidencecited by 29
- 2025Presumed Cultural Identity: How Names Shape LLM Responsescited by 21
- 2025Robustly Improving LLM Fairness in Realistic Settings via Interpretabilitycited by 18
- 2026Behavioral Economics of AI: LLM Biases and Correctionscited by 9
- 2025Comparing the Framing Effect in Humans and LLMs on Naturally Occurring Textscited by 6
- 2026Persona Vectors in Games: Measuring and Steering Strategies via Activation Vectorscited by 6
- 2025Rethinking Prospect Theory for LLMs: Revealing the Instability of Decision-Making under Epistemic Uncertaintycited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Sparks of Rationality: Do Reasoning LLMs Align with Human Judgment and Choice?
- 2025LLM Agents Display Human Biases but Exhibit Distinct Learning Patterns
- 2023Can LLMs Capture Human Preferences?
- 2026LLM Consumer Behavior Theory: Foundations of a Novel Research Field
- 2024Can LLMs Replace Economic Choice Prediction Labs? The Case of Language-based Persuasion Games
- 2025Noise, Adaptation, and Strategy: Assessing LLM Fidelity in Decision-Making
- 2024Humanlike Cognitive Patterns as Emergent Phenomena in Large Language Models
- 2026Mind the (DH) Gap! A Contrast in Risky Choices Between Reasoning and Conversational LLMs