Sparks of Rationality: Do Reasoning LLMs Align with Human Judgment and Choice?
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large Language Models (LLMs) are increasingly positioned as decision engines for hiring, healthcare, and economic judgment, yet real-world human judgment reflects a balance between rational deliberation and emotion-driven bias. If LLMs are to participate in high-stakes decisions or serve as models of human behavior, it is critical to assess whether they exhibit analogous patterns of (ir)rationalities and biases. To this end, we evaluate multiple LLM families on (i) benchmarks testing core axioms of rational choice and (ii) classic decision domains from behavioral economics and social norms where emotions are known to shape judgment and choice. Across settings, we show that deliberate "thinking" reliably improves rationality and pushes models toward expected-value maximization. To probe human-like affective distortions and their interaction with reasoning, we use two emotion-steering methods: in-context priming (ICP) and representation-level steering (RLS). ICP induces strong directional shifts that are often extreme and difficult to calibrate, whereas RLS produces more psychologically plausible patterns but with lower reliability. Our results suggest that the same mechanisms that improve rationality also amplify sensitivity to affective interventions, and that different steering methods trade off controllability against human-aligned behavior. Overall, this points to a tension between reasoning and affective steering, with implications for both human simulation and the safe deployment of LLM-based decision systems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 0 of its 89 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
0 of 89 references.
No references here yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Do LLMs Choose Like Humans? Using Cognitive Theory to Evaluate LLM Decision-Making
- 2026LLMs Should Not Yet Be Credited with Decision Explanation
- 2024(Ir)rationality and Cognitive Biases in Large Language Models
- 2025Noise, Adaptation, and Strategy: Assessing LLM Fidelity in Decision-Making
- 2025Rethinking Human Preference Evaluation of LLM Rationales
- 2026Mind the (DH) Gap! A Contrast in Risky Choices Between Reasoning and Conversational LLMs
- 2026Do LLMs Share Human-Like Biases? Causal Reasoning Under Prior Knowledge, Irrelevant Context, and Varying Compute Budgets
- 2026Do LLMs Have Values? A Quantitative Analysis and Alignment Framework for Values in Large Language Models