Rethinking Prospect Theory for LLMs: Revealing the Instability of Decision-Making under Epistemic Uncertainty
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Real-world decision-making often involves uncertainty expressed in linguistic rather than numerical terms, and Prospect Theory (PT) provides a classic framework for modeling human behavior under such uncertainty. Although recent studies have developed frameworks to estimate PT parameters for Large Language Models (LLMs), few have examined whether PT itself adequately describes LLM decision-making behavior. To address these gaps, we develop a streamlined workflow grounded in a classic behavioral economics experimental paradigm. First, we estimate PT parameters and evaluate how well the resulting model captures LLM decision-making behavior. We then derive probability mappings for epistemic markers in the same context and inject them into prompts to examine the stability of PT parameters under linguistic uncertainty. Our findings suggest that PT does not consistently provide a reliable account of LLM decision-making across models, and that its application to LLMs is likely sensitive to epistemic uncertainty. The findings caution against the deployment of PT-based frameworks in real-world applications where epistemic ambiguity is prevalent, giving valuable insights in behaviour interpretation and future alignment direction for LLM decision-making.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 15 of its 45 references that are in the map. First posted on arXiv 12 Aug 2025.
Builds on
15 of 45 references.
References · 15
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024Relying on the Unreliable: The Impact of Language Models' Reluctance to Express Uncertaintycited by 106
- 2025From Automation to Autonomy: A Survey on Large Language Models in Scientific Discoverycited by 93
- 2023Navigating the Grey Area: How Expressions of Uncertainty and Overconfidence Affect Language Modelscited by 91
- 2024Decision-Making Behavior Evaluation Framework for LLMs under Uncertain Contextcited by 41
- 2024Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluationcited by 29
- 2025Mathematical Proof as a Litmus Test: Revealing Failure Modes of Advanced Large Reasoning Modelscited by 20
- 2022Learning to Ask Like a Physiciancited by 16
- 2025Revisiting Epistemic Markers in Confidence Estimation: Can Markers Accurately Reflect Large Language Models' Uncertainty?cited by 16
- 2024Perceptions of Linguistic Uncertainty by Language Models and Humanscited by 15
- 2025Diversity-Enhanced Reasoning for Subjective Questionscited by 9
- 2025Evaluating and Aligning Human Economic Risk Preferences in LLMscited by 8
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026PlanBench-XL: Evaluating Long-Horizon Planning of LLM Tool-Use Agents in Large-Scale Tool Ecosystemscited by 11
- 2025CritiCal: Can Critique Help LLM Uncertainty or Confidence Calibration?cited by 4
- 2026Temporal Preference Concepts and their Functions in a Large Language Modelcited by 0
- 2026Do LLMs Choose Like Humans? Using Cognitive Theory to Evaluate LLM Decision-Makingcited by 0
- 2026Do LLMs Choose Like Humans? Using Cognitive Theory to Evaluate LLM Decision-Making2 Sep 2026
- 2026PlanBench-XL: Evaluating Long-Horizon Planning of LLM Tool-Use Agents in Large-Scale Tool Ecosystems21 Jun 2026
- 2026Temporal Preference Concepts and their Functions in a Large Language Model11 May 2026
- 2025CritiCal: Can Critique Help LLM Uncertainty or Confidence Calibration?28 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Mind the (DH) Gap! A Contrast in Risky Choices Between Reasoning and Conversational LLMs
- 2025Noise, Adaptation, and Strategy: Assessing LLM Fidelity in Decision-Making
- 2023The Challenge of Using LLMs to Simulate Human Behavior: A Causal Inference Perspective
- 2026Probing Outcome-Level Resemblance and Mechanism-Level Alignment in LLM Risk Decisions: Evidence from the St. Petersburg Game
- 2026LLMs Should Not Yet Be Credited with Decision Explanation
- 2026Representation Without Control: Testing the Realization Effect in Language Models
- 2026When Preferences Fail to Become Incentives: A Utility-Behavior Gap in Large Language Models
- 2025Risk Profiling and Modulation for LLMs