Risk Profiling and Modulation for LLMs
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used for decision-making tasks under uncertainty; however, their risk profiles and how they are influenced by prompting and alignment methods remain underexplored. Existing studies have primarily examined personality prompting or multi-agent interactions, leaving open the question of how post-training influences the risk behavior of LLMs. In this work, we propose a new pipeline for eliciting, steering, and modulating LLMs' risk profiles, drawing on tools from behavioral economics and finance. Using utility-theoretic models, we compare pre-trained, instruction-tuned, and RLHF-aligned LLMs, and find that while instruction-tuned models exhibit behaviors consistent with some standard utility formulations, pre-trained and RLHF-aligned models deviate more from any utility models fitted. We further evaluate modulation strategies, including prompt engineering, in-context learning, and post-training, and show that post-training provides the most stable and effective modulation of risk preference. Our findings provide insights into the risk profiles of different classes and stages of LLMs and demonstrate how post-training modulates these profiles, laying the groundwork for future research on behavioral alignment and risk-aware LLM design.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 57 references that are in the map. First posted on arXiv 27 Sep 2025.
Builds on
13 of 57 references.
References · 13
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
- 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 79
- 2023FinGPT: Instruction Tuning Benchmark for Open-Source Large Language Models in Financial Datasetscited by 69
- 2024MedExQA: Medical Question Answering Benchmark with Multiple Explanationscited by 60
- 2024Large Language Model Agent in Financial Trading: A Surveycited by 60
- 2024LLM economicus? Mapping the Behavioral Biases of LLMs via Utility Theorycited by 47
- 2024Decision-Making Behavior Evaluation Framework for LLMs under Uncertain Contextcited by 41
- 2024Prompting Techniques for Reducing Social Bias in LLMs through System 1 and System 2 Cognitive Processescited by 39
- 2025Agentic AI Systems Applied to tasks in Financial Services: Modeling and model risk management crewscited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Evaluating and Aligning Human Economic Risk Preferences in LLMs
- 2025Predicting Effects, Missing Distributions: Evaluating LLMs as Human Behavior Simulators in Operations Management
- 2025Can Large Language Models Capture Human Risk Preferences? A Cross-Cultural Study
- 2023The Challenge of Using LLMs to Simulate Human Behavior: A Causal Inference Perspective
- 2024AI as Decision-Maker: Ethics and Risk Preferences of LLMs
- 2025Steering Risk Preferences in Large Language Models by Aligning Behavioral and Neural Representations
- 2025Can large language models assist choice modelling? Insights into prompting strategies and current models' capabilities
- 2026Mind the (DH) Gap! A Contrast in Risky Choices Between Reasoning and Conversational LLMs