Limited or Biased: Modeling Sub-Rational Human Investors in Financial Markets
Not on the map. Why?
Abstract (arXiv)
Human decision-making in real-life deviates significantly from the optimal decisions made by fully rational agents, primarily due to computational limitations or psychological biases. While existing studies in behavioral finance have discovered various aspects of human sub-rationality, there lacks a comprehensive framework to transfer these findings into an adaptive human model applicable across diverse financial market scenarios. In this study, we introduce a flexible model that incorporates five different aspects of human sub-rationality using reinforcement learning. Our model is trained using a high-fidelity multi-agent market simulator, which overcomes limitations associated with the scarcity of labeled data of individual investors. We evaluate the behavior of sub-rational human investors using hand-crafted market scenarios and SHAP value analysis, showing that our model accurately reproduces the observations in the previous studies and reveals insights of the driving factors of human behavior. Finally, we explore the impact of sub-rationality on the investor's Profit and Loss (PnL) and market quality. Our experiments reveal that bounded-rational and prospect-biased human behaviors improve liquidity but diminish price efficiency, whereas human behavior influenced by myopia, optimism, and pessimism reduces market liquidity.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 17 of its 75 references that are in the map. First posted on arXiv 16 Oct 2022.
Builds on
17 of 75 references.
References · 17
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2018Soft Actor-Critic Algorithms and Applicationscited by 1,179
- 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 753
- 2013Risk-sensitive Reinforcement Learningcited by 129
- 2019Hyperbolic Discounting and Learning over Multiple Horizonscited by 58
- 2015Learning the Preferences of Ignorant, Inconsistent Agentscited by 45
- 2018Market Making via Reinforcement Learningcited by 45
- 2018Where Do You Think You're Going?: Inferring Beliefs about Dynamics from Behaviorcited by 40
- 2019Get Real: Realism Metrics for Robust Limit Order Book Market Simulationscited by 40
- 2021ABIDES-Gym: Gym Environments for Multi-Agent Discrete Event Simulation and Application to Financial Marketscited by 34
- 2019ABIDES: Towards High-Fidelity Market Simulation for AI Researchcited by 31
5 more
- 2022Learning to simulate realistic limit order book markets from data as a World Agentcited by 27
- 2021Human irrationality: both bad and good for reward inferencecited by 25
- 2019How to Evaluate Trading Strategies: Single Agent Market Replay or Multiple Agent Interactive Simulation?cited by 15
- 2019Risk-Sensitive Compact Decision Trees for Autonomous Execution in Presence of Simulated Market Responsecited by 6
- 2021Profit equitably: An investigation of market maker's impact on equitable outcomescited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.