Are LLMs Good Financial User Simulators? Multi-view Investor Logic Alignment (MILA)
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used as user simulators, yet it remains unclear whether their predictions faithfully reproduce the evolving decisions of individual users. We investigate this question in a controlled longitudinal paper-trading study with 80 participants, where user interactions, simulated transactions, virtual portfolio states, and point-in-time market information are aligned under a rolling next-day prediction protocol. We evaluate behavioral fidelity hierarchically, from trade occurrence to action structure, asset selection, and downstream portfolio consequences. Across 1,239 aligned user-days, no evaluated LLM reliably outperforms a simple recent-activity persistence baseline for predicting whether a user trades. Fidelity further deteriorates at finer levels: models struggle to recover buy--sell structure and traded assets, and similar activity-level predictions can lead to substantially different portfolio trajectories. Controlled evidence ablations show that recent trading history strongly governs activity prediction, whereas asset selection is substantially more sensitive to the available evidence. An observational analysis further finds that intensified ticker-specific research predicts imminent trading, but diagnostic tests do not support a causal interpretation. These findings suggest that current LLMs capture useful short-term behavioral regularities without yet recovering a stable individual decision mechanism.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 23 references that are in the map. First posted on arXiv 14 Sep 2026.
Builds on
15 of 23 references.
References · 15
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2017Neural Collaborative Filteringcited by 1,111
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2019ERASER: A Benchmark to Evaluate Rationalized NLP Modelscited by 530
- 2023User Behavior Simulation with Large Language Model based Agentscited by 140
- 2023AgentCF: Collaborative Learning with Autonomous Language Agents for Recommender Systemscited by 116
- 2025TwinMarket: A Scalable Behavioral and Social Simulation for Financial Marketscited by 48
- 2024BASES: Large-scale Web Search User Simulation with Large Language Model based Agentscited by 25
- 2023SurrealDriver: Designing LLM-powered Generative Driver Agent Framework based on Human Drivers' Driving-thinking Datacited by 24
- 2026Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Tracescited by 9
- 2019Reinforcement Learning for Personalized Dialogue Managementcited by 6
- 2025RecPS: Privacy Risk Scoring for Recommender Systemscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Behavioral Consistency Validation for LLM Agents: An Analysis of Trading-Style Switching through Stock-Market Simulation
- 2024INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agent
- 2024Large Language Model Agent in Financial Trading: A Survey
- 2026The Price of Thought: Does Test-Time Reasoning Pay in LLM Trading?
- 2026The Price of Agreement: Measuring LLM Sycophancy in Agentic Financial Applications
- 2026Representation Signatures and Risk-Feedback Alignment in LLM Trading Agents
- 2026Beyond Agent Architecture: Execution Assumptions and Reproducibility in LLM-Based Trading Systems
- 2025StockBench: Can LLM Agents Trade Stocks Profitably In Real-world Markets?