InvestAlign: Overcoming Data Scarcity in Aligning Large Language Models with Investor Decision-Making Processes under Herd Behavior
On the map: LLM alignment / RLHF / preference optimisation → Preference alignment for recommenders and RAG
Abstract (arXiv)
Aligning Large Language Models (LLMs) with investor decision-making processes under herd behavior is a critical challenge in behavioral finance, which grapples with a fundamental limitation: the scarcity of real-user data needed for Supervised Fine-Tuning (SFT). While SFT can bridge the gap between LLM outputs and human behavioral patterns, its reliance on massive authentic data imposes substantial collection costs and privacy risks. We propose InvestAlign, a novel framework that constructs high-quality SFT datasets by leveraging theoretical solutions to similar and simple optimal investment problems rather than complex scenarios. Our theoretical analysis demonstrates that training LLMs with InvestAlign-generated data achieves faster parameter convergence than using real-user data, suggesting superior learning efficiency. Furthermore, we develop InvestAgent, an LLM agent fine-tuned with InvestAlign, which demonstrates significantly closer alignment to real-user data than pre-SFT models in both simple and complex investment problems. This highlights our proposed InvestAlign as a promising approach with the potential to address complex optimal investment problems and align LLMs with investor decision-making processes under herd behavior. Our code is publicly available at https://github.com/thu-social-network-research-group/InvestAlign.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Preference alignment for recommenders and RAG, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 36 of its 68 references that are in the map. First posted on arXiv 9 Jul 2025.
Builds on
36 of 68 references.
References · 36
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2021Convex optimizationcited by 2,515
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 894
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 839
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2023How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resourcescited by 408
24 more
- 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 257
- 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 188
- 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 164
- 2023EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activitiescited by 154
- 2024Reinforcement Learning for LLM Post-Training: A Surveycited by 92
- 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 82
- 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 79
- 2022On the Importance and Applicability of Pre-Training for Federated Learningcited by 71
- 2023Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investmentcited by 56
- 2024Exploring Prosocial Irrationality for LLM Agents: A Social Cognition Viewcited by 38
- 2024Getting More Juice Out of the SFT Data: Reward Learning from Human Demonstration Improves SFT for LLM Alignmentcited by 32
- 2024Automate Strategy Finding with LLM in Quant Investmentcited by 26
- 2023The SocialAI School: Insights from Developmental Psychology Towards Artificial Socio-Cultural Agentscited by 24
- 2023Synthetic Data Applications in Financecited by 22
- 2024Fine-Tuning Large Language Models for Stock Return Prediction Using Newsflowcited by 8
- 2024Evaluating and Modeling Social Intelligence: A Comparative Study of Human and AI Capabilitiescited by 6
- 2024UNA: A Unified Supervised Framework for Efficient LLM Alignment Across Feedback Typescited by 6
- 2024FinVerse: An Autonomous Agent System for Versatile Financial Analysiscited by 5
- 2024Minor SFT loss for LLM fine-tune to increase performance and reduce model deviationcited by 3
- 2024Behavioral Bias of Vision-Language Models: A Behavioral Finance Viewcited by 3
- 2024Next-Generation Simulation Illuminates Scientific Problems of Organised Complexitycited by 2
- 2024Optimal Investment with Herd Behaviour Using Rational Decision Decompositioncited by 1
- 2024Six Levels of Privacy: A Framework for Financial Synthetic Datacited by 1
- 2024Optimal Investment under the Influence of Decision-changing Imitationcited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025LLMs Meet Finance: Fine-Tuning Foundation Models for the Open FinLLM Leaderboard
- 2026Representation Signatures and Risk-Feedback Alignment in LLM Trading Agents
- 2026Your AI, On a Dial: Controlling Investment Bias in LLMs with a Single Neuron
- 2026Toward Expert Investment Teams:A Multi-Agent LLM System with Fine-Grained Trading Tasks
- 2024SNFinLLM: Systematic and Nuanced Financial Domain Adaptation of Chinese Large Language Models
- 2026Evaluating Investment Logic in Large Language Models: A Real-World Benchmark Towards Personalzied Financial Agents
- 2026Behavioral Consistency Validation for LLM Agents: An Analysis of Trading-Style Switching through Stock-Market Simulation
- 2026QuantEval: A Benchmark for Financial Quantitative Tasks in Large Language Models