Can Language Models Learn to Forecast Stock Prices
New in LLM reasoning; no direction yet. LLM reasoning
Abstract (arXiv)
Post-training has been shown to significantly improve language models' performance on tasks with verifiable outcomes, including mathematical reasoning, software engineering, and computer use. However, whether the same approach can improve forecasting in financial markets is much less clear. Compared with tasks with verifiable outcomes, not only are realized returns noisy, but even what constitutes a relevant information set for making effective predictions is not obvious a priori: the model must decide which observations to gather and then commit to a numerical judgment before the outcome is known. We study this question in a chronological stock-price sandbox, where a language model gathers price, volume, relative-performance, and market-context evidence and predicts a future return. We post-train Qwen3-4B with supervised fine-tuning (SFT) on tool-use demonstrations, then proximal policy optimization (PPO) with a terminal reward given by the forecast score against the realized return. The resulting AURA-4B more than doubles the starting direction--magnitude score, from 20.94 to 43.31, and is comparable to frontier language models on this benchmark. Conditional magnitude agreement rises from 33.3 to 66.2, while directional accuracy changes from 62.9 to 65.4. SFT expands tool use, and PPO further increases the share of ranking and market-context queries. These results show that post-training can substantially improve financial forecasting performance, together with changes in how the model investigates the market, on this outcome-selected benchmark.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 41 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
29 of 41 references.
References · 29
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2024Chronos: Learning the Language of Time Seriescited by 712
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
- 2023FinGPT: Open-Source Financial Large Language Modelscited by 244
17 more
- 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 163
- 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 163
- 2023Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Modelscited by 125
- 2024Approaching Human-Level Forecasting with Language Modelscited by 102
- 2025DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoningcited by 84
- 2021FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Financecited by 57
- 2025ComputerRL: Scaling End-to-End Online Reinforcement Learning for Computer Use Agentscited by 49
- 2025StockBench: Can LLM Agents Trade Stocks Profitably In Real-world Markets?cited by 43
- 2023Assessing Look-Ahead Bias in Stock Return Predictions Generated By GPT Sentiment Analysiscited by 29
- 2025Kronos: A Foundation Model for the Language of Financial Marketscited by 25
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Trainingcited by 18
- 2025When Agents Trade: Live Multi-Market Trading Benchmark for LLM Agentscited by 16
- 2026Future-as-Label: Scalable Supervision from Real-World Outcomescited by 11
- 2026QuantEval: A Benchmark for Financial Quantitative Tasks in Large Language Modelscited by 7
- 2026From Knowing to Doing: A Memory-Controlled Benchmark for LLM Trading Agents on Stock Marketscited by 7
- 2026FrontierFinance: A Challenging Benchmark for Measuring Frontier Intelligence of Finance Agentscited by 3
- 2026LEAP: Likelihood Elicitation and Aggregation for LLM-based Probabilistic Forecastingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RETuning: Upgrading Inference-Time Scaling for Stock Movement Prediction with Large Language Models
- 2026Reasoning through Verifiable Forecast Actions: Consistency-Grounded RL for Financial LLMs
- 2026Learning to Trade Like an Expert: Cognitive Fine-Tuning for Stable Financial Reasoning in Language Models
- 2026Dutch Books for Language Models
- 2026Towards Financial World Modeling
- 2024Can Large Language Models Beat Wall Street? Unveiling the Potential of AI in Stock Selection
- 2026The Price of Thought: Does Test-Time Reasoning Pay in LLM Trading?
- 2026FinBench: Time-Gated Calibration and Uncertainty Benchmarking for Agentic Financial Forecasting