Alpha-R1: Alpha Screening with LLM Reasoning via Reinforcement Learning
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Signal decay and regime shifts pose recurring challenges for data-driven investment strategies in non-stationary markets, where conventional time-series and machine learning approaches often struggle to generalize beyond historical correlations. While large language models (LLMs) offer strong capabilities for processing unstructured information, their potential to support quantitative factor screening through explicit economic reasoning remains underexplored. Existing factor-based methods typically reduce alphas to numerical time series, overlooking the semantic rationale that determines when a factor is economically relevant. We present Alpha-R1, an RL-aligned LLM framework for context-aware alpha screening. Its core mechanism, semantic gating, evaluates each candidate factor's semantic profile against a dynamically constructed market state description, selecting a sparse subset of factors whose economic rationale aligns with current market conditions. The selection model is trained via group relative policy optimization (GRPO), using realized portfolio returns as the primary reward signal. Under a 12-month out-of-sample evaluation, Alpha-R1 achieves annualized returns of 47.87% on S&P 500 and 40.57% on CSI 300 with Sharpe ratios of 1.62 and 2.23. These results, obtained under a bounded candidate-pool evaluation protocol, provide evidence for second-stage semantic factor reranking in non-stationary markets. The full implementation and resources are available at https://github.com/FinStep-AI/Alpha-R1.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 44 of its 89 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
44 of 89 references.
Closest ancestors · 3
Same direction, newest first
- 2025Trading-R1: Financial Trading with LLM Reasoning via Reinforcement Learning14 Sep
- 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learning20 Mar
- 2025Fino1: On the Transferability of Reasoning-Enhanced LLMs and Reinforcement Learning to Finance12 Feb
Other references · 41
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2025Group Sequence Policy Optimizationcited by 835
29 more
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
- 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Modelscited by 485
- 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 188
- 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 164
- 2024A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalistcited by 137
- 2023Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Modelscited by 129
- 2023XuanYuan 2.0: A Large Chinese Financial Chat Model with Hundreds of Billions Parameterscited by 92
- 2020FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Financecited by 87
- 2023BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmarkcited by 60
- 2023Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investmentcited by 56
- 2020Reinforcement-Learning based Portfolio Management with Augmented Asset Movement Prediction Statescited by 55
- 2025R&D-Agent-Quant: A Multi-Agent Framework for Data-Centric Factors and Model Joint Optimizationcited by 43
- 2025AlphaAgent: LLM-Driven Alpha Mining with Regularized Exploration to Counteract Alpha Decaycited by 42
- 2024LLMFactor: Extracting Profitable Factors through Prompts for Explainable Stock Movement Predictioncited by 33
- 2024AlphaForge: A Framework to Mine and Dynamically Combine Formulaic Alpha Factorscited by 27
- 2024Automate Strategy Finding with LLM in Quant Investmentcited by 26
- 2025Time Travel is Cheating: Going Live with DeepFund for Real-Time Fund Investment Benchmarkingcited by 21
- 2025Can LLM-based Financial Investing Strategies Outperform the Market in Long Run?cited by 20
- 2025AlphaAgents: Large Language Model based Multi-Agents for Equity Portfolio Constructionscited by 16
- 2020MAPS: Multi-agent Reinforcement Learning-based Portfolio Management Systemcited by 15
- 2024Alpha-GPT 2.0: Human-in-the-Loop AI for Quantitative Investmentcited by 11
- 2025Beyond the Black Box: Interpretability of LLMs in Financecited by 11
- 2025AlphaEval: A Comprehensive and Efficient Evaluation Framework for Formula Alpha Miningcited by 11
- 2025Chain-of-Alpha: Unleashing the Power of Large Language Models for Alpha Mining in Quantitative Tradingcited by 9
- 2025QuantEvolve: Automating Quantitative Strategy Discovery through Multi-Agent Evolutionary Frameworkcited by 6
- 2025AlphaQuanter: An End-to-End Tool-Augmented Agentic Reinforcement Learning Framework for Stock Tradingcited by 5
- 2025FinWorld: An All-in-One Open-Source Platform for End-to-End Financial AI Research and Deploymentcited by 4
- 2025Growing the Efficient Frontier on Panel Treescited by 2
- 2025Reinforcement-Learning Portfolio Allocation with Dynamic Embedding of Market Informationcited by 2
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026AlphaPROBE: Alpha Mining via Principled Retrieval and On-graph biased evolutioncited by 3
- 2026AlphaMemo: Structured Search-Process Memory for Self-Evolving Alpha Mining Agentscited by 3
- 2026GRPO for Financial Advice Generation: Outperforming Commercial LLMs under CATE Evaluationcited by 0
- 2026FaVOR: LLM-Based Agentic Framework for Factor Mining via Empirical Validationcited by 0
- 2026Agentic Empirical Asset Pricing: Methodological Foundationscited by 0
- 2026AlphaRLM: Aligning Language Models for Literature-Grounded Symbolic Factor Discoverycited by 0
- 2026AlphaPilot: Multi-Turn Tool-Using LLM Agents for Adaptive Alpha Mining with Reinforcement Learningcited by 0
- 2026AlphaPilot: Multi-Turn Tool-Using LLM Agents for Adaptive Alpha Mining with Reinforcement Learning11 Oct 2026
- 2026AlphaRLM: Aligning Language Models for Literature-Grounded Symbolic Factor Discovery10 Oct 2026
- 2026Agentic Empirical Asset Pricing: Methodological Foundations1 Sep 2026
- 2026FaVOR: LLM-Based Agentic Framework for Factor Mining via Empirical Validation31 Aug 2026
- 2026GRPO for Financial Advice Generation: Outperforming Commercial LLMs under CATE Evaluation12 Aug 2026
- 2026AlphaMemo: Structured Search-Process Memory for Self-Evolving Alpha Mining Agents26 May 2026
- 2026AlphaPROBE: Alpha Mining via Principled Retrieval and On-graph biased evolution12 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026From Feedback Loops to Policy Updates: Reinforcement Fine-Tuning for LLM-Based Alpha Factor Discovery
- 2025Navigating the Alpha Jungle: An LLM-Powered MCTS Framework for Formulaic Factor Mining
- 2026FactorBench: A Portfolio-Aware Benchmark for Automated Factor Mining
- 2025Cognitive Alpha Mining via LLM-Driven Code-Based Evolution
- 2026From Knowing to Doing: A Memory-Controlled Benchmark for LLM Trading Agents on Stock Markets
- 2025The Evolution of Alpha in Finance Harnessing Human Insight and LLM Agents
- 2025Inferring Latent Market Forces: Evaluating LLM Detection of Gamma Exposure Patterns via Obfuscation Testing
- 2026Reasoning through Verifiable Forecast Actions: Consistency-Grounded RL for Financial LLMs