mlsanityData to 14 Oct 2026

Alpha-R1: Alpha Screening with LLM Reasoning via Reinforcement Learning

arXiv 2512.23515 ↗First posted 29 Dec 2025q-fin.TR cs.AI cs.CEcited by 7

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Signal decay and regime shifts pose recurring challenges for data-driven investment strategies in non-stationary markets, where conventional time-series and machine learning approaches often struggle to generalize beyond historical correlations. While large language models (LLMs) offer strong capabilities for processing unstructured information, their potential to support quantitative factor screening through explicit economic reasoning remains underexplored. Existing factor-based methods typically reduce alphas to numerical time series, overlooking the semantic rationale that determines when a factor is economically relevant. We present Alpha-R1, an RL-aligned LLM framework for context-aware alpha screening. Its core mechanism, semantic gating, evaluates each candidate factor's semantic profile against a dynamically constructed market state description, selecting a sparse subset of factors whose economic rationale aligns with current market conditions. The selection model is trained via group relative policy optimization (GRPO), using realized portfolio returns as the primary reward signal. Under a 12-month out-of-sample evaluation, Alpha-R1 achieves annualized returns of 47.87% on S&P 500 and 40.57% on CSI 300 with Sharpe ratios of 1.62 and 2.23. These results, obtained under a bounded candidate-pool evaluation protocol, provide evidence for second-stage semantic factor reranking in non-stationary markets. The full implementation and resources are available at https://github.com/FinStep-AI/Alpha-R1.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 44 of its 89 references that are in the map. First posted on arXiv 29 Dec 2025.

Builds on

44 of 89 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Trading-R1: Financial Trading with LLM Reasoning via Reinforcement Learning14 Sep
  2. 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learning20 Mar
  3. 2025Fino1: On the Transferability of Reasoning-Enhanced LLMs and Reinforcement Learning to Finance12 Feb

Other references · 41

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  6. 2015Continuous control with deep reinforcement learningcited by 3,407
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  8. 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
  9. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
  10. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
  11. 2023BloombergGPT: A Large Language Model for Financecited by 939
  12. 2025Group Sequence Policy Optimizationcited by 835
29 more
  1. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
  2. 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Modelscited by 485
  3. 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 188
  4. 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 164
  5. 2024A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalistcited by 137
  6. 2023Can ChatGPT Forecast Stock Price Movements? Return Predictability and Large Language Modelscited by 129
  7. 2023XuanYuan 2.0: A Large Chinese Financial Chat Model with Hundreds of Billions Parameterscited by 92
  8. 2020FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Financecited by 87
  9. 2023BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmarkcited by 60
  10. 2023Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investmentcited by 56
  11. 2020Reinforcement-Learning based Portfolio Management with Augmented Asset Movement Prediction Statescited by 55
  12. 2025R&D-Agent-Quant: A Multi-Agent Framework for Data-Centric Factors and Model Joint Optimizationcited by 43
  13. 2025AlphaAgent: LLM-Driven Alpha Mining with Regularized Exploration to Counteract Alpha Decaycited by 42
  14. 2024LLMFactor: Extracting Profitable Factors through Prompts for Explainable Stock Movement Predictioncited by 33
  15. 2024AlphaForge: A Framework to Mine and Dynamically Combine Formulaic Alpha Factorscited by 27
  16. 2024Automate Strategy Finding with LLM in Quant Investmentcited by 26
  17. 2025Time Travel is Cheating: Going Live with DeepFund for Real-Time Fund Investment Benchmarkingcited by 21
  18. 2025Can LLM-based Financial Investing Strategies Outperform the Market in Long Run?cited by 20
  19. 2025AlphaAgents: Large Language Model based Multi-Agents for Equity Portfolio Constructionscited by 16
  20. 2020MAPS: Multi-agent Reinforcement Learning-based Portfolio Management Systemcited by 15
  21. 2024Alpha-GPT 2.0: Human-in-the-Loop AI for Quantitative Investmentcited by 11
  22. 2025Beyond the Black Box: Interpretability of LLMs in Financecited by 11
  23. 2025AlphaEval: A Comprehensive and Efficient Evaluation Framework for Formula Alpha Miningcited by 11
  24. 2025Chain-of-Alpha: Unleashing the Power of Large Language Models for Alpha Mining in Quantitative Tradingcited by 9
  25. 2025QuantEvolve: Automating Quantitative Strategy Discovery through Multi-Agent Evolutionary Frameworkcited by 6
  26. 2025AlphaQuanter: An End-to-End Tool-Augmented Agentic Reinforcement Learning Framework for Stock Tradingcited by 5
  27. 2025FinWorld: An All-in-One Open-Source Platform for End-to-End Financial AI Research and Deploymentcited by 4
  28. 2025Growing the Efficient Frontier on Panel Treescited by 2
  29. 2025Reinforcement-Learning Portfolio Allocation with Dynamic Embedding of Market Informationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Feedback Loops to Policy Updates: Reinforcement Fine-Tuning for LLM-Based Alpha Factor Discovery
  2. 2025Navigating the Alpha Jungle: An LLM-Powered MCTS Framework for Formulaic Factor Mining
  3. 2026FactorBench: A Portfolio-Aware Benchmark for Automated Factor Mining
  4. 2025Cognitive Alpha Mining via LLM-Driven Code-Based Evolution
  5. 2026From Knowing to Doing: A Memory-Controlled Benchmark for LLM Trading Agents on Stock Markets
  6. 2025The Evolution of Alpha in Finance Harnessing Human Insight and LLM Agents
  7. 2025Inferring Latent Market Forces: Evaluating LLM Detection of Gamma Exposure Patterns via Obfuscation Testing
  8. 2026Reasoning through Verifiable Forecast Actions: Consistency-Grounded RL for Financial LLMs