Fin-PRM: A Domain-Specialized Process Reward Model for Financial Reasoning in Large Language Models
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Process Reward Models (PRMs) supervise intermediate reasoning steps in large language models (LLMs), but existing PRMs are mainly trained on general-domain data and struggle with the structured, symbolic, and fact-sensitive nature of financial reasoning. Financial tasks require not only correct final answers but also verifiable intermediate steps grounded in domain knowledge. In this paper, we propose Fin-PRM, a domain-specialized, trajectory-aware PRM for financial reasoning that jointly models step-level correctness and trajectory-level coherence, producing binary supervision signals for both local and global reasoning quality. To support reliable supervision, we construct a high-quality financial reasoning dataset of 3K trajectories, where step- and trajectory-level labels are automatically derived from multi-source reward signals, including Monte Carlo rollouts, LLM-based evaluation, and explicit financial knowledge verification. Fin-PRM defines a unified ranking score that integrates step- and trajectory-level rewards, enabling consistent use across multiple settings. We evaluate Fin-PRM in three scenarios: (1) offline trajectory selection for supervised fine-tuning, (2) reward-guided Best-of-N inference for test-time scaling, and (3) process-aware reward shaping for reinforcement learning. Experiments on financial reasoning benchmarks, including CFLUE and FinQA, show that Fin-PRM consistently outperforms general-purpose PRMs and strong baselines. Our project resources will be available at https://github.com/aliyun/qwen-dianjin.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 26 of its 32 references that are in the map. First posted on arXiv 21 Aug 2025.
Builds on
26 of 32 references.
Closest ancestors · 1
Same direction, newest first
Other references · 25
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023Let's Verify Step by Stepcited by 3,789
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
- 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 735
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 625
13 more
- 2023Textbooks Are All You Needcited by 569
- 2025Process Reinforcement through Implicit Rewardscited by 504
- 2025LIMO: Less is More for Reasoningcited by 498
- 2025The Lessons of Developing Process Reward Models in Mathematical Reasoningcited by 415
- 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 399
- 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 379
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
- 2024Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoningcited by 279
- 2023FinGPT: Open-Source Financial Large Language Modelscited by 253
- 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scalingcited by 136
- 2025Process Reward Models That Thinkcited by 118
- 2025ReasonFlux-PRM: Trajectory-Aware PRMs for Long Chain-of-Thought Reasoning in LLMscited by 46
- 2024Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation Datasetcited by 23
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025A Survey of Process Reward Models: From Outcome Signals to Process Supervisions for Large Language Modelscited by 38
- 2026Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluationcited by 7
- 2025PRInTS: Reward Modeling for Long-Horizon Information Seekingcited by 5
- 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysiscited by 5
- 2026interwhen: A Generalizable Framework for Steering Reasoning Models with Test-time Verificationcited by 2
- 2026VeriBound: PAC-Bayesian Generalization Bounds for Process Reward Models Trained with Formal Verification Toolscited by 1
- 2025TDHook: A Lightweight Framework for Interpretabilitycited by 0
- 2026VeriBound: PAC-Bayesian Generalization Bounds for Process Reward Models Trained with Formal Verification Tools17 Jun 2026
- 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis27 Apr 2026
- 2026Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluation10 Feb 2026
- 2026interwhen: A Generalizable Framework for Steering Reasoning Models with Test-time Verification5 Feb 2026
- 2025PRInTS: Reward Modeling for Long-Horizon Information Seeking24 Nov 2025
- 2025A Survey of Process Reward Models: From Outcome Signals to Process Supervisions for Large Language Models9 Oct 2025
- 2025TDHook: A Lightweight Framework for Interpretability29 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2026FinTrace: Holistic Trajectory-Level Evaluation of LLM Tool Calling for Long-Horizon Financial Tasks
- 2025FinEval-KR: A Financial Domain Evaluation Framework for Large Language Models' Knowledge and Reasoning
- 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learning
- 2023Beyond Classification: Financial Reasoning in State-of-the-Art Language Models
- 2025GroundedPRM: Tree-Guided and Fidelity-Aware Process Reward Modeling for Step-Level Reasoning
- 2025Agentar-Fin-R1: Enhancing Financial Intelligence through Domain Expertise, Training Efficiency, and Advanced Reasoning
- 2025Linking Process to Outcome: Conditional Reward Modeling for LLM Reasoning
- 2026Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements