mlsanityData to 14 Oct 2026

Fin-PRM: A Domain-Specialized Process Reward Model for Financial Reasoning in Large Language Models

arXiv 2508.15202 ↗First posted 21 Aug 2025cs.CLcited by 7

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Process Reward Models (PRMs) supervise intermediate reasoning steps in large language models (LLMs), but existing PRMs are mainly trained on general-domain data and struggle with the structured, symbolic, and fact-sensitive nature of financial reasoning. Financial tasks require not only correct final answers but also verifiable intermediate steps grounded in domain knowledge. In this paper, we propose Fin-PRM, a domain-specialized, trajectory-aware PRM for financial reasoning that jointly models step-level correctness and trajectory-level coherence, producing binary supervision signals for both local and global reasoning quality. To support reliable supervision, we construct a high-quality financial reasoning dataset of 3K trajectories, where step- and trajectory-level labels are automatically derived from multi-source reward signals, including Monte Carlo rollouts, LLM-based evaluation, and explicit financial knowledge verification. Fin-PRM defines a unified ranking score that integrates step- and trajectory-level rewards, enabling consistent use across multiple settings. We evaluate Fin-PRM in three scenarios: (1) offline trajectory selection for supervised fine-tuning, (2) reward-guided Best-of-N inference for test-time scaling, and (3) process-aware reward shaping for reinforcement learning. Experiments on financial reasoning benchmarks, including CFLUE and FinQA, show that Fin-PRM consistently outperforms general-purpose PRMs and strong baselines. Our project resources will be available at https://github.com/aliyun/qwen-dianjin.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 26 of its 32 references that are in the map. First posted on arXiv 21 Aug 2025.

Builds on

26 of 32 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025DianJin-R1: Evaluating and Enhancing Financial Reasoning in Large Language Models22 Apr

Other references · 25

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2023Let's Verify Step by Stepcited by 3,789
  5. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  6. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  7. 2024A Survey on LLM-as-a-Judgecited by 1,423
  8. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
  9. 2022Solving math word problems with process- and outcome-based feedbackcited by 901
  10. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
  11. 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 735
  12. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 625
13 more
  1. 2023Textbooks Are All You Needcited by 569
  2. 2025Process Reinforcement through Implicit Rewardscited by 504
  3. 2025LIMO: Less is More for Reasoningcited by 498
  4. 2025The Lessons of Developing Process Reward Models in Mathematical Reasoningcited by 415
  5. 2023DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretrainingcited by 399
  6. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 379
  7. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
  8. 2024Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoningcited by 279
  9. 2023FinGPT: Open-Source Financial Large Language Modelscited by 253
  10. 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scalingcited by 136
  11. 2025Process Reward Models That Thinkcited by 118
  12. 2025ReasonFlux-PRM: Trajectory-Aware PRMs for Long Chain-of-Thought Reasoning in LLMscited by 46
  13. 2024Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation Datasetcited by 23

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 4.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026FinTrace: Holistic Trajectory-Level Evaluation of LLM Tool Calling for Long-Horizon Financial Tasks
  2. 2025FinEval-KR: A Financial Domain Evaluation Framework for Large Language Models' Knowledge and Reasoning
  3. 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learning
  4. 2023Beyond Classification: Financial Reasoning in State-of-the-Art Language Models
  5. 2025GroundedPRM: Tree-Guided and Fidelity-Aware Process Reward Modeling for Step-Level Reasoning
  6. 2025Agentar-Fin-R1: Enhancing Financial Intelligence through Domain Expertise, Training Efficiency, and Advanced Reasoning
  7. 2025Linking Process to Outcome: Conditional Reward Modeling for LLM Reasoning
  8. 2026Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements