FunPRM: Function-as-Step Process Reward Model with Meta Reward Correction for Code Generation
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Code generation is a core application of large language models (LLMs), yet LLMs still frequently fail on complex programming tasks. Given its success in mathematical reasoning, test-time scaling approaches such as Process Reward Model (PRM)-based Best-of-N selection offer a promising way to improve performance. However, existing PRMs remain ineffective for code generation due to the lack of meaningful step decomposition in code and the noise of Monte Carlo-estimated partial-solution correctness scores (rewards). To address these challenges, we propose FunPRM. FunPRM prompts LLMs to encourage modular code generation organized into functions, with functions treated as PRM reasoning steps. Furthermore, FunPRM introduces a novel meta-learning-based reward correction mechanism that leverages clean final-solution rewards obtained via a unit-test-based evaluation system to purify noisy partial-solution rewards. Experiments on LiveCodeBench and BigCodeBench demonstrate that FunPRM consistently outperforms existing test-time scaling methods across five base LLMs, notably achieving state-of-the-art performance on LiveCodeBench when combined with O4-mini. Furthermore, FunPRM produces code that is more readable and reusable for developers.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 34 of its 46 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
34 of 46 references.
Closest ancestors · 3
Same direction, newest first
- 2025S*: Test Time Scaling for Code Generation20 Feb
- 2024Reasoning Through Execution: Unifying Process and Outcome Rewards for Code Generation19 Dec
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code12 Mar
Other references · 31
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024GPT-4o System Cardcited by 4,588
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Let's Verify Step by Stepcited by 3,789
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
19 more
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2024A Survey on Large Language Models for Code Generationcited by 658
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
- 2024Generative Verifiers: Reward Modeling as Next-Token Predictioncited by 480
- 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 441
- 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 344
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 187
- 2025Skywork Open Reasoner 1 Technical Reportcited by 165
- 2024Debug like a Human: A Large Language Model Debugger via Verifying Runtime Execution Step-by-stepcited by 127
- 2024Multi-step Problem Solving Through a Verifier: An Empirical Analysis on Model-induced Process Supervisioncited by 52
- 2025Evaluating Judges as Evaluators: The JETTS Benchmark of LLM-as-Judges as Test-Time Scaling Evaluatorscited by 44
- 2020Learning to Purify Noisy Labels via Meta Soft Label Correctorcited by 39
- 2025EXAONE 4.0: Unified Large Language Models Integrating Non-reasoning and Reasoning Modescited by 32
- 2023Learning from Noisy Labels with Decoupled Meta Label Purifiercited by 21
- 2025DreamPRM: Domain-Reweighted Process Reward Model for Multimodal Reasoningcited by 15
- 2023Enhanced Meta Label Correction for Coping with Label Corruptioncited by 6
- 2024TapWeight: Reweighting Pretraining Objectives for Task-Adaptive Pretrainingcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026OPBackdoor: Opportunistic Backdoors via Alibi-Aligned Reasoning21 Sep 2026
- 2026Code as Agent Harness18 May 2026
- 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis27 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025DreamPRM-Code: Function-as-Step Process Reward Model with Label Correction for LLM Coding
- 2025From Mathematical Reasoning to Code: Generalization of Process Reward Models in Test-Time Scaling
- 2025GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning
- 2024Process Supervision-Guided Policy Optimization for Code Generation
- 2023Let's reward step by step: Step-Level reward model as the Navigators for Reasoning
- 2025Smaller Models, Smarter Rewards: A Two-Sided Approach to Process and Outcome Rewards
- 2025Dynamic Scaling of Unit Tests for Code Reward Modeling
- 2025Towards Better Correctness and Efficiency in Code Generation