mlsanityData to 14 Oct 2026

Cast a Wider Net: Coordinated Pass@K Policy Optimization for Code Reasoning

arXiv 2605.27000 ↗First posted 26 May 2026cs.CL cs.AIcited by 2

On the map: LLM reasoning → Reinforcement learning for reasoning

Abstract (arXiv)

Repeated sampling with a verifier is the standard way to allocate test-time compute for code generation, with pass@K as the canonical metric. Yet the standard policy class draws K independent samples from a single answer distribution, so attempts often collapse onto near-duplicate reasoning paths and waste the budget on redundant rollouts. This failure is costly in competitive programming, where many problems admit multiple distinct algorithmic strategies and pass@K requires only one correct attempt. We propose Coordinated Pass@K Policy Optimization (CPPO), which turns pass@K generation into joint exploration over strategies: a planner emits a tuple of K=4 alternative high-level methods, and a shared solver attempts one solution per method. CPPO trains this joint policy with a multiplicative planner reward, Rplan = J_psi · Rout, assigning credit only to valid strategy tuples that lead to verifier-confirmed pass@K success. Across APPS, CodeContests, and LiveCodeBench-v6, CPPO improves pass@4 over direct sampling, planning baselines, planner-only SFT, and pass@K-oriented RL under the same K=4 solver-attempt budget, with statistically significant gains on six of nine model--benchmark cells. The largest single gain is +0.16 on Qwen3.5-9B LiveCodeBench-v6 over the strongest baseline, PKPO (0.588 rightarrow 0.748; paired bootstrap, p < 0.05).

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 13 of its 26 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

13 of 26 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Diversity-Incentivized Exploration for Versatile Reasoning30 Sep
  2. 2025Pass@k Training for Adaptively Balancing Exploration and Exploitation of Large Reasoning Models14 Aug
  3. 2023Let's Verify Step by Step31 May
  4. 2017Proximal Policy Optimization Algorithms20 Jul

Other references · 9

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  5. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  6. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  7. 2021Measuring Coding Challenge Competence With APPScited by 902
  8. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
  9. 2025Jointly Reinforcing Diversity and Quality in Language Model Generationscited by 80

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PaT: Planning-after-Trial for Efficient Test-Time Code Generation
  2. 2025MURPHY: Feedback-Aware GRPO with Retrospective Credit Assignment for Multi-Turn Code Generation
  3. 2026Entropy-Regularized Rank-Masked Policy Optimization for Test-Time Reinforcement Learning in Code Generation
  4. 2026CVeDRL: An Efficient Code Verifier via Difficulty-aware Reinforcement Learning
  5. 2026Skip-Connected Policy Optimization for Implicit Advantage
  6. 2026Adaptive Generate-Rank-Verify: Inference-Time Search with Costly Verification
  7. 2025Pass@K Policy Optimization: Solving Harder Reinforcement Learning Problems
  8. 2025OptPO: Optimal Rollout Allocation for Test-time Policy Optimization