Beyond pass@k: Redundancy-Aware RLVR for Multi-Sample Code Generation
Not on the map. Why?
Abstract (arXiv)
LLMs for code generation are commonly evaluated in repeated-sampling settings using Pass@k, where multiple candidate programs are executed against unit tests under a finite sampling budget. While recent verifier-based reinforcement learning (RLVR) methods improve executable correctness, how these objectives affect redundancy among sampled programs remains poorly understood. In this work, we study implementation-level redundancy in code generation using JPlag, a plagiarism-detection system for code. Across models and benchmarks, we show that correctness-only RLVR often concentrates generations around repeated implementations, whereas Pass@k-aware objectives maintain lower redundancy and improve larger-budget performance. Motivated by these observations, we augment RLVR with direct anti-redundancy rewards based on JPlag similarity. Across 3 models and 3 benchmarks, discouraging near-duplicate generations reliably improves finite-budget executable performance, often matching or outperforming specialized Pass@k-aware objectives.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 23 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
18 of 23 references.
References · 18
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2024A Survey on Large Language Models for Code Generationcited by 646
- 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 386
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
- 2023TACO: Topics in Algorithmic COde generation datasetcited by 150
- 2024RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learningcited by 146
- 2025Pass@K Policy Optimization: Solving Harder Reinforcement Learning Problemscited by 83
6 more
- 2024What Makes Large Language Models Reason in (Multi-Turn) Code Generation?cited by 29
- 2025Diversity-Incentivized Exploration for Versatile Reasoningcited by 28
- 2024Exploring Precision and Recall to assess the quality and diversity of LLMscited by 27
- 2025Efficient Code Embeddings from Code Generation Modelscited by 12
- 2025How Diversely Can Language Models Solve Problems? Exploring the Algorithmic Diversity of Model-Generated Codecited by 9
- 2026Bridging Online and Offline RL: Contextual Bandit Learning for Multi-Turn Code Generationcited by 4
Built on by
Not cited yet.