mlsanityData to 7 Oct 2026

Beyond pass@k: Redundancy-Aware RLVR for Multi-Sample Code Generation

arXiv 2605.28022 ↗First posted 27 May 2026cs.CL cs.SEcited by 0

Not on the map. Why?

Abstract (arXiv)

LLMs for code generation are commonly evaluated in repeated-sampling settings using Pass@k, where multiple candidate programs are executed against unit tests under a finite sampling budget. While recent verifier-based reinforcement learning (RLVR) methods improve executable correctness, how these objectives affect redundancy among sampled programs remains poorly understood. In this work, we study implementation-level redundancy in code generation using JPlag, a plagiarism-detection system for code. Across models and benchmarks, we show that correctness-only RLVR often concentrates generations around repeated implementations, whereas Pass@k-aware objectives maintain lower redundancy and improve larger-budget performance. Motivated by these observations, we augment RLVR with direct anti-redundancy rewards based on JPlag similarity. Across 3 models and 3 benchmarks, discouraging near-duplicate generations reliably improves finite-budget executable performance, often matching or outperforming specialized Pass@k-aware objectives.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 23 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

18 of 23 references.

References · 18

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  6. 2021Program Synthesis with Large Language Modelscited by 3,509
  7. 2024A Survey on Large Language Models for Code Generationcited by 646
  8. 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 386
  9. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 299
  10. 2023TACO: Topics in Algorithmic COde generation datasetcited by 150
  11. 2024RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learningcited by 146
  12. 2025Pass@K Policy Optimization: Solving Harder Reinforcement Learning Problemscited by 83
6 more
  1. 2024What Makes Large Language Models Reason in (Multi-Turn) Code Generation?cited by 29
  2. 2025Diversity-Incentivized Exploration for Versatile Reasoningcited by 28
  3. 2024Exploring Precision and Recall to assess the quality and diversity of LLMscited by 27
  4. 2025Efficient Code Embeddings from Code Generation Modelscited by 12
  5. 2025How Diversely Can Language Models Solve Problems? Exploring the Algorithmic Diversity of Model-Generated Codecited by 9
  6. 2026Bridging Online and Offline RL: Contextual Bandit Learning for Multi-Turn Code Generationcited by 4

Built on by

Not cited yet.