ScaleBox: Enabling High-Fidelity and Scalable Code Verification for Large Language Models
Not on the map. Why?
Abstract (arXiv)
Code sandboxes have emerged as a critical infrastructure for advancing the coding capabilities of large language models, providing verifiable feedback for both RL training and evaluation. However, existing systems fail to provide accurate verification and efficiency under high-concurrency workloads. We present ScaleBox, a high-fidelity and scalable system designed to address these limitations in large-scale code training. ScaleBox introduces automated special-judge generation and management, fine-grained parallel execution across test cases with seamless multi-node coordination, and a configuration-driven evaluation suite for reproducible benchmarking. A series of experiments demonstrates that ScaleBox significantly enhances code verification accuracy and efficiency. Our further RLVR experiments show that ScaleBox substantially improves both performance on LiveCodeBench and training stability, significantly outperforming heuristic-matching baselines. By providing a reliable and high-throughput infrastructure, ScaleBox facilitates more effective research and development in large-scale code training.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 30 references that are in the map. First posted on arXiv 30 Apr 2026.
Builds on
16 of 30 references.
References · 16
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
- 2021Measuring Coding Challenge Competence With APPScited by 902
- 2024A Survey on Large Language Models for Code Generationcited by 658
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
- 2023TACO: Topics in Algorithmic COde generation datasetcited by 160
- 2024FullStack Bench: Evaluating LLMs as Full Stack Coderscited by 58
4 more
- 2025xVerify: Efficient Answer Verifier for Reasoning Model Evaluationscited by 55
- 2025Code to Think, Think to Code: A Survey on Code-Enhanced Reasoning and Reasoning-Driven Code Intelligence in LLMscited by 47
- 2025CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Rewardcited by 40
- 2025Klear-CodeTest: Scalable Test Case Generation for Code Reinforcement Learningcited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.