ATGen: Adversarial Reinforcement Learning for Test Case Generation
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) excel at code generation, yet their outputs often contain subtle bugs, for which effective test cases are a critical bottleneck. Existing test generation methods, whether based on prompting or supervised fine-tuning, rely on static datasets. This imposes a ``fixed-difficulty ceiling'', fundamentally limiting their ability to uncover novel or more complex bugs beyond their training scope. To overcome this, we introduce ATGen, a framework that trains a test case generator via adversarial reinforcement learning. ATGen pits a test generator against an adversarial code generator that continuously crafts harder bugs to evade the current policy. This dynamic loop creates a curriculum of increasing difficulty challenging current policy. The test generator is optimized via Reinforcement Learning (RL) to jointly maximize ``Output Accuracy'' and ``Attack Success'', enabling it to learn a progressively stronger policy that breaks the fixed-difficulty ceiling of static training. Extensive experiments demonstrate that ATGen significantly outperforms state-of-the-art baselines. We further validate its practical utility, showing it serves as both a more effective filter for Best-of-N inference and a higher-quality reward source for training code generation models. Our work establishes a new, dynamic paradigm for improving the reliability of LLM-generated code.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Oct 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MMSkills: Towards Multimodal Skills for General Visual Agentscited by 16
- 2026ACE: Self-Evolving LLM Coding Framework via Adversarial Unit Test Generation and Preference Optimizationcited by 4
- 2026RefineRL: Advancing Competitive Programming with Self-Refinement Reinforcement Learningcited by 2
- 2026Beyond the Verdict: Agentic Code Judging with Verifiable Feedbackcited by 0
- 2026Beyond the Verdict: Agentic Code Judging with Verifiable Feedback13 Oct 2026
- 2026MMSkills: Towards Multimodal Skills for General Visual Agents13 May 2026
- 2026ACE: Self-Evolving LLM Coding Framework via Adversarial Unit Test Generation and Preference Optimization17 Apr 2026
- 2026RefineRL: Advancing Competitive Programming with Self-Refinement Reinforcement Learning1 Apr 2026