DPIAgent: Divide, Protocol, Isolate for Agentic Reproduction Test Generation
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Reproduction test generation, producing a failing-then-passing test that captures a reported bug, is a critical step in automated software engineering. Existing agentic methods treat this as a monolithic loop, despite the task inherently comprising two subtasks of distinct nature: diagnosing the root cause and writing a fail-to-pass test. Without explicit separation, the agent faces a compound objective with underspecified intermediate goals, leading to goal drift. We propose DPIAgent, a structured agentic framework built on three principles, Divide, Protocol, Isolate (DPI), that mitigates compound-objective ambiguity and goal drift: it Divides the task into single-objective phases of defect exploration and test generation; enforces a handoff Protocol that records the diagnosis and test plan, preventing context loss; and Isolates each phase's action space by tailoring the toolset to its task, preventing irrelevant tools from misleading execution. On SWT-Bench Verified, DPIAgent outperforms seven baselines across three backbone LLMs. With DPI alone it reaches 81.76% success rate on GPT-5, the highest reported among open-source methods, gaining up to 11.88 points over the strongest baseline on GPT-5-Mini; adding test selection further raises it to 86.17%. Our analysis shows that architectural structure and backbone capability are complementary axes rather than substitutes, demonstrating DPI's generalizability across model classes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 21 of its 30 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
21 of 30 references.
Closest ancestors · 7
Same direction, newest first
- 2025Kimi-Dev: Agentless Training as Skill Prior for SWE-Agents27 Sep
- 2025Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scaling31 Jul
- 2025Ambig-SWE: Interactive Agents to Overcome Underspecificity in Software Engineering18 Feb
- 2025Agentic Bug Reproduction for Effective Automated Program Repair at Google3 Feb
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents18 Jun
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
Other references · 14
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2025SWE-bench Goes Live!cited by 74
- 2024TDD-Bench Verified: Can LLMs Generate Tests for Issues Before They Get Resolved?cited by 32
- 2025Otter: Generating Tests from Issues to Validate SWE Patchescited by 24
- 2025Issue Localization via LLM-Driven Iterative Code Graph Searchingcited by 22
- 2025Issue2Test: Generating Reproducing Test Cases from Issue Reportscited by 18
- 2025RPG: A Repository Planning Graph for Unified and Scalable Codebase Generationcited by 18
- 2025AssertFlip: Reproducing Bugs via Inversion of LLM-Generated Passing Testscited by 11
- 2025Heterogeneous Prompting and Execution Feedback for SWE Issue Test Generation and Selectioncited by 10
- 2026TestExplora: Benchmarking LLMs for Proactive Bug Discovery via Repository-Level Test Generationcited by 5
- 2023A Survey on What Developers Think About Testingcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Automated structural testing of LLM-based agents: methods, framework, and case studies
- 2025TestForge: Feedback-Driven, Agentic Test Suite Generation
- 2026Complex Agents, Shallow Tests: Demystifying and Enhancing Test Adequacy of Agent Harness in the Wild
- 2026AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents
- 2025Nexus: Execution-Grounded Multi-Agent Test Oracle Synthesis
- 2025StaAgent: An Agentic Framework for Testing Static Analyzers
- 2026VibeCheck: Assessing the Quality of LLM-Generated Unit Tests: A Multi-agent Empirical Study across Heterogeneous Repositories
- 2026Dynamic Cogeneration of Bug Reproduction Test in Agentic Program Repair