mlsanityData to 7 Oct 2026

ReProAgent: Tool-Augmented Multi-Stage Agentic Generation of Bug Reproduction Tests from Issue Reports

arXiv 2607.09123 ↗First posted 10 Jul 2026cs.SEcited by 1

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Reproduction tests help developers confirm reported issues and provide executable feedback for issue resolution, yet issue reports in open-source projects rarely include such tests. Recent studies have explored generating issue reproduction tests from issue reports with large language models, but existing approaches largely rely on prompt-based pipelines that retrieve textual context and generate tests. This limits their ability to understand how reported issues behave in repository-scale codebases and to flexibly organize the construction of reproduction tests. In this paper, we propose ReProAgent, a multi-stage agent framework for reproduction test generation from issue reports. ReProAgent decomposes the task into four agent stages: bug localization, root cause analysis, test planning, and test generation. To support these stages, ReProAgent integrates task-specific tools for task decomposition and reflection, context retrieval from both textual sources and repository graphs, and runtime interaction with the execution environment. Experiments on SWT-bench-lite and SWT-bench-verified show that ReProAgent successfully reproduces 58.43% and 70.30% of issues, outperforming all baselines, with an average cost of 0.14 per instance. For example, when equipped with GPT-5-mini, ReProAgent exceeds OpenHands with the same backbone by 20.43 and 7.90 percentage points, respectively. ReProAgent also generalizes across multiple backbone LLMs and improves downstream issue resolution performance when integrated with existing repair approaches.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 57 references that are in the map. First posted on arXiv 10 Jul 2026.

Builds on

23 of 57 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repair27 Feb
  2. 2024SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents18 Jun
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May

Other references · 20

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  3. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  4. 2020Unit Test Case Generation with Transformers and Focal Contextcited by 118
  5. 2022Large Language Models are Few-shot Testers: Exploring LLM-based General Bug Reproductioncited by 110
  6. 2023ChatUniTest: A Framework for LLM-Based Test Generationcited by 94
  7. 2024Code-Aware Prompting: A study of Coverage Guided Test Generation in Regression Setting using LLMcited by 63
  8. 2024TestGenEval: A Real World Unit Test Generation and Test Completion Benchmarkcited by 49
  9. 2024HITS: High-coverage LLM-based Unit Test Generation via Method Slicingcited by 37
  10. 2024CoverUp: Effective High Coverage Test Generation for Pythoncited by 36
  11. 2025Otter: Generating Tests from Issues to Validate SWE Patchescited by 24
  12. 2023GAMMA: Revisiting Template-based Automated Program Repair via Mask Predictioncited by 22
8 more
  1. 2024TestART: Improving LLM-based Unit Testing via Co-evolution of Automated Generation and Repair Iterationcited by 20
  2. 2025Issue2Test: Generating Reproducing Test Cases from Issue Reportscited by 18
  3. 2025AssertFlip: Reproducing Bugs via Inversion of LLM-Generated Passing Testscited by 11
  4. 2025Heterogeneous Prompting and Execution Feedback for SWE Issue Test Generation and Selectioncited by 10
  5. 2017A Large-Scale Study on the Usage of Testing Patterns that Address Maintainability Attributes (Patterns for Ease of Modification, Diagnoses, and Comprehension)cited by 7
  6. 2026Echo: Graph-Enhanced Retrieval and Execution Feedback for Issue Reproduction Test Generationcited by 4
  7. 2026iCoRe: An Iterative Correlation-Aware Retriever for Bug Reproduction Test Generationcited by 3
  8. 2026Understanding Bug-Reproducing Tests: A First Empirical Studycited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025TENET: One Step Toward Test-Driven Development for Repository-Level Code Generation
  2. 2026BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing?
  3. 2025Issue-Oriented Agent-Based Framework for Automated Review Comment Generation
  4. 2026Automating Computational Reproducibility in Social Science: Comparing Prompt-Based and Agent-Based Approaches
  5. 2025Agentic Bug Reproduction for Effective Automated Program Repair at Google
  6. 2024Evaluating Software Development Agents: Patch Patterns, Code Quality, and Issue Complexity in Real-World GitHub Scenarios
  7. 2026A Unified Issue Resolution Benchmark for Requirement Clarification, Planning, and Code Generation for Coding Agents
  8. 2026Rethinking the Value of Agent-Generated Tests for LLM-Based Software Engineering Agents