Writing Bug Reports for Software Repair Agents: What Information Matters Most?
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Software development is increasingly moving toward agentic-first workflows. This includes AI agents responsible for generating initial fixes for submitted issue reports. In this setting, issue reports are no longer merely documentation for human maintainers; they become the primary task specification for the agent. However, little is known about how such reports should be written to maximize the agent's chances of producing a correct fix. We study what makes a bug report agent-ready. Starting from the SWE-bench Verified benchmark (i.e., a collection of 500 real repository issues with human-written gold patches and test suites for evaluating generated fixes) we manually classify each issue by change type (e.g., bug fix vs refactoring) and annotate each sentence with its information type, such as observed behavior, expected behavior, reproduction steps, localization cues, and suggested fixes. We focus on the 441 issues representing bug reports, and we run on them mini-swe-agent using three LLM backbones (i.e., GPT-5-mini, MiniMax M2.5, and Gemini 3 Flash). We then fit a binomial regression model to estimate the incremental association between each information type and agent success, controlling for confounding factors. Our results suggest that agentic-first reports benefit most from information that narrows the agent's search and repair space. Localization cues, such as references to affected code areas, are positively associated with successful repairs, while suggested fixes, expressed either in code or natural language, show some of the strongest positive associations with pass probability. An ablation study removing selected information types confirms that agents benefit less from information traditionally useful to humans, such as reproduction steps, and more from sentences that expose a repair direction, either through bug localization or a suggested fix.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 69 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
29 of 69 references.
Closest ancestors · 12
Same direction, newest first
- 2026Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architectures3 Apr
- 2026Yet Even Less Is Even Better For Agentic, Reasoning, and Coding LLMs1 Apr
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?17 Nov
- 2025Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scaling31 Jul
- 2025SWE-smith: Scaling Data for Software Engineering Agents30 Apr
- 2025DARS: Dynamic Action Re-Sampling to Enhance Coding Agent Performance by Adaptive Tree Traversal18 Mar
- 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement26 Oct
- 2024SpecRover: Code Intent Extraction via LLMs5 Aug
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agents23 Jul
- 2024MASAI: Modular Architecture for Software-engineering AI Agents17 Jun
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
- 2024MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolution26 Mar
Other references · 17
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,502
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,274
- 2024AutoCodeRover: Autonomous Program Improvementcited by 274
- 2024CodeR: Issue Resolving with Multi-Agent and Task Graphscited by 91
- 2025SWE-Exp: Experience-Driven Software Issue Resolutioncited by 65
- 2024Alibaba LingmaAgent: Improving Automated Issue Resolution via Comprehensive Repository Explorationcited by 58
- 2023A Survey of Learning-based Automated Program Repaircited by 55
- 2023Prompting Is All You Need: Automated Android Bug Replay with Large Language Modelscited by 40
- 2024A Systematic Literature Review on Large Language Models for Automated Program Repaircited by 37
- 2025EXPEREPAIR: Dual-Memory Enhanced LLM-based Repository-Level Program Repaircited by 35
- 2019Assessing the Quality of the Steps to Reproduce in Bug Reportscited by 13
- 2024FlexFL: Flexible and Effective Fault Localization with Open-Source Large Language Modelscited by 8
5 more
- 2017Auto-completing Bug Reports for Android Applicationscited by 7
- 2023BURT: A Chatbot for Interactive Bug Reportingcited by 5
- 2025Combining Language and App UI Analysis for the Automated Assessment of Bug Reproduction Stepscited by 2
- 2026Automated Table Reproduction via Code Generationcited by 2
- 2026ImproBR: Bug Report Improver Using LLMscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026What Makes a Good Bug Report for an AI Agent?
- 2025Can Agents Fix Agent Issues?
- 2024Evaluating Software Development Agents: Patch Patterns, Code Quality, and Issue Complexity in Real-World GitHub Scenarios
- 2026ReProAgent: Tool-Augmented Multi-Stage Agentic Generation of Bug Reproduction Tests from Issue Reports
- 2025Understanding Automated Program Repair Agents Through the Lens of Traceability: An Empirical Study
- 2026Active-SWE: Benchmarking Coding Agents for Proactive Bug Fixing without Issue Reports
- 2025Evaluating Agent-based Program Repair at Google
- 2026Coding Agents Don't Know When to Act