Agentic Software Issue Resolution with Large Language Models: A Survey
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Software issue resolution aims to address real-world issues in software repositories based on natural language descriptions provided by users, and represents a key aspect of software maintenance. With the rapid development of large language models (LLMs) in reasoning and generation, LLM-based approaches have made significant progress in automated software issue resolution. However, resolving real-world software issues is inherently complex and requires long-horizon reasoning, iterative exploration, and feedback-driven decision-making, which demand agentic capabilities beyond conventional single-step approaches. Recently, LLM-based agentic systems have emerged as a promising research direction for software issue resolution, accompanied by rapid growth in the relevant literature. Advances in agentic software issue resolution can not only greatly improve the efficiency and quality of software maintenance, but also provide a realistic environment for evaluating the reasoning, planning, and execution capabilities of agentic systems, thereby bridging artificial intelligence and software engineering. This work presents a systematic survey of 242 recent studies at the forefront of research on LLM-based agentic software issue resolution. It outlines the general workflow of the task and establishes a taxonomy across three dimensions: benchmarks, techniques, and empirical studies. Furthermore, it highlights reinforcement learning as an increasingly important training paradigm for agentic systems in software engineering. Finally, it summarizes key challenges and outlines promising directions for future research.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 161 of its 311 references that are in the map. First posted on arXiv 24 Dec 2025.
Builds on
161 of 311 references.
Closest ancestors · 62
Same direction, newest first
- 2025Toward Training Superintelligent Software Agents through Self-Play SWE-RL21 Dec
- 2025SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarios20 Dec
- 2025Training Versatile Coding Agents in Synthetic Environments13 Dec
- 2025Does SWE-Bench-Verified Test Agent Ability or Model Memory?11 Dec
- 2025SWEnergy: An Empirical Study on Energy Efficiency in Agentic Issue Resolution Frameworks with SLMs10 Dec
- 2025Process-Centric Analysis of Agentic Software Systems2 Dec
- 2025SABER: Small Actions, Big Errors -- Safeguarding Mutating Steps in LLM Agents26 Nov
- 2025Live-SWE-agent: Can Software Engineering Agents Self-Evolve on the Fly?17 Nov
- 2025Understanding Code Agent Behaviour: An Empirical Study of Success and Failure Trajectories31 Oct
- 2025TOM-SWE: User Mental Modeling For Software Engineering Agents24 Oct
- 2025Huxley-G"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machine24 Oct
- 2025More with Less: An Empirical Study of Turn-Control Strategies for Efficient Coding Agents19 Oct
38 more
- 2025SIADAFIX: issue description response for adaptive program repair17 Oct
- 2025Lingxi: Repository-Level Issue Resolution Framework Enhanced by Procedural Knowledge Guided Scaling13 Oct
- 2025A Comprehensive Survey on Benchmarks and Solutions in Software Engineering of LLM-Empowered Agentic System10 Oct
- 2025Saving SWE-Bench: A Benchmark Mutation Approach for Realistic Agent Evaluation10 Oct
- 2025Lita: Light Agent Uncovers the Agentic Coding Capabilities of LLMs30 Sep
- 2025Reducing Cost of LLM Agents with Trajectory Reduction28 Sep
- 2025Kimi-Dev: Agentless Training as Skill Prior for SWE-Agents27 Sep
- 2025An Empirical Study on Failures in Automated Issue Solving17 Sep
- 2025When Agents go Astray: Course-Correcting SWE Agents with PRMs2 Sep
- 2025Devstral: Fine-tuning Language Models for Coding Agent Applications8 Aug
- 2025RepoForge: Training a SOTA Fast-thinking SWE Agent with an End-to-End Data Curation Pipeline Synergizing SFT and RL at Scale3 Aug
- 2025Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scaling31 Jul
- 2025SWE-Debate: Competitive Multi-Agent Debate for Software Issue Resolution31 Jul
- 2025Skywork-SWE: Unveiling Data Scaling Laws for Software Engineering in LLMs24 Jun
- 2025Understanding Software Engineering Agents: A Study of Thought-Action-Result Trajectories23 Jun
- 2025PAGENT: Learning to Patch Software Engineering Agents21 Jun
- 2025SemAgent: A Semantics Aware Program Repair Agent19 Jun
- 2025UTBoost: Rigorous Evaluation of Coding Agents on SWE-Bench10 Jun
- 2025SWE-Dev: Building Software Engineering Agents with Training and Inference Scaling9 Jun
- 2025GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents29 May
- 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents26 May
- 2025TRAIL: Trace Reasoning and Agentic Issue Localization13 May
- 2025SWE-smith: Scaling Data for Software Engineering Agents30 Apr
- 2025SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents11 Apr
- 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents9 Apr
- 2025Thinking Longer, Not Larger: Enhancing Software Engineering Agents via Scaling Test-Time Compute31 Mar
- 2025SEAlign: Alignment Training for Software Engineering Agent24 Mar
- 2025DARS: Dynamic Action Re-Sampling to Enhance Coding Agent Performance by Adaptive Tree Traversal18 Mar
- 2025Beyond Final Code: A Process-Oriented Error Analysis of Software Development Agents in Real-World GitHub Scenarios16 Mar
- 2025LocAgent: Graph-Guided LLM Agents for Code Localization12 Mar
- 2025Ambig-SWE: Interactive Agents to Overcome Underspecificity in Software Engineering18 Feb
- 2025Agentic Bug Reproduction for Effective Automated Program Repair at Google3 Feb
- 2025OrcaLoca: An LLM Agent Framework for Software Issue Localization1 Feb
- 2025Large Language Model Critics for Execution-Free Evaluation of Code Changes28 Jan
- 2024Training Software Engineering Agents and Verifiers with SWE-Gym30 Dec
- 2024An Empirical Study on LLM-based Agents for Automated Bug Fixing15 Nov
- 2024Lingma SWE-GPT: An Open Development-Process-Centric Language Model for Automated Software Improvement1 Nov
- 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement26 Oct
50 newest of 62 All 62 (JSON)
Other references · 99
- 2017Attention Is All You Needcited by 59,932
- 2023GPT-4 Technical Reportcited by 18,132
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2025Qwen3 Technical Reportcited by 8,195
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Qwen Technical Reportcited by 3,273
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2024A Survey on LLM-as-a-Judgecited by 1,384
38 more
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2024A Survey on Large Language Models for Code Generationcited by 646
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
- 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
- 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 246
- 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 196
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 195
- 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 167
- 2025Multi-SWE-bench: A Multilingual Benchmark for Issue Resolvingcited by 165
- 2025Qwen2.5-1M Technical Reportcited by 158
- 2023Keep the Conversation Going: Fixing 162 out of 337 bugs for 0.42 each using ChatGPTcited by 125
- 2022Large Language Models are Few-shot Testers: Exploring LLM-based General Bug Reproductioncited by 110
- 2024SWE-Bench+: Enhanced Coding Benchmark for LLMscited by 95
- 2025Learn-by-interact: A Data-Centric Framework for Self-Adaptive Agents in Realistic Environmentscited by 93
- 2025Agent KB: Leveraging Cross-Domain Experience for Agentic Problem Solvingcited by 90
- 2024CodeR: Issue Resolving with Multi-Agent and Task Graphscited by 89
- 2024RepoGraph: Enhancing AI Software Engineering with Repository-level Code Graphcited by 88
- 2025SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolutioncited by 87
- 2025CWM: An Open-Weights LLM for Research on Code Generation with World Modelscited by 87
- 2025SE-Agent: Self-Evolution Trajectory Optimization in Multi-Step Reasoning with LLM-Based Agentscited by 66
- 2025SWE-Exp: Experience-Driven Software Issue Resolutioncited by 64
- 2024CodexGraph: Bridging Large Language Models and Code Repositories via Code Graph Databasescited by 62
- 2024Alibaba LingmaAgent: Improving Automated Issue Resolution via Comprehensive Repository Explorationcited by 58
- 2025FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementationcited by 57
- 2024TestGenEval: A Real World Unit Test Generation and Test Completion Benchmarkcited by 49
- 2025Are "Solved Issues" in SWE-bench Really Solved Correctly? An Empirical Studycited by 47
- 2025The SWE-Bench Illusion: When State-of-the-Art LLMs Remember Instead of Reasoncited by 47
- 2025Agent-RLVR: Training Software Engineering Agents via Guidance and Environment Rewardscited by 41
- 2023RepoFusion: Training Code Models to Understand Your Repositorycited by 40
- 2021AutoFL: Enabling Heterogeneity-Aware Energy Efficient Federated Learningcited by 39
- 2024CoRNStack: High-Quality Contrastive Data for Better Code Retrieval and Rerankingcited by 37
- 2024SWE-bench-java: A GitHub Issue Resolving Benchmark for Javacited by 34
- 2025EXPEREPAIR: Dual-Memory Enhanced LLM-based Repository-Level Program Repaircited by 34
- 2025Training Long-Context, Multi-Turn Software Engineering Agents with Reinforcement Learningcited by 34
- 2025SWE-Perf: Can Language Models Optimize Code Performance on Real-World Repositories?cited by 33
- 2024TDD-Bench Verified: Can LLMs Generate Tests for Issues Before They Get Resolved?cited by 32
50 most cited of 99 All 99 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026From Laboratory to Real-World Applications: Benchmarking Agentic Code Reasoning at the Repository Levelcited by 6
- 2026Learning When to Remember: Risk-Sensitive Contextual Bandits for Abstention-Aware Memory Retrieval in LLM-Based Coding Agentscited by 3
- 2026Agentic Agile-V: From Vibe Coding to Verified Engineering in Software and Hardware Developmentcited by 2
- 2026RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworkscited by 1
- 2026Graphectory Viewer: A Tool for Process-Centric Analysis of Agentic Software Trajectoriescited by 1
- 2026Beyond Textual Repository Exploration: Dual-Modal Structural Reasoning for Agentic Issue Resolutioncited by 0
- 2026Graphectory Viewer: A Tool for Process-Centric Analysis of Agentic Software Trajectories17 Aug 2026
- 2026RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks12 Aug 2026
- 2026Beyond Textual Repository Exploration: Dual-Modal Structural Reasoning for Agentic Issue Resolution2 Jul 2026
- 2026Agentic Agile-V: From Vibe Coding to Verified Engineering in Software and Hardware Development19 May 2026
- 2026Learning When to Remember: Risk-Sensitive Contextual Bandits for Abstention-Aware Memory Retrieval in LLM-Based Coding Agents30 Apr 2026
- 2026From Laboratory to Real-World Applications: Benchmarking Agentic Code Reasoning at the Repository Level7 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Advances and Frontiers of LLM-based Issue Resolution in Software Engineering: A Comprehensive Survey
- 2026LLM-Based Agentic Systems for Software Engineering: Challenges and Opportunities
- 2026SWE-Adept: An LLM-Based Agentic Framework for Deep Codebase Analysis and Structured Issue Resolution
- 2026SelfHeal: Empirical Fix Pattern Analysis and Bug Repair in LLM Agents
- 2025Can Agents Fix Agent Issues?
- 2026REAgent: Requirement-Driven LLM Agents for Software Issue Resolution
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future
- 2026Reproducible, Explainable, and Effective Evaluations of Agentic AI for Software Engineering