A Survey of Learning-based Automated Program Repair
Not on the map. Why?
Abstract (arXiv)
Automated program repair (APR) aims to fix software bugs automatically and plays a crucial role in software development and maintenance. With the recent advances in deep learning (DL), an increasing number of APR techniques have been proposed to leverage neural networks to learn bug-fixing patterns from massive open-source code repositories. Such learning-based techniques usually treat APR as a neural machine translation (NMT) task, where buggy code snippets (i.e., source language) are translated into fixed code snippets (i.e., target language) automatically. Benefiting from the powerful capability of DL to learn hidden relationships from previous bug-fixing datasets, learning-based APR techniques have achieved remarkable performance. In this paper, we provide a systematic survey to summarize the current state-of-the-art research in the learning-based APR community. We illustrate the general workflow of learning-based APR techniques and detail the crucial components, including fault localization, patch generation, patch ranking, patch validation, and patch correctness phases. We then discuss the widely-adopted datasets and evaluation metrics and outline existing empirical studies. We discuss several critical aspects of learning-based APR techniques, such as repair domains, industrial deployment, and the open science issue. We highlight several practical guidelines on applying DL techniques for future APR studies, such as exploring explainable patch generation and utilizing code features. Overall, our paper can help researchers gain a comprehensive understanding about the achievements of the existing learning-based APR techniques and promote the practical application of these techniques. Our artifacts are publicly available at urlhttps://github.com/QuanjunZhang/AwesomeLearningAPR.
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jan 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 5; 2024: 19; 2025: 16; 2026: 15.
55 papers.
Sort:
By area:
- 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repaircited by 225
- 2024MarsCode Agent: AI-native Automated Bug Fixingcited by 68
- 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Codecited by 62
- 2024Calibration and Correctness of Language Models for Codecited by 49
- 2024An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities against Strong Detectioncited by 32
- 2024An Empirical Study on LLM-based Agents for Automated Bug Fixingcited by 23
- 2024Increasing the LLM Accuracy for Question Answering: Ontologies to the Rescue!cited by 18
- 2025A Comprehensive Survey on Benchmarks and Solutions in Software Engineering of LLM-Empowered Agentic Systemcited by 15
- 2026Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architecturescited by 15
- 2024Aligning the Objective of LLM-based Program Repaircited by 12
- 2026TrajAudit: Automated Failure Diagnosis for Agentic Coding Systemscited by 11
- 2024Enhanced Automated Code Vulnerability Repair using Large Language Modelscited by 10
38 more
- 2023Data Cleaning and Machine Learning: A Systematic Literature Reviewcited by 9
- 2024VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patchingcited by 9
- 2024RepairBench: Leaderboard of Frontier Models for Program Repaircited by 9
- 2026SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repaircited by 9
- 2024Can GPT-O1 Kill All Bugs? An Evaluation of GPT-Family LLMs on QuixBugscited by 7
- 2024TransAgent: Enhancing LLM-Based Code Translation via Fine-Grained Execution Alignmentcited by 7
- 2025The Art of Repair: Optimizing Iterative Program Repair with Instruction-Tuned Modelscited by 7
- 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarizationcited by 6
- 2024CursorCore: Assist Programming through Aligning Anythingcited by 6
- 2025ReCode: Improving LLM-based Code Repair with Fine-Grained Retrieval-Augmented Generationcited by 6
- 2026TraceCoder: A Trace-Driven Multi-Agent Framework for Automated Debugging of LLM-Generated Codecited by 6
- 2023Revisiting and Improving Retrieval-Augmented Deep Assertion Generationcited by 5
- 2023ConDefects: A New Dataset to Address the Data Leakage Concern for LLM-based Fault Localization and Program Repaircited by 4
- 2024Understanding Defects in Generated Codes by Language Modelscited by 4
- 2025Improving Deep Assertion Generation via Fine-Tuning Retrieval-Augmented Pre-trained Language Modelscited by 4
- 2026Coding Agents Don't Know When to Actcited by 4
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trendscited by 3
- 2025Unlocking LLM Repair Capabilities Through Cross-Language Translation and Multi-Agent Refinementcited by 3
- 2025The Impact of Fine-tuning Large Language Models on Automated Program Repaircited by 3
- 2025Diffusion is a code repair operator and generatorcited by 3
- 2024Exploring the Integration of Large Language Models in Industrial Test Maintenance Processescited by 2
- 2025Improving Retrieval-Augmented Deep Assertion Generation via Joint Trainingcited by 2
- 2024The Rise and Fall(?) of Software Engineeringcited by 1
- 2024Agent-Driven Automatic Software Improvementcited by 1
- 2025Variational Prefix Tuning for Diverse and Accurate Code Summarization Using Pre-trained Language Modelscited by 1
- 2025RePaCA: Leveraging Reasoning Large Language Models for Static Automated Patch Correctness Assessmentcited by 1
- 2025A Research Roadmap for Augmenting Software Engineering Processes and Software Products with Generative AIcited by 1
- 2026AdaptEval: A Benchmark for Evaluating Large Language Models on Code Snippet Adaptationcited by 1
- 2026Precise Debugging Benchmark: Is Your Model Debugging or Regenerating?cited by 1
- 2026Writing Bug Reports for Software Repair Agents: What Information Matters Most?cited by 1
- 2026Multi-Perspective Agentic Program Repair via Code Property Graphs and Temporal Execution Graphscited by 1
- 2023A new solution and concrete implementation steps for Artificial General Intelligencecited by 0
- 2025Self-Bootstrapping Automated Program Repair: Using LLMs to Generate and Evaluate Synthetic Training Data for Bug Repaircited by 0
- 2025Repairing Language Model Pipelines by Meta Self-Refining Competing Constraints at Runtimecited by 0
- 2025BitsAI-Fix: LLM-Driven Approach for Automated Lint Error Resolution in Practicecited by 0
- 2025Post-hoc LLM-Supported Debugging of Distributed Processescited by 0
- 2025Software Vulnerability Management in the Era of Artificial Intelligence: An Industry Perspectivecited by 0
- 2026Principled Fine-tuning of LLMs from User-Edits: A Medley of Preference, Supervision, and Rewardcited by 0
50 most cited of 55 All 55 (JSON)
- 2026Metrics Failure in LLM-Based Code Vulnerability Repair: An Empirical Study and a Change-Aware Screen22 Sep 2026
- 2026Agentic Method for Deterministic Validation of Legacy Code Migration30 Jul 2026
- 2026Multi-Perspective Agentic Program Repair via Code Property Graphs and Temporal Execution Graphs14 Jul 2026
- 2026Writing Bug Reports for Software Repair Agents: What Information Matters Most?10 Jul 2026
- 2026VeriPilot: An LLM-Powered Verilog Debugging Framework22 Jun 2026
- 2026Exploration Structure in LLM Agents for Multi-File Change Localization10 Jun 2026
- 2026TrajAudit: Automated Failure Diagnosis for Agentic Coding Systems26 May 2026
- 2026Coding Agents Don't Know When to Act8 May 2026
- 2026A Metamorphic Testing Approach to Diagnosing Memorization in LLM-Based Program Repair23 Apr 2026
- 2026Precise Debugging Benchmark: Is Your Model Debugging or Regenerating?19 Apr 2026
- 2026Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architectures3 Apr 2026
- 2026SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repair27 Feb 2026
38 more
- 2026TraceCoder: A Trace-Driven Multi-Agent Framework for Automated Debugging of LLM-Generated Code6 Feb 2026
- 2026Principled Fine-tuning of LLMs from User-Edits: A Medley of Preference, Supervision, and Reward27 Jan 2026
- 2026AdaptEval: A Benchmark for Evaluating Large Language Models on Code Snippet Adaptation8 Jan 2026
- 2025Software Vulnerability Management in the Era of Artificial Intelligence: An Industry Perspective20 Dec 2025
- 2025A Research Roadmap for Augmenting Software Engineering Processes and Software Products with Generative AI30 Oct 2025
- 2025A Comprehensive Survey on Benchmarks and Solutions in Software Engineering of LLM-Empowered Agentic System10 Oct 2025
- 2025ReCode: Improving LLM-based Code Repair with Fine-Grained Retrieval-Augmented Generation2 Sep 2025
- 2025Post-hoc LLM-Supported Debugging of Distributed Processes20 Aug 2025
- 2025Diffusion is a code repair operator and generator14 Aug 2025
- 2025BitsAI-Fix: LLM-Driven Approach for Automated Lint Error Resolution in Practice5 Aug 2025
- 2025RePaCA: Leveraging Reasoning Large Language Models for Static Automated Patch Correctness Assessment30 Jul 2025
- 2025The Impact of Fine-tuning Large Language Models on Automated Program Repair26 Jul 2025
- 2025Repairing Language Model Pipelines by Meta Self-Refining Competing Constraints at Runtime11 Jul 2025
- 2025Variational Prefix Tuning for Diverse and Accurate Code Summarization Using Pre-trained Language Models14 May 2025
- 2025Self-Bootstrapping Automated Program Repair: Using LLMs to Generate and Evaluate Synthetic Training Data for Bug Repair12 May 2025
- 2025The Art of Repair: Optimizing Iterative Program Repair with Instruction-Tuned Models5 May 2025
- 2025Unlocking LLM Repair Capabilities Through Cross-Language Translation and Multi-Agent Refinement28 Mar 2025
- 2025Improving Deep Assertion Generation via Fine-Tuning Retrieval-Augmented Pre-trained Language Models22 Feb 2025
- 2025Improving Retrieval-Augmented Deep Assertion Generation via Joint Training15 Feb 2025
- 2024An Empirical Study on LLM-based Agents for Automated Bug Fixing15 Nov 2024
- 2024CursorCore: Assist Programming through Aligning Anything9 Oct 2024
- 2024TransAgent: Enhancing LLM-Based Code Translation via Fine-Grained Execution Alignment30 Sep 2024
- 2024RepairBench: Leaderboard of Frontier Models for Program Repair27 Sep 2024
- 2024VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patching16 Sep 2024
- 2024Can GPT-O1 Kill All Bugs? An Evaluation of GPT-Family LLMs on QuixBugs16 Sep 2024
- 2024Exploring the Integration of Large Language Models in Industrial Test Maintenance Processes10 Sep 2024
- 2024MarsCode Agent: AI-native Automated Bug Fixing2 Sep 2024
- 2024Understanding Defects in Generated Codes by Language Models23 Aug 2024
- 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarization1 Jul 2024
- 2024Agent-Driven Automatic Software Improvement24 Jun 2024
- 2024The Rise and Fall(?) of Software Engineering14 Jun 2024
- 2024An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities against Strong Detection10 Jun 2024
- 2024Increasing the LLM Accuracy for Question Answering: Ontologies to the Rescue!20 May 2024
- 2024Aligning the Objective of LLM-based Program Repair13 Apr 2024
- 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repair25 Mar 2024
- 2024Calibration and Correctness of Language Models for Code3 Feb 2024
- 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends15 Jan 2024
- 2024Enhanced Automated Code Vulnerability Repair using Large Language Models8 Jan 2024
50 newest of 55 All 55 (JSON)
- 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repaircited by 225
- 2024MarsCode Agent: AI-native Automated Bug Fixingcited by 68
- 2024An Empirical Study on LLM-based Agents for Automated Bug Fixingcited by 23
- 2025A Comprehensive Survey on Benchmarks and Solutions in Software Engineering of LLM-Empowered Agentic Systemcited by 15
- 2026Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architecturescited by 15
- 2026TrajAudit: Automated Failure Diagnosis for Agentic Coding Systemscited by 11
- 2026SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repaircited by 9
- 2026TraceCoder: A Trace-Driven Multi-Agent Framework for Automated Debugging of LLM-Generated Codecited by 6
- 2026Coding Agents Don't Know When to Actcited by 4
- 2025Unlocking LLM Repair Capabilities Through Cross-Language Translation and Multi-Agent Refinementcited by 3
- 2024Agent-Driven Automatic Software Improvementcited by 1
- 2026Writing Bug Reports for Software Repair Agents: What Information Matters Most?cited by 1
12 most cited of 15 All 15 (JSON)
- 2026Agentic Method for Deterministic Validation of Legacy Code Migration30 Jul 2026
- 2026Multi-Perspective Agentic Program Repair via Code Property Graphs and Temporal Execution Graphs14 Jul 2026
- 2026Writing Bug Reports for Software Repair Agents: What Information Matters Most?10 Jul 2026
- 2026Exploration Structure in LLM Agents for Multi-File Change Localization10 Jun 2026
- 2026TrajAudit: Automated Failure Diagnosis for Agentic Coding Systems26 May 2026
- 2026Coding Agents Don't Know When to Act8 May 2026
- 2026Inside the Scaffold: A Source-Code Taxonomy of Coding Agent Architectures3 Apr 2026
- 2026SGAgent: Suggestion-Guided LLM-Based Multi-Agent Framework for Repository-Level Software Repair27 Feb 2026
- 2026TraceCoder: A Trace-Driven Multi-Agent Framework for Automated Debugging of LLM-Generated Code6 Feb 2026
- 2025A Comprehensive Survey on Benchmarks and Solutions in Software Engineering of LLM-Empowered Agentic System10 Oct 2025
- 2025Unlocking LLM Repair Capabilities Through Cross-Language Translation and Multi-Agent Refinement28 Mar 2025
- 2024An Empirical Study on LLM-based Agents for Automated Bug Fixing15 Nov 2024
12 newest of 15 All 15 (JSON)
- 2025ReCode: Improving LLM-based Code Repair with Fine-Grained Retrieval-Augmented Generationcited by 6
- 2023Revisiting and Improving Retrieval-Augmented Deep Assertion Generationcited by 5
- 2025Improving Deep Assertion Generation via Fine-Tuning Retrieval-Augmented Pre-trained Language Modelscited by 4
- 2025Improving Retrieval-Augmented Deep Assertion Generation via Joint Trainingcited by 2
- 2025ReCode: Improving LLM-based Code Repair with Fine-Grained Retrieval-Augmented Generation2 Sep 2025
- 2025Improving Deep Assertion Generation via Fine-Tuning Retrieval-Augmented Pre-trained Language Models22 Feb 2025
- 2025Improving Retrieval-Augmented Deep Assertion Generation via Joint Training15 Feb 2025
- 2023Revisiting and Improving Retrieval-Augmented Deep Assertion Generation19 Sep 2023
- 2025Diffusion is a code repair operator and generatorcited by 3
- 2025Diffusion is a code repair operator and generator14 Aug 2025
- 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Codecited by 62
- 2024Calibration and Correctness of Language Models for Codecited by 49
- 2024Increasing the LLM Accuracy for Question Answering: Ontologies to the Rescue!cited by 18
- 2024Aligning the Objective of LLM-based Program Repaircited by 12
- 2024Enhanced Automated Code Vulnerability Repair using Large Language Modelscited by 10
- 2023Data Cleaning and Machine Learning: A Systematic Literature Reviewcited by 9
- 2024VulnLLMEval: A Framework for Evaluating Large Language Models in Software Vulnerability Detection and Patchingcited by 9
- 2024RepairBench: Leaderboard of Frontier Models for Program Repaircited by 9
- 2024Can GPT-O1 Kill All Bugs? An Evaluation of GPT-Family LLMs on QuixBugscited by 7
- 2024TransAgent: Enhancing LLM-Based Code Translation via Fine-Grained Execution Alignmentcited by 7
- 2025The Art of Repair: Optimizing Iterative Program Repair with Instruction-Tuned Modelscited by 7
- 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarizationcited by 6
12 most cited of 31 All 31 (JSON)
- 2026Metrics Failure in LLM-Based Code Vulnerability Repair: An Empirical Study and a Change-Aware Screen22 Sep 2026
- 2026VeriPilot: An LLM-Powered Verilog Debugging Framework22 Jun 2026
- 2026A Metamorphic Testing Approach to Diagnosing Memorization in LLM-Based Program Repair23 Apr 2026
- 2026Precise Debugging Benchmark: Is Your Model Debugging or Regenerating?19 Apr 2026
- 2026Principled Fine-tuning of LLMs from User-Edits: A Medley of Preference, Supervision, and Reward27 Jan 2026
- 2026AdaptEval: A Benchmark for Evaluating Large Language Models on Code Snippet Adaptation8 Jan 2026
- 2025Software Vulnerability Management in the Era of Artificial Intelligence: An Industry Perspective20 Dec 2025
- 2025A Research Roadmap for Augmenting Software Engineering Processes and Software Products with Generative AI30 Oct 2025
- 2025Post-hoc LLM-Supported Debugging of Distributed Processes20 Aug 2025
- 2025BitsAI-Fix: LLM-Driven Approach for Automated Lint Error Resolution in Practice5 Aug 2025
- 2025The Impact of Fine-tuning Large Language Models on Automated Program Repair26 Jul 2025
- 2025Repairing Language Model Pipelines by Meta Self-Refining Competing Constraints at Runtime11 Jul 2025
12 newest of 31 All 31 (JSON)