mlsanityData to 7 Oct 2026

A Systematic Literature Review on Large Language Models for Automated Program Repair

arXiv 2405.01466 ↗First posted 2 May 2024cs.SEcited by 37

Not on the map. Why?

Abstract (arXiv)

Automated Program Repair (APR) attempts to patch software bugs and reduce manual debugging efforts. Very recently, with the advances in Large Language Models (LLMs), an increasing number of APR techniques have been proposed, facilitating software development and maintenance and demonstrating remarkable performance. However, due to ongoing explorations in the LLM-based APR field, it is challenging for researchers to understand the current achievements, challenges, and potential opportunities. This work provides the first systematic literature review to summarize the applications of LLMs in APR between 2020 and 2025. We analyze 189 relevant papers from LLMs, APR and their integration perspectives. First, we categorize existing popular LLMs that are applied to support APR and outline four types of utilization strategies for their deployment. Besides, we detail some specific repair scenarios that benefit from LLMs, e.g., semantic bugs and security vulnerabilities. Furthermore, we discuss several critical aspects of integrating LLMs into APR research, e.g., input forms and open science. Finally, we highlight a set of challenges remaining to be investigated and the potential guidelines for future research. Overall, our paper provides a systematic overview of the research landscape to the APR community, helping researchers gain a comprehensive understanding of achievements and promote future research.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 May 2024.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 11; 2026: 17.

37 papers.

Sort:

By area:

  1. 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
  2. 2024When LLMs Meet Cybersecurity: A Systematic Literature Reviewcited by 70
  3. 2025Type-Constrained Code Generation with Language Modelscited by 32
  4. 2024Source Code Summarization in the Era of Large Language Modelscited by 30
  5. 2025AI Agentic Programming: A Survey of Techniques, Challenges, and Opportunitiescited by 26
  6. 2025debug-gym: A Text-Based Environment for Interactive Debuggingcited by 19
  7. 2025Afterburner: Reinforcement Learning Facilitates Self-Improving Code Efficiency Optimizationcited by 14
  8. 2025Seeing is Fixing: Cross-Modal Reasoning with Multimodal LLMs for Visual Software Issue Fixingcited by 11
  9. 2024RepairBench: Leaderboard of Frontier Models for Program Repaircited by 9
  10. 2024Can GPT-O1 Kill All Bugs? An Evaluation of GPT-Family LLMs on QuixBugscited by 7
  11. 2024ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarizationcited by 6
  12. 2025Agentic Program Repair from Test Failures at Scale: A Neuro-symbolic approach with static analysis and test execution feedbackcited by 6
25 more
  1. 2025Can LLMs Find Bugs in Code? An Evaluation from Beginner Errors to Security Vulnerabilities in Python and C++cited by 3
  2. 2026CktEvo: Repository-Level RTL Code Benchmark for Design Evolutioncited by 3
  3. 2024Automated Code Fix Suggestions for Accessibility Issues in Mobile Appscited by 2
  4. 2024An Empirical Study on Self-correcting Large Language Models for Data Science Code Generationcited by 2
  5. 2024Detection Made Easy: Potentials of Large Language Models for Solidity Vulnerabilitiescited by 2
  6. 2025Improving Retrieval-Augmented Deep Assertion Generation via Joint Trainingcited by 2
  7. 2025HAFixAgent: History-Aware Program Repair Agentcited by 2
  8. 2026Polaris: A G"odel Agent Framework for Small Language Models through Experience-Abstracted Policy Repaircited by 2
  9. 2026LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Reviewcited by 2
  10. 2026ARISE: A Repository-level Graph Representation and Toolset for Agentic Program Repair and Fault Localizationcited by 2
  11. 2026DeepDiscovery: A Location-Inference Framework for Task-Level Repository Understandingcited by 1
  12. 2026Writing Bug Reports for Software Repair Agents: What Information Matters Most?cited by 1
  13. 2026Multi-Perspective Agentic Program Repair via Code Property Graphs and Temporal Execution Graphscited by 1
  14. 2025T3: Multi-level Tree-based Automatic Program Repair with Large Language Modelscited by 0
  15. 2025Learning Bug Context for PyTorch-to-JAX Translation with LLMscited by 0
  16. 2026A Metamorphic Testing Approach to Diagnosing Memorization in LLM-Based Program Repaircited by 0
  17. 2026An Empirical Evaluation of Locally Deployed LLMs for Bug Detection in Python Codecited by 0
  18. 2026BLAgent: Agentic RAG for File-Level Bug Localizationcited by 0
  19. 2026Benchmarking Large Language Models on Floating-Point Error Classificationcited by 0
  20. 2026Beyond Textual Repository Exploration: Dual-Modal Structural Reasoning for Agentic Issue Resolutioncited by 0
  21. 2026Multi-Agent LLM Collaboration for Unit Test Generation via Human-Testing-Inspired Workflowscited by 0
  22. 2026Retrieval-Oriented Code Representations in Agentic Bug Localizationcited by 0
  23. 2026Deep Academic Survey: Stateful Agentic Closed-Loop Paradigm for Academic Survey Automationcited by 0
  24. 2026The Vibe Shift in Software Engineering: Evaluating AI-Led Conversational Programming for Performance, Cognition, and Responsible Adoptioncited by 0
  25. 2026Test-Driven Approaches to Software Engineering with Large Language Models: A Survey of Phases, Tasks, and Agent Skillscited by 0