SequenceR: Sequence-to-Sequence Learning for End-to-End Program Repair
Not on the map. Why?
Abstract (arXiv)
This paper presents a novel end-to-end approach to program repair based on sequence-to-sequence learning. We devise, implement, and evaluate a system, called SequenceR, for fixing bugs based on sequence-to-sequence learning on source code. This approach uses the copy mechanism to overcome the unlimited vocabulary problem that occurs with big code. Our system is data-driven; we train it on 35,578 samples, carefully curated from commits to open-source repositories. We evaluate it on 4,711 independent real bug fixes, as well on the Defects4J benchmark used in program repair research. SequenceR is able to perfectly predict the fixed line for 950/4711 testing samples, and find correct patches for 14 bugs in Defects4J. It captures a wide range of repair operators without any domain-specific top-down design.
Key facts. Cited by 144 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 18; 2023: 39; 2024: 21; 2025: 19; 2026: 21.
144 papers.
Sort:
By area:
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
- 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
- 2021Unified Pre-training for Program Understanding and Generationcited by 361
- 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 230
- 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repaircited by 225
- 2021CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Taskscited by 199
- 2023Is Self-Repair a Silver Bullet for Code Generation?cited by 191
- 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 173
- 2023Keep the Conversation Going: Fixing 162 out of 337 bugs for 0.42 each using ChatGPTcited by 125
- 2023Baldur: Whole-Proof Generation and Repair with Large Language Modelscited by 118
- 2023RLTF: Reinforcement Learning from Unit Test Feedbackcited by 110
38 more
- 2021Examining Zero-Shot Vulnerability Repair with Large Language Modelscited by 105
- 2023Execution-based Code Generation using Deep Reinforcement Learningcited by 95
- 2021CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Softwarecited by 89
- 2021CURE: Code-Aware Neural Machine Translation for Automatic Program Repaircited by 85
- 2021Leveraging Automated Unit Tests for Unsupervised Code Translationcited by 82
- 2021Break-It-Fix-It: Unsupervised Learning for Program Repaircited by 71
- 2021DOBF: A Deobfuscation Pre-Training Objective for Programming Languagescited by 68
- 2024Aligning LLM Agents by Learning Latent Preference from User Editscited by 66
- 2024NExT: Teaching Large Language Models to Reason about Code Executioncited by 60
- 2021A Syntax-Guided Edit Decoder for Neural Program Repaircited by 57
- 2023Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repaircited by 55
- 2023How Effective Are Neural Networks for Fixing Security Vulnerabilitiescited by 50
- 2023RepairLLaMA: Efficient Representations and Fine-Tuned Adapters for Program Repaircited by 50
- 2023LLaMA-Reviewer: Advancing Code Review Automation with Large Language Models through Parameter-Efficient Fine-Tuningcited by 47
- 2022Compilable Neural Code Generation with Compiler Feedbackcited by 46
- 2023Large Language Models and Simple, Stupid Bugscited by 45
- 2023RAP-Gen: Retrieval-Augmented Patch Generation with CodeT5 for Automatic Program Repaircited by 43
- 2023A New Era in Software Security: Towards Self-Healing Software via Large Language Models and Formal Verificationcited by 42
- 2024Can LLMs Replace Manual Annotation of Software Engineering Artifacts?cited by 40
- 2021Neural Transfer Learning for Repairing Security Vulnerabilities in C Codecited by 36
- 2024Automatic Programming: Large Language Models and Beyondcited by 35
- 2023Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Reviewcited by 32
- 2023Better patching using LLM prompting, via Self-Consistencycited by 29
- 2023Large Language Models of Code Fail at Completing Code with Potential Bugscited by 28
- 2021On Multi-Modal Learning of Editing Source Codecited by 25
- 2021A Survey on Machine Learning Techniques for Source Code Analysiscited by 23
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
- 2021Generating Bug-Fixes Using Pretrained Transformerscited by 18
- 2021DeepDebug: Fixing Python Bugs Using Stack Traces, Backtranslation, and Code Skeletonscited by 17
- 2024PromSec: Prompt Optimization for Secure Generation of Functional Source Code with Large Language Models (LLMs)cited by 17
- 2021Learning Structural Edits via Incremental Tree Transformationscited by 16
- 2023ITER: Iterative Neural Repair for Multi-Location Patchescited by 16
- 2023GrACE: Generation using Associated Code Editscited by 16
- 2023Towards Generating Functionally Correct Code Edits from Natural Language Issue Descriptionscited by 14
- 2023Benchmarking Causal Study to Interpret Large Language Models for Source Codecited by 14
- 2025Beyond Final Code: A Process-Oriented Error Analysis of Software Development Agents in Real-World GitHub Scenarioscited by 14
- 2023KNOD: Domain Knowledge Distilled Tree Decoder for Automated Program Repaircited by 13
- 2023Toward a Theory of Causation for Interpreting Neural Code Modelscited by 12
50 most cited of 144 All 144 (JSON)
- 2026SPHERE: Adaptive VR Indoor Scene Generation via LLM-Enhanced Spatial Preference Learning and Human-in-the-Loop RL1 Oct 2026
- 2026RepairFormer: Automated Repair of Structured Inputs Using Transformers5 Aug 2026
- 2026The Order Is the Guarantee: Verifier-Budgeted Code Deletion with Static-First Learned Proposals5 Aug 2026
- 2026AssumptionMiner: Extracting, Tracing, and Revising Implicit Assumptions in LLM Code Generation24 Jul 2026
- 2026Multi-Perspective Agentic Program Repair via Code Property Graphs and Temporal Execution Graphs14 Jul 2026
- 2026Anchored Self-Play for Code Repair3 Jul 2026
- 2026Diff-Based Code Corruption using LLMs for Large-Scale Bugfix Benchmarking27 Jun 2026
- 2026RAVEN: Agentic RAG for Automated Vulnerability Repair21 Jun 2026
- 2026Exploration Structure in LLM Agents for Multi-File Change Localization10 Jun 2026
- 2026EviACT: An Evidence-to-Action Framework for Agentic Program Repair26 May 2026
- 2026NeuroNL2LTL: A Neurosymbolic Framework for Natural Language Translation of Linear Temporal Logic20 May 2026
- 2026Signal Reshaping for GRPO in Weak-Feedback Agentic Code Repair8 May 2026
38 more
- 2026A Metamorphic Testing Approach to Diagnosing Memorization in LLM-Based Program Repair23 Apr 2026
- 2026LogicEval: A Systematic Framework for Evaluating Automated Repair Techniques for Logical Vulnerabilities in Real-World Software14 Apr 2026
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysis12 Apr 2026
- 2026CCCE: A Continuous Code Calibration Engine for Autonomous Enterprise Codebase Maintenance via Knowledge Graph Traversal and Adaptive Decision Gating10 Apr 2026
- 2026Improving MPI Error Detection and Repair with Large Language Models and Bug References2 Apr 2026
- 2026On the Impact of Code Comments for Automated Bug-Fixing: An Empirical Study30 Jan 2026
- 2026Towards Comprehensive Benchmarking Infrastructure for LLMs In Software Engineering28 Jan 2026
- 2026Principled Fine-tuning of LLMs from User-Edits: A Medley of Preference, Supervision, and Reward27 Jan 2026
- 2026From Completion to Editing: Unlocking Context-Aware Code Infilling via Search-and-Replace Instruction Tuning19 Jan 2026
- 2025DynaFix: Iterative Automated Program Repair Driven by Execution-Level Dynamic Information31 Dec 2025
- 2025Assessing the Software Security Comprehension of Large Language Models24 Dec 2025
- 2025LLM Agents for Automated Dependency Upgrades3 Oct 2025
- 2025Red Teaming Program Repair Agents: When Correct Patches can Hide Vulnerabilities30 Sep 2025
- 2025On the Soundness and Consistency of LLM Agents for Executing Test Cases Written in Natural Language23 Sep 2025
- 2025Call Me Maybe: Enhancing JavaScript Call Graph Construction using Graph Neural Networks22 Jun 2025
- 2025Dissecting the SWE-Bench Leaderboards: Profiling Submitters and Architectures of LLM- and Agent-Based Repair Systems20 Jun 2025
- 2025A Multi-Dataset Evaluation of Models for Automated Vulnerability Repair5 Jun 2025
- 2025Gradient-Based Program Repair: Fixing Bugs in Continuous Program Spaces23 May 2025
- 2025Self-Bootstrapping Automated Program Repair: Using LLMs to Generate and Evaluate Synthetic Training Data for Bug Repair12 May 2025
- 2025Towards an Understanding of Context Utilization in Code Intelligence11 Apr 2025
- 2025Mapping the Trust Terrain: LLMs in Software Engineering -- Insights and Perspectives18 Mar 2025
- 2025Beyond Final Code: A Process-Oriented Error Analysis of Software Development Agents in Real-World GitHub Scenarios16 Mar 2025
- 2025PredicateFix: Repairing Static Analysis Alerts with Bridging Predicates15 Mar 2025
- 2025UniGenCoder: Merging Seq2Seq and Seq2Tree Paradigms for Unified Code Generation18 Feb 2025
- 2025SURGE: On the Potential of Large Language Models as General-Purpose Surrogate Code Executors16 Feb 2025
- 2025AuPair: Golden Example Pairs for Code Repair12 Feb 2025
- 2025SnipGen: A Mining Repository Framework for Evaluating LLMs for Code10 Feb 2025
- 2025Treefix: Enabling Execution with a Tree of Prefixes21 Jan 2025
- 2024Integrating Various Software Artifacts for Better LLM-based Bug Localization and Program Repair5 Dec 2024
- 2024Memory-Efficient Large Language Models for Program Repair with Semantic-Guided Patch Generation22 Oct 2024
- 2024PromSec: Prompt Optimization for Secure Generation of Functional Source Code with Large Language Models (LLMs)19 Sep 2024
- 2024Can GPT-O1 Kill All Bugs? An Evaluation of GPT-Family LLMs on QuixBugs16 Sep 2024
- 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep 2024
- 2024MergeRepair: An Exploratory Study on Merging Task-Specific Adapters in Code LLMs for Automated Program Repair18 Aug 2024
- 2024Can LLMs Replace Manual Annotation of Software Engineering Artifacts?10 Aug 2024
- 2024Towards More Trustworthy and Interpretable LLMs for Code through Syntax-Grounded Explanations12 Jul 2024
- 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul 2024
- 2024NARRepair: Non-Autoregressive Code Generation Model for Automatic Program Repair24 Jun 2024
50 newest of 144 All 144 (JSON)
- 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
- 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repaircited by 225
- 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 173
- 2024Aligning LLM Agents by Learning Latent Preference from User Editscited by 66
- 2025Beyond Final Code: A Process-Oriented Error Analysis of Software Development Agents in Real-World GitHub Scenarioscited by 14
- 2025Dissecting the SWE-Bench Leaderboards: Profiling Submitters and Architectures of LLM- and Agent-Based Repair Systemscited by 8
- 2025Red Teaming Program Repair Agents: When Correct Patches can Hide Vulnerabilitiescited by 4
- 2026EviACT: An Evidence-to-Action Framework for Agentic Program Repaircited by 3
- 2025LLM Agents for Automated Dependency Upgradescited by 1
- 2026RAVEN: Agentic RAG for Automated Vulnerability Repaircited by 1
- 2026Multi-Perspective Agentic Program Repair via Code Property Graphs and Temporal Execution Graphscited by 1
- 2025On the Soundness and Consistency of LLM Agents for Executing Test Cases Written in Natural Languagecited by 0
12 most cited of 14 All 14 (JSON)
- 2026Multi-Perspective Agentic Program Repair via Code Property Graphs and Temporal Execution Graphs14 Jul 2026
- 2026RAVEN: Agentic RAG for Automated Vulnerability Repair21 Jun 2026
- 2026Exploration Structure in LLM Agents for Multi-File Change Localization10 Jun 2026
- 2026EviACT: An Evidence-to-Action Framework for Agentic Program Repair26 May 2026
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysis12 Apr 2026
- 2025LLM Agents for Automated Dependency Upgrades3 Oct 2025
- 2025Red Teaming Program Repair Agents: When Correct Patches can Hide Vulnerabilities30 Sep 2025
- 2025On the Soundness and Consistency of LLM Agents for Executing Test Cases Written in Natural Language23 Sep 2025
- 2025Dissecting the SWE-Bench Leaderboards: Profiling Submitters and Architectures of LLM- and Agent-Based Repair Systems20 Jun 2025
- 2025Beyond Final Code: A Process-Oriented Error Analysis of Software Development Agents in Real-World GitHub Scenarios16 Mar 2025
- 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep 2024
- 2024Agentless: Demystifying LLM-based Software Engineering Agents1 Jul 2024
12 newest of 14 All 14 (JSON)
- 2024NExT: Teaching Large Language Models to Reason about Code Executioncited by 60
- 2023Better patching using LLM prompting, via Self-Consistencycited by 29
- 2025AuPair: Golden Example Pairs for Code Repaircited by 3
- 2026Signal Reshaping for GRPO in Weak-Feedback Agentic Code Repaircited by 0
- 2026Signal Reshaping for GRPO in Weak-Feedback Agentic Code Repair8 May 2026
- 2025AuPair: Golden Example Pairs for Code Repair12 Feb 2025
- 2024NExT: Teaching Large Language Models to Reason about Code Execution23 Apr 2024
- 2023Better patching using LLM prompting, via Self-Consistency31 May 2023
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
- 2021Unified Pre-training for Program Understanding and Generationcited by 361
- 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 230
- 2021CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Taskscited by 199
- 2023Is Self-Repair a Silver Bullet for Code Generation?cited by 191
- 2023Keep the Conversation Going: Fixing 162 out of 337 bugs for 0.42 each using ChatGPTcited by 125
- 2023Baldur: Whole-Proof Generation and Repair with Large Language Modelscited by 118
- 2023RLTF: Reinforcement Learning from Unit Test Feedbackcited by 110
- 2021Examining Zero-Shot Vulnerability Repair with Large Language Modelscited by 105
- 2023Execution-based Code Generation using Deep Reinforcement Learningcited by 95
- 2021CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Softwarecited by 89
12 most cited of 120 All 120 (JSON)
- 2026SPHERE: Adaptive VR Indoor Scene Generation via LLM-Enhanced Spatial Preference Learning and Human-in-the-Loop RL1 Oct 2026
- 2026RepairFormer: Automated Repair of Structured Inputs Using Transformers5 Aug 2026
- 2026The Order Is the Guarantee: Verifier-Budgeted Code Deletion with Static-First Learned Proposals5 Aug 2026
- 2026AssumptionMiner: Extracting, Tracing, and Revising Implicit Assumptions in LLM Code Generation24 Jul 2026
- 2026Diff-Based Code Corruption using LLMs for Large-Scale Bugfix Benchmarking27 Jun 2026
- 2026NeuroNL2LTL: A Neurosymbolic Framework for Natural Language Translation of Linear Temporal Logic20 May 2026
- 2026A Metamorphic Testing Approach to Diagnosing Memorization in LLM-Based Program Repair23 Apr 2026
- 2026LogicEval: A Systematic Framework for Evaluating Automated Repair Techniques for Logical Vulnerabilities in Real-World Software14 Apr 2026
- 2026CCCE: A Continuous Code Calibration Engine for Autonomous Enterprise Codebase Maintenance via Knowledge Graph Traversal and Adaptive Decision Gating10 Apr 2026
- 2026Improving MPI Error Detection and Repair with Large Language Models and Bug References2 Apr 2026
- 2026On the Impact of Code Comments for Automated Bug-Fixing: An Empirical Study30 Jan 2026
- 2026Towards Comprehensive Benchmarking Infrastructure for LLMs In Software Engineering28 Jan 2026
12 newest of 120 All 120 (JSON)