Next Edit Prediction: Learning to Predict Code Edits from Context and Interaction History
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of large language models (LLMs) has led to the widespread adoption of AI-powered coding assistants integrated into a development environment. On one hand, low-latency code completion offers completion suggestions but is fundamentally constrained to the cursor's current position. On the other hand, chat-based editing can perform complex modifications, yet forces developers to stop their work, describe the intent in natural language, which causes a context-switch away from the code. This creates a suboptimal user experience, as neither paradigm proactively predicts the developer's next edit in a sequence of related edits. To bridge this gap and provide the seamless code edit suggestion, we introduce the task of Next Edit Prediction, a novel task designed to infer developer intent from recent interaction history to predict both the location and content of the subsequent edit. Specifically, we curate a high-quality supervised fine-tuning dataset and an evaluation benchmark for the Next Edit Prediction task. Then, we conduct supervised fine-tuning on a series of models and performed a comprehensive evaluation of both the fine-tuned models and other baseline models, yielding several novel findings. This work lays the foundation for a new interaction paradigm that proactively collaborate with developers by anticipating their following action, rather than merely reacting to explicit instructions. The code is available at https://github.com/lurf21/NextEditPrediction.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 40 references that are in the map. First posted on arXiv 13 Aug 2025.
Builds on
26 of 40 references.
References · 26
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Code Llama: Open Foundation Models for Codecited by 2,105
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 876
- 2023StarCoder: may the source be with you!cited by 790
- 2022A Survey on In-context Learningcited by 717
- 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
14 more
- 2024StarCoder 2 and The Stack v2: The Next Generationcited by 484
- 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 357
- 2023RepoBench: Benchmarking Repository-Level Code Auto-Completion Systemscited by 346
- 2022Efficient Training of Language Models to Fill in the Middlecited by 248
- 2024CodeGemma: Open Code Models Based on Gemmacited by 145
- 2023CodeGen2: Lessons for Training LLMs on Programming and Natural Languagescited by 124
- 2023Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructionscited by 46
- 2022CoditT5: Pretraining for Source Code and Natural Language Editingcited by 45
- 2018CODIT: Code Editing with Tree-Based Neural Modelscited by 40
- 2024Language Models for Code Completion: A Practical Evaluationcited by 38
- 2021On Multi-Modal Learning of Editing Source Codecited by 25
- 2023Your Code Secret Belongs to Me: Neural Code Completion Tools Can Memorize Hard-Coded Credentialscited by 17
- 2025Repetitions are not all alike: distinct mechanisms sustain repetition in language modelscited by 9
- 2023Automated Code Editing with Search-Generate-Modifycited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.