Diff Diffusion: Predicting Edit Paths with Diffusion Models for Efficient Code Editing
On the map: Diffusion models → Discrete and text diffusion
Abstract (arXiv)
Diffusion large language models (dLLMs) are appealing for code generation because they can update many tokens in parallel, yet many are optimized for sequence synthesis rather than edit prediction. This setting is poorly matched to modern AI-assisted IDEs, where edit prediction must infer the next code change from recent edits, the current file, and cursor-local context. Such changes are usually sparse and preserve most source tokens, so regenerating a full code segment wastes computation. We propose Diff Diffusion, a diffusion-inspired LLM framework for code editing that predicts edit paths from an original snippet to its revised form. Diff Diffusion represents denoising as structured edit operations, and combines this formulation with multi-stage training and efficient parallel decoding. By focusing computation on changed regions, Diff Diffusion supports accurate low-latency edits and multi-position parallel modification. Across public edit-completion benchmarks, edit-prediction evaluations, and online validation, Diff Diffusion matches or leads autoregressive baselines while delivering 2.78 times faster inference on public edit-completion benchmarks and a 39.0% P50 model-latency reduction in production. This work provides a new modeling perspective for AI applications that require high accuracy and low latency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 42 of its 50 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
42 of 50 references.
Closest ancestors · 21
Same direction, newest first
- 2026Improved Large Language Diffusion Models24 Jun
- 2026Edit-Based Refinement for Parallel Masked Diffusion Language Models10 May
- 2026Beyond Masks: Efficient, Flexible Diffusion Language Models via Deletion-Insertion Processes4 Mar
- 2026LFPO: Likelihood-Free Policy Optimization for Masked Diffusion Models2 Mar
- 2026LLaDA2.1: Speeding Up Text Diffusion via Token Editing9 Feb
- 2026DreamOn: Diffusion Language Models For Code Infilling Beyond Fixed-size Canvas1 Feb
- 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100B10 Dec
- 2025Diffusion Language Models are Super Data Learners5 Nov
- 2025dInfer: An Efficient Inference Framework for Diffusion Language Models9 Oct
- 2025Simple Policy Gradients for Reasoning with Diffusion Language Models5 Oct
- 2025LLaDA-MoE: A Sparse MoE Diffusion Language Model29 Sep
- 2025Revolutionizing Reinforcement Learning Framework for Diffusion Large Language Models8 Sep
9 more
- 2025Dream-Coder 7B: An Open Diffusion Language Model for Code1 Sep
- 2025Any-Order Flexible Length Masked Diffusion31 Aug
- 2025Dream 7B: Diffusion Large Language Models21 Aug
- 2025Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inference4 Aug
- 2025Diffusion Beats Autoregressive in Data-Constrained Settings21 Jul
- 2025DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generation25 Jun
- 2025LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs17 Jun
- 2025Flexible-length Text Infilling for Discrete Diffusion Models16 Jun
- 2025Large Language Diffusion Models14 Feb
Other references · 21
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 420
- 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 285
- 2025Mercury: Ultra-Fast Language Models Based on Diffusioncited by 235
- 2023OctoPack: Instruction Tuning Code Large Language Modelscited by 189
9 more
- 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 148
- 2025Edit Flows: Flow Matching with Edit Operationscited by 55
- 2025Seed-Coder: Let the Code Model Curate Data for Itselfcited by 49
- 2023Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructionscited by 48
- 2025Beyond Fixed: Training-Free Variable-Length Denoising for Diffusion Large Language Modelscited by 34
- 2024CodeEditorBench: Evaluating Code Editing Capability of Large Language Modelscited by 23
- 2024Let the Code LLM Edit Itself When You Edit the Codecited by 10
- 2024CursorCore: Assist Programming through Aligning Anythingcited by 7
- 2024AI-Assisted SQL Authoring at Industry Scalecited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026How Should Diffusion Language Models Edit Code?
- 2026Distilled Continuous Diffusion Language Models Can Write Code in Few Steps---or One
- 2026When Models Edit Too Much: On the Fidelity of Minimal Code Edits
- 2026Constrained Code Generation with Discrete Diffusion
- 2026DiffBench Meets DiffAgent: End-to-End LLM-Driven Diffusion Acceleration Code Generation
- 2026Beyond Block Boundaries: Multi-Block Editing for Diffusion Large Language Models
- 2023CodeFusion: A Pre-trained Diffusion Model for Code Generation
- 2026EditFlow: Benchmarking and Optimizing Code Edit Recommendation Systems via Reconstruction of Developer Flows