Distilled Continuous Diffusion Language Models Can Write Code in Few Steps---or One
On the map: Diffusion models → Discrete and text diffusion
Abstract (arXiv)
Language generation is almost universally treated as a sequential process: autoregressive models emit one token at a time, while diffusion language models replace token-level seriality with a long trajectory of iterative refinement. In this work, we introduce PlaidQ, a 0.7B continuous diffusion language model for code generation, and show that its trajectory can be aggressively distilled into only a few denoising steps---or even one, enabling efficient code generation. PlaidQ repurposes a pretrained autoregressive model as a bidirectional denoiser over continuous token embeddings. We distill PlaidQ with distribution matching for few-step generation and paired-trajectory supervision for one-step generation. At matched model scale, PlaidQ is competitive with discrete diffusion language models on code generation. Distillation then shifts the quality--compute frontier: a 16-step student reaches 31.78 and 40.49 pass@10 on HumanEval and MBPP+, surpassing the same PlaidQ teacher sampled for 512 steps. At the extreme, paired-trajectory distillation achieves 7.07 pass@1 on HumanEval with a single denoising step, producing functionally correct programs. Together, these results establish continuous diffusion as a viable path to few-step and one-step code generation. Broadly, continuous diffusion is not merely another representation for language: it provides an interface through which language models can inherit the acceleration and distillation machinery of continuous diffusion modeling. Training and inference code and model checkpoints are available at https://github.com/pengzhangzhi/plaidq.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 79 of its 83 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
79 of 83 references.
Closest ancestors · 42
Same direction, newest first
- 2026OPTD: On-Policy Transition Distillation with Consistency-Guided Adaptive Compression for Few-Step Diffusion Language Models3 Aug
- 2026AURORA-LM: Autoencoding Unified Representation for Continuous-Latent Diffusion Language Modeling3 Aug
- 2026Low Perplexity is Repetition: A One-Dimensional Self-Conditioning Attractor in Continuous Diffusion LMs1 Jul
- 2026Diffusion Language Models: An Experimental Analysis17 Jun
- 2026DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling22 May
- 2026Continuous Diffusion Scales Competitively with Discrete Diffusion for Language18 May
- 2026Language Modeling with Hyperspherical Flows11 May
- 2026ELF: Embedded Language Flows11 May
- 2026Scaling Categorical Flow Maps8 May
- 2026CoBit: Language Modeling with Bitstream Diffusion7 May
- 2026Don't Retrain, Align: Adapting Autoregressive LMs to Diffusion LMs via Representation Alignment7 May
- 2026Continuous Latent Diffusion Language Model7 May
30 more
- 2026LangFlow: Continuous Diffusion Rivals Discrete in Language Modeling13 Apr
- 2026CoDAR: Continuous Diffusion Language Models are More Powerful Than You Think3 Mar
- 2026CRoCoDiL: Continuous and Robust Conditioned Diffusion for Language2 Mar
- 2026Flow Map Language Models: One-step Language Modeling via Continuous Denoising18 Feb
- 2026LaDi-RL: Latent Diffusion Reasoning Prevents Entropy Collapse in Reinforcement Learning2 Feb
- 2026DreamOn: Diffusion Language Models For Code Infilling Beyond Fixed-size Canvas1 Feb
- 2026CD4LM: Consistency Distillation and aDaptive Decoding for Diffusion Language Models5 Jan
- 2025Corrective Diffusion Language Models17 Dec
- 2025LaDiR: Latent Diffusion Enhances LLMs for Text Reasoning6 Oct
- 2025Continuously Augmented Discrete Diffusion model for Categorical Generative Modeling1 Oct
- 2025Ultra-Fast Language Generation via Discrete Diffusion Divergence Instruct29 Sep
- 2025Planner Aware Path Learning in Diffusion Language Models Training27 Sep
- 2025Dream-Coder 7B: An Open Diffusion Language Model for Code1 Sep
- 2025Dream 7B: Diffusion Large Language Models21 Aug
- 2025DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generation25 Jun
- 2025DLM-One: Diffusion Language Models for One-Step Sequence Generation30 May
- 2025dKV-Cache: The Cache for Diffusion Language Models21 May
- 2025Remasking Discrete Diffusion Models with Inference-Time Scaling1 Mar
- 2025Continuous Diffusion Model for Language Modeling17 Feb
- 2025Large Language Diffusion Models14 Feb
- 2025Path Planning for Masked Diffusion Model Sampling5 Feb
- 2024Beyond Autoregression: Fast LLMs via Self-Distillation Through Time28 Oct
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Models23 Oct
- 2024Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Sampling4 Sep
- 2024Simple and Effective Masked Diffusion Language Models11 Jun
- 2024Simplified and Generalized Masked Diffusion for Discrete Data6 Jun
- 2023CodeFusion: A Pre-trained Diffusion Model for Code Generation26 Oct
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution25 Oct
- 2023Likelihood-Based Diffusion Language Models30 May
- 2022Continuous diffusion for categorical data28 Nov
Other references · 37
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
- 2023Consistency Modelscited by 1,778
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
25 more
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2017Non-Autoregressive Neural Machine Translationcited by 457
- 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 404
- 2025Muon is Scalable for LLM Trainingcited by 381
- 2024Discrete Flow Matchingcited by 301
- 2018Online normalizer calculation for softmaxcited by 154
- 2025How to build a consistency model: Learning flow maps via self-distillationcited by 96
- 2025NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Modelcited by 94
- 2025Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistencycited by 81
- 2025Edit Flows: Flow Matching with Edit Operationscited by 53
- 2024Cut Your Losses in Large-Vocabulary Language Modelscited by 35
- 2026Transition Matching Distillation for Fast Video Generationcited by 27
- 2026Discrete Flow Mapscited by 23
- 2025Exploring the Potential of Diffusion Large Language Models in Code Generationcited by 16
- 2026Self-conditioned Flow Map Language Models via Fixed-point Flowscited by 9
- 2025Flexible Language Modeling in Continuous Space with Transformer-based Autoregressive Flowscited by 8
- 2026Posterior Refinement: Fast Language Generation via Any-Order Flow Mapscited by 8
- 2026Parallel Decoding Distillation for Fast Image and Video Generationcited by 7
- 2026Spherical Flows for Sampling Categorical Datacited by 4
- 2026Latent Reasoning with Normalizing Flowscited by 4
- 2026Coupling Models for One-Step Discrete Generationcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Reasoning with Continuous Latent Diffusion28 Sep 2026
- 2026ELF-REG: Scaling Continuous Diffusion Language Models to Reasoning Tasks24 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Constrained Code Generation with Discrete Diffusion
- 2026Hierarchical Continuous Diffusion Language Models
- 2026Continuous Diffusion Models Can Obey Formal Syntax
- 2025On Powerful Ways to Generate: Autoregression, Diffusion, and Beyond
- 2026AnCoder: Anchored Code Generation via Discrete Diffusion Models
- 2025Saber: An Efficient Sampling with Adaptive Acceleration and Backtracking Enhanced Remasking for Diffusion Language Model
- 2026Alpha Diffusion Language Models: Factorization Alone Is Not the Problem
- 2025FS-DFM: Fast and Accurate Long Text Generation with Few-Step Diffusion Language Models