mlsanityData to 7 Oct 2026

PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Model

arXiv 2306.02531 ↗First posted 5 Jun 2023cs.CLcited by 56

On the map: Diffusion models → Discrete and text diffusion

Abstract (arXiv)

Autoregressive models for text sometimes generate repetitive and low-quality output because errors accumulate during the steps of generation. This issue is often attributed to exposure bias - the difference between how a model is trained, and how it is used during inference. Denoising diffusion models provide an alternative approach in which a model can revisit and revise its output. However, they can be computationally expensive and prior efforts on text have led to models that produce less fluent output compared to autoregressive models, especially for longer text and paragraphs. In this paper, we propose PLANNER, a model that combines latent semantic diffusion with autoregressive generation, to generate fluent text while exercising global control over paragraphs. The model achieves this by combining an autoregressive "decoding" module with a "planning" module that uses latent diffusion to generate semantic paragraph embeddings in a coarse-to-fine manner. The proposed method is evaluated on various conditional generation tasks, and results on semantic generation, text completion and summarization show its effectiveness in generating high-quality long-form text in an efficient manner.

Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 43 of its 48 references that are in the map. First posted on arXiv 5 Jun 2023.

Builds on

43 of 48 references.

Closest ancestors · 3

Same direction, newest first

  1. 2022Latent Diffusion for Language Generation19 Dec
  2. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models17 Oct
  3. 2021Autoregressive Diffusion Models5 Oct

Other references · 40

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  10. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  11. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  12. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
28 more
  1. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  2. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
  3. 2021Variational Diffusion Modelscited by 1,145
  4. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
  5. 2015Teaching Machines to Read and Comprehendcited by 1,039
  6. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
  7. 2016Deep Variational Information Bottleneckcited by 915
  8. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 779
  9. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
  10. 2015Generating Sentences from a Continuous Spacecited by 607
  11. 2019Neural Text Generation with Unlikelihood Trainingcited by 489
  12. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
  13. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
  14. 2023Simple diffusion: End-to-end diffusion for high resolution imagescited by 413
  15. 2016SeqGAN: Sequence Generative Adversarial Nets with Policy Gradientcited by 375
  16. 2022Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioningcited by 362
  17. 2016Deep Reinforcement Learning for Dialogue Generationcited by 286
  18. 2019Causal Confusion in Imitation Learningcited by 286
  19. 2017Toward Controlled Generation of Textcited by 271
  20. 2016Professor Forcing: A New Algorithm for Training Recurrent Networkscited by 214
  21. 2018Analyzing Uncertainty in Neural Machine Translationcited by 126
  22. 2018Generating Informative and Diverse Conversational Responses via Adversarial Information Maximizationcited by 114
  23. 2020Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Spacecited by 114
  24. 2022Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generationcited by 90
  25. 2022Subspace Diffusion Generative Modelscited by 70
  26. 2017Adversarial Feature Matching for Text Generationcited by 58
  27. 2022Exploring Discrete Diffusion Models for Image Captioningcited by 16
  28. 2018A Tutorial on Deep Latent Variable Models of Natural Languagecited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 13; 2025: 22; 2026: 19.

56 papers.

Sort:

By area:

  1. 2025Large Language Diffusion Modelscited by 872
  2. 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 268
  3. 2025DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generationcited by 184
  4. 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 145
  5. 2024Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planningcited by 135
  6. 2023BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrappingcited by 96
  7. 2024Large Concept Models: Language Modeling in a Sentence Representation Spacecited by 86
  8. 2025A Survey on Diffusion Language Modelscited by 75
  9. 2023Matryoshka Diffusion Modelscited by 70
  10. 2025Diffusion Models for Robotic Manipulation: A Surveycited by 39
  11. 2025Continuously Augmented Discrete Diffusion model for Categorical Generative Modelingcited by 32
  12. 2025TESS 2: A Large-Scale Generalist Diffusion Language Modelcited by 30
38 more
  1. 2026ELF: Embedded Language Flowscited by 27
  2. 2025LaDiR: Latent Diffusion Enhances LLMs for Text Reasoningcited by 25
  3. 2025Cosmos: Compressed and Smooth Latent Space for Text Diffusion Modelingcited by 24
  4. 2024TEncDM: Understanding the Properties of the Diffusion Model in the Space of Language Model Encodingscited by 22
  5. 2025DLM-One: Diffusion Language Models for One-Step Sequence Generationcited by 19
  6. 2025Latent Thinking Optimization: Your Latent Reasoning Language Model Secretly Encodes Reward Signals in Its Latent Thoughtscited by 18
  7. 2025Dream-VL & Dream-VLA: Open Vision-Language and Vision-Language-Action Models with Diffusion Language Model Backbonecited by 18
  8. 2024Diffusion Model for Planning: A Systematic Literature Reviewcited by 17
  9. 2024Diffusion Guided Language Modelingcited by 15
  10. 2024DiscDiff: Latent Diffusion Model for DNA Sequence Generationcited by 12
  11. 2024Diffusion on language model encodings for protein sequence generationcited by 11
  12. 2025Implicit Search via Discrete Diffusion: A Study on Chesscited by 11
  13. 2024Semformer: Transformer Language Models with Semantic Planningcited by 9
  14. 2026How to Train Your Latent Diffusion Language Model Jointly With the Latent Spacecited by 8
  15. 2024Many-to-many Image Generation with Auto-regressive Diffusion Modelscited by 6
  16. 2026Silence the Judge: Reinforcement Learning with Self-Verifier via Latent Geometric Clusteringcited by 6
  17. 2025DiffPO: Diffusion-styled Preference Optimization for Efficient Inference-Time Alignment of Large Language Modelscited by 5
  18. 2026DLLM Agent: See Farther, Run Fastercited by 5
  19. 2024Latent Diffusion Models for Controllable RNA Sequence Generationcited by 4
  20. 2024Segment-Level Diffusion: A Framework for Controllable Long-Form Generation with Diffusion Language Modelscited by 4
  21. 2025Language Models Are Implicitly Continuouscited by 4
  22. 2025Leveraging the Spatial Hierarchy: Coarse-to-fine Trajectory Generation via Cascaded Hybrid Diffusioncited by 4
  23. 2026Exposure Bias Can Alleviate Itself via Directional and Frequency Rectification in Flow Matchingcited by 4
  24. 2026Characterizing Memorization in Diffusion Language Models: Generalized Extraction and Sampling Effectscited by 3
  25. 2025Don't Let It Fade: Preserving Edits in Diffusion Language Models via Token Timestep Allocationcited by 2
  26. 2026RELATE: A Reinforcement Learning-Enhanced LLM Framework for Advertising Text Generationcited by 2
  27. 2026Stop-Think-AutoRegress: Language Modeling with Latent Diffusion Planningcited by 2
  28. 2026LFPO: Likelihood-Free Policy Optimization for Masked Diffusion Modelscited by 2
  29. 2026ConvergeFlow: Language Flow with Provable Convergence to Token Embeddingscited by 2
  30. 2025What Makes the Preferred Thinking Direction for LLMs in Multiple-choice Questions?cited by 1
  31. 2025Alternatives To Next Token Prediction In Text Generation -- A Surveycited by 1
  32. 2026Leveraging Pretrained Language Models as Energy Functions for Glauber Dynamics Text Diffusioncited by 1
  33. 2026Efficient Long-Context Modeling in Diffusion Language Models via Block Approximate Sparse Attentioncited by 1
  34. 2024Absorb & Escape: Overcoming Single Model Limitations in Generating Genomic Sequencescited by 0
  35. 2025Planning with Diffusion Models for Target-Oriented Dialogue Systemscited by 0
  36. 2025Explainability Through Systematicity: The Hard Systematicity Challenge for Artificial Intelligencecited by 0
  37. 2025ReflexFlow: Rethinking Learning Objective for Exposure Bias Alleviation in Flow Matchingcited by 0
  38. 2026DeALOG: Decentralized Multi-Agents Log-Mediated Reasoning Frameworkcited by 0

50 most cited of 56 All 56 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Diffusion Models for Non-autoregressive Text Generation: A Survey
  2. 2022DiffusER: Discrete Diffusion via Edit-based Reconstruction
  3. 2022Self-conditioned Embedding Diffusion for Text Generation
  4. 2023AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation
  5. 2022Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise
  6. 2023InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text Generation
  7. 2026Continuous Latent Diffusion Language Model
  8. 2023A Survey of Diffusion Models in Natural Language Processing