mlsanityData to 14 Oct 2026

Multi-Turn Reflective Masking Elicits Reasoning in Mask Diffusion Models

arXiv 2606.16700 ↗First posted 15 Jun 2026cs.CLcited by 0

On the map: LLM reasoning → Diffusion reasoning and test-time scaling

also in 1 more
Abstract (arXiv)

While reasoning on autoregressive (AR) models is often performed by chain-of-thought reasoning and reflection, their refinement of previous outputs still relies on fully sequential generation, even when only local edits are needed. In contrast, the masking mechanism in Mask Diffusion Models (MDMs) naturally supports explicit local edits on previous outputs, allowing selective refinement without discarding previous answers and generating another from scratch. While this property more closely aligns with how humans correct mistakes by iterative local refinement, existing MDMs do not support multi-turn masking and denoising. We propose Reflective Masking (RM), which elicits such an intrinsic reasoning capability in MDMs via lightweight post-training. RM provides a native test-time scaling, where an MDM iteratively revisits and revises its prior outputs based on evolving context. To exploit insights from previous turns like AR reasoning, we further introduce History Reference, a parameter-free mechanism that leverages intermediate denoising states during revision. Our approach requires no architectural changes and is easily applicable to existing MDMs. Across diverse tasks and modalities, including text generation, Sudoku, and image editing, Reflective Masking consistently outperforms standard masking-based baselines and demonstrates strong generality, positioning RM as a fundamental primitive for reasoning on MDMs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 23 of its 51 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

23 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Remasking Discrete Diffusion Models with Inference-Time Scaling1 Mar

Other references · 22

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  3. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  4. 2021Program Synthesis with Large Language Modelscited by 3,637
  5. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  6. 2025Large Language Diffusion Modelscited by 912
  7. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
  8. 2025Dream 7B: Diffusion Large Language Modelscited by 544
  9. 2019Neural Text Generation with Unlikelihood Trainingcited by 503
  10. 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
  11. 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 409
  12. 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 274
10 more
  1. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  2. 2025DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generationcited by 187
  3. 2025Seed Diffusion: A Large-Scale Diffusion Language Model with High-Speed Inferencecited by 178
  4. 2025LLaDA2.0: Scaling Up Diffusion Language Models to 100Bcited by 166
  5. 2025SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generationcited by 129
  6. 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 88
  7. 2025Dream-Coder 7B: An Open Diffusion Language Model for Codecited by 81
  8. 2025Generalized Interpolating Discrete Diffusioncited by 70
  9. 2025Don't Settle Too Early: Self-Reflective Remasking for Diffusion Language Modelscited by 37
  10. 2026dLLM: Simple Diffusion Language Modelingcited by 14

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learn from Your Mistakes: Self-Correcting Masked Diffusion Models
  2. 2025Bringing Stability to Diffusion: Decomposing and Reducing Variance of Training Masked Diffusion Models
  3. 2026A Theoretical Analysis of Why Masked Diffusion Models Mitigate the Reversal Curse
  4. 2026The Confidence Shortcut: A Reasoning Failure Mode of Masked Diffusion Models
  5. 2026TimeROME-DLM: Temporal Causal Tracing and Low-Rank Inference-Time Knowledge Editing for Masked Diffusion Language Models
  6. 2025Fine-Tuning Masked Diffusion for Provable Self-Correction
  7. 2025Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusions
  8. 2026Pivot-SD: Efficient Self-Distillation for Masked Diffusion Language Models