mlsanityData to 14 Oct 2026

Intent-Triggered Anchoring for Multi-Token Format Units in Parallel Decoding of Diffusion Language Models

arXiv 2610.16516 ↗First posted 12 Oct 2026cs.CLcited by 0

On the map: Diffusion models → Discrete and text diffusion

also in 1 more
Abstract (arXiv)

In parallel decoding, diffusion language models commit several tokens per forward pass, so co-committed tokens cannot see each other, breaking multi-token format units that parsers need. On ECHO, an open-weight one-step chest X-ray (CXR) report generator, 32.7-36.7% of evaluation reports lack a parseable Impression heading and score as empty. We propose intent-triggered anchoring, a training-free decoding rule that completes a format unit once the model commits its first token, inserting only units with a unique, content-free completion; fallbacks write the unit when the model stops or loops without starting it. On three CXR evaluation sets, the rule raises readable rates from 63.3-67.3% to 100.0% with no regressions and a 95th-percentile latency ratio of 0.68-1.28 against official decoding. Broken headings state findings absent from the reference; adding the heading at the end leaves them in 15.5-31.0% of reports, our rule in at most 0.6%. For math answer markers, the rule raises accuracy in the most parallel setting of five diffusion language models by 5.8-20.8 points on GSM8K and 5.1-17.1 on GSM-Symbolic, held out from tuning. With lenient answer extraction, gains are 3.3-12.5 and 2.7-6.3 points; the rule adds 1.4-8.6 points over a stop-only fallback for four of the five models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 34 of its 48 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

34 of 48 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Parallelism and Generation Order in Masked Diffusion Language Models: Limits Today, Potential Tomorrow22 Jan
  2. 2025SDAR: A Synergistic Diffusion-AutoRegression Paradigm for Scalable Sequence Generation7 Oct
  3. 2025Remasking Discrete Diffusion Models with Inference-Time Scaling1 Mar
  4. 2025Theoretical Benefit and Limitation of Diffusion Language Model13 Feb
  5. 2024Simplified and Generalized Masked Diffusion for Discrete Data6 Jun

Other references · 29

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  4. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  5. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  6. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  7. 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 420
  8. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 337
  9. 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 237
  10. 2023Grammar-Constrained Decoding for Structured NLP Tasks without Finetuningcited by 197
  11. 2020NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraintscited by 149
  12. 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 148
17 more
  1. 2025Fast-dLLM v2: Efficient Block-Diffusion LLMcited by 139
  2. 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 128
  3. 2025Accelerating Diffusion LLMs via Adaptive Parallel Decodingcited by 112
  4. 2024CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formatscited by 106
  5. 2024Let Me Speak Freely? A Study on the Impact of Format Restrictions on Performance of Large Language Modelscited by 96
  6. 2025LaViDa: A Large Diffusion Language Model for Multimodal Understandingcited by 84
  7. 2025dParallel: Learnable Parallel Decoding for dLLMscited by 65
  8. 2025ParallelBench: Understanding the Trade-offs of Parallel Decoding in Diffusion LLMscited by 43
  9. 2025ReXGradient-160K: A Large-Scale Publicly Available Dataset of Chest Radiographs with Free-text Reportscited by 27
  10. 2025DINGO: Constrained Inference for Diffusion LLMscited by 16
  11. 2025Constrained Decoding of Diffusion LLMs with Context-Free Grammarscited by 14
  12. 2025LLaDA-MedV: Exploring Large Language Diffusion Models for Biomedical Image Understandingcited by 13
  13. 2025SDAR-VL: Stable and Efficient Block-wise Diffusion for Vision-Language Understandingcited by 13
  14. 2025Enabling Approximate Joint Sampling in Diffusion LMscited by 10
  15. 2026Lookahead-then-Verify: Reliable Constrained Decoding for Diffusion LLMs under Context-Free Grammarscited by 7
  16. 2026ECHO: Efficient Chest X-ray Report Generation with One-step Block Diffusioncited by 4
  17. 2026Discrete Diffusion Language Models for Interactive Radiology Report Draftingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Mean-Field Parallel Decoding for Discrete Diffusion Language Models
  2. 2026Why Diffusion Language Models Struggle with Truly Parallel (Non-Autoregressive) Decoding?
  3. 2026Locally Coherent Parallel Decoding in Diffusion Language Models
  4. 2026Supportive Token Revealing for Fast Diffusion Language Model Decoding
  5. 2026Set Diffusion: Interpolating Token Orderings Between Autoregression and Diffusion for Fast and Flexible Decoding
  6. 2026Deferred Commitment Decoding for Diffusion Language Models
  7. 2025From Bits to Rounds: Parallel Decoding with Exploration for Diffusion Language Models
  8. 2026EPIC: Efficient and Parallel Inference under CFG Constraints for Diffusion Language Models