Reversible Diffusion Decoding for Diffusion Language Models
On the map: Diffusion models → Discrete and text diffusion
Abstract (arXiv)
Diffusion language models enable parallel token generation through block-wise decoding, but their irreversible commitments can lead to stagnation, where the reverse diffusion process fails to make further progress under a suboptimal context.We propose Reversible Diffusion Decoding (RDD), a decoding framework that introduces reversibility into block-wise diffusion generation. RDD detects stagnation as a state-dependent failure of the reverse process and enables efficient backtracking to earlier blocks without recomputation via cached model states. To avoid repeated failure trajectories, RDD applies confidence-guided re-masking to selectively reinitialize uncertain tokens while preserving reliable context.This reversible formulation allows decoding to recover from early commitment errors while maintaining the parallel efficiency of diffusion-based generation. Experiments show that RDD improves generation robustness and quality over baselines with minimal computational overhead.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 20 of its 21 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
20 of 21 references.
Closest ancestors · 8
Same direction, newest first
- 2025Saber: An Efficient Sampling with Adaptive Acceleration and Backtracking Enhanced Remasking for Diffusion Language Model20 Oct
- 2025Don't Settle Too Early: Self-Reflective Remasking for Diffusion Language Models28 Sep
- 2025Dream 7B: Diffusion Large Language Models21 Aug
- 2025Diffusion LLMs Can Do Faster-Than-AR Inference via Discrete Diffusion Forcing8 Aug
- 2025Accelerated Sampling from Masked Diffusion Models via Entropy Bounded Unmasking30 May
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models12 Mar
- 2025Remasking Discrete Diffusion Models with Inference-Time Scaling1 Mar
- 2025Large Language Diffusion Models14 Feb
Other references · 12
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 404
- 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 399
- 2025dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Cachingcited by 168
- 2025Accelerating Diffusion LLMs via Adaptive Parallel Decodingcited by 108
- 2019Non-Monotonic Sequential Text Generationcited by 55
- 2025Self Speculative Decoding for Diffusion Large Language Modelscited by 29
- 2025d2Cache: Accelerating Diffusion-Based LLMs via Dual Adaptive Cachingcited by 24
- 2025Review, Remask, Refine (R3): Process-Guided Block Diffusion for Text Generationcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Deferred Commitment Decoding for Diffusion Language Models
- 2026Rethinking the Generation Order of Block Diffusion Language Models
- 2026Mean-Field Parallel Decoding for Discrete Diffusion Language Models
- 2026Stop the Flip-Flop: Context-Preserving Verification for Fast Revocable Diffusion Decoding
- 2026AsyncLane: Decoupling Refinement from Advancement in Diffusion Language Model Decoding
- 2026Roll Out and Roll Back: Diffusion LLMs are Their Own Efficiency Teachers
- 2025Beyond Confidence: Adaptive and Coherent Decoding for Diffusion Language Models
- 2026Reliable Parallel Decoding in Masked Diffusion Language Models