Does This Action Still Explain the Task? Reverse Scoring for Diffusion Language Model Agents
On the map: Diffusion models → Discrete and text diffusion
also in 2 more
Abstract (arXiv)
Diffusion-based large language models (dLLMs) promise to break the sequential latency bottleneck of autoregressive agents through parallel decoding, but recent evaluations show this efficiency does not transfer to embodied agentic competence: dLLM-backed agents repeatedly fall into retry loops, re-issuing an action long after it has failed. We give a mechanistic account of this failure and a training-free remedy. We trace the retry loop to the adaptivity of masked decoding: the sampler commits the positions it is most confident about and defers the uncertain ones, and at a failure state the context already offers a confident fill for the deferred decision, i.e. the failed action itself, so the retry is committed without the failure feedback ever being confronted. We model the resulting distortion of the action distribution as a task-blind corruption: contextually salient actions (e.g., the action just taken) receive inflated probability by a factor that depends on the state and the action but not on the task. Under this model, we analyse an invariance proposition: the task-blind factor cancels exactly from the reverse conditional, i.e. the likelihood of the task given the state and a candidate action, which coincides with the task posterior of an idealized uncorrupted model. Masked dLLMs evaluate the reverse conditional natively, unlike autoregressive models, by masking the task tokens and denoising, at the cost of a few parallel passes per candidate. We instantiate the rule as Reflect Reverse and evaluate it on four multi-turn embodied benchmarks, where it improves task success and progression rates over forward-scoring baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Discrete and text diffusion, one of 14 directions in Diffusion models. Builds on 33 of its 36 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
33 of 36 references.
Closest ancestors · 11
Same direction, newest first
- 2026Improved Large Language Diffusion Models24 Jun
- 2026The Flexibility Trap: Rethinking the Value of Arbitrary Order in Diffusion Language Models21 Jan
- 2026The Bitter Lesson of Diffusion Language Models for Agentic Workflows: A Comprehensive Reality Check19 Jan
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models12 Mar
- 2025Large Language Diffusion Models14 Feb
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Models23 Oct
- 2024Simple and Effective Masked Diffusion Language Models11 Jun
- 2024Simplified and Generalized Masked Diffusion for Discrete Data6 Jun
- 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data6 Jun
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution25 Oct
- 2023Likelihood-Based Diffusion Language Models30 May
Other references · 22
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Let's Verify Step by Stepcited by 3,789
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2025Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decodingcited by 420
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 339
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
- 2021Surface Form Competition: Why the Highest Probability Answer Isn't Always Rightcited by 263
10 more
- 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 244
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 187
- 2019Interactive Fiction Games: A Colossal Adventurecited by 168
- 2024Simple Guidance Mechanisms for Discrete Diffusion Modelscited by 155
- 2026Scalable Power Sampling: Unlocking Efficient, Training-Free Reasoning for LLMs via Distribution Sharpeningcited by 31
- 2023Pangu-Agent: A Fine-Tunable Generalist Agent with Structured Reasoningcited by 30
- 2026LangForce: Bayesian Decomposition of Vision Language Action Models via Latent Action Queriescited by 27
- 2025On Almost Surely Safe Alignment of Large Language Models at Inference-Timecited by 14
- 2024Mitigating Hallucination in Abstractive Summarization with Domain-Conditional Mutual Informationcited by 6
- 2026The Model Knows, the Decoder Finds: Future Value Guided Particle Power Samplingcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DLLM Agent: See Farther, Run Faster
- 2026A Theoretical Analysis of Why Masked Diffusion Models Mitigate the Reversal Curse
- 2026Skill Reuse as Compression in Agentic RL
- 2026Before They Can Solve: Predicting Post-Training Coding-Agent Performance from Base Models
- 2026The Long-Horizon Task Mirage? Diagnosing Where and Why Agentic Systems Break
- 2026ReLiveGym: Evaluating Long-Lived Agents over Weeks of Replayed Reality
- 2025Beyond Surface Reasoning: Unveiling the True Long Chain-of-Thought Capacity of Diffusion Large Language Models
- 2025Do Large Language Models Know What They Are Capable Of?