ST-Veto: Spatio-Temporal Token Veto for Diffusion MLLMs via Taylor Prediction and Visual Grounding
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Vision Language Models (VLMs) achieve strong reasoning with Chain-of-Thought (CoT) prompting but incur high sequential-generation cost, error accumulation, and limited self-correction. Diffusion Multimodal Large Language Models (dMLLMs) unmask tokens in an order-agnostic process, improving efficiency and enabling iterative refinement, yet their reasoning and how to enhance it remain underexplored. We propose a training-free method, Spatio-Temporal Token Veto (ST-Veto), which leverages the ability to observe all token positions at each diffusion step. Rather than relying only on current-step confidence, ST-Veto vetoes temporally unstable tokens via second-order Taylor prediction of confidence dynamics and filters weakly grounded tokens using image-attention mass, swapping them with safer candidates. Across multiple dMLLMs and multimodal reasoning benchmarks, ST-Veto consistently outperforms standard decoding policies and prior VLM reasoning methods, improving accuracy by up to 9% with no additional training or generation cost. Analyses show that ST-Veto steers generation toward higher-confidence, better-grounded paths.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 36 of its 41 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
36 of 41 references.
Closest ancestors · 8
Same direction, newest first
- 2026Thinking Diffusion: Penalize and Guide Visual-Grounded Reasoning in Diffusion Multimodal Language Models7 Apr
- 2024Interleaved-Modal Chain-of-Thought29 Nov
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought26 May
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Models27 Nov
- 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
- 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep
Other references · 28
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
16 more
- 2025Large Language Diffusion Modelscited by 912
- 2024Simple and Effective Masked Diffusion Language Modelscited by 848
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
- 2025Dream 7B: Diffusion Large Language Modelscited by 544
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2023OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocationcited by 478
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
- 2023Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategiescited by 238
- 2024Multi-Modal Hallucination Control by Visual Information Groundingcited by 208
- 2024Devils in Middle Layers of Large Vision-Language Models: Interpreting, Detecting and Mitigating Object Hallucinations via Attention Lenscited by 143
- 2025The Diffusion Dualitycited by 135
- 2025See What You Are Told: Visual Attention Sink in Large Multimodal Modelscited by 132
- 2024Scaffolding Coordinates to Promote Vision-Language Coordination in Large Multi-Modal Modelscited by 57
- 2024Seeing Clearly by Layer Two: Enhancing Attention Heads to Alleviate Hallucination in LVLMscited by 52
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025RedVTP: Training-Free Acceleration of Diffusion Vision-Language Models Inference via Masked Token-Guided Visual Token Pruning
- 2025D3ToM: Decider-Guided Dynamic Token Merging for Accelerating Diffusion MLLMs
- 2026VETO: Video Efficient Token Optimization for Vision Language Models
- 2025LaViDa: A Large Diffusion Language Model for Multimodal Understanding
- 2025Generative Multimodal Pretraining with Discrete Diffusion Timestep Tokens
- 2026Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models
- 2025I Think, Therefore I Diffuse: Enabling Multimodal In-Context Reasoning in Diffusion Models
- 2024Boosting Multimodal Large Language Models with Visual Tokens Withdrawal for Rapid Inference