mlsanityData to 7 Oct 2026

DRT: Dense Reasoning Trace for Efficient and Grounded Multimodal Reasoning

arXiv 2609.21675 ↗First posted 18 Sep 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Despite the remarkable progress in Multimodal Large Language Models (MLLMs), prevailing Chain-of-Thought (CoT) paradigms remain confined to the natural-language expression space. Consequently, they inherently incur excessive linguistic overhead, leading to information dilution and weak visual grounding. To address this challenge, we propose Dense Reasoning Trace (DRT), a paradigm that departs from natural-language-centered CoT by expressing reasoning as compact structured traces, which include concise intermediate states with symbolic connectors and disentangle visual observations from logical deductions. First, we introduce the Dense Trace Initialization to internalize the DRT reasoning mode into the model, substantially improving token efficiency while preserving visual evidence. To further enable the model to faithfully capture the logical relations within traces, we propose the Trace-Grounded Reinforcement Learning framework, which builds reference traces through a tri-perspective verification pipeline and employs Trace-Grounded GRPO with structured rewards, encouraging the model to generate concise DRT-style traces with reduced hallucination and stronger logical grounding. Extensive experiments on challenging reasoning benchmarks show that DRT achieves 5.5× token efficiency improvement while improving 1.3 accuracy points over the Qwen3-VL baseline. These findings suggest that complex multimodal reasoning may not require verbose natural-language traces, opening a more efficient path for next-generation MLLMs. Our code and data are available at: https://github.com/HIT-leaderone/DRT

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 17 of its 44 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

17 of 44 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Learning Adaptive Reasoning Paths for Efficient Visual Reasoning16 Apr
  2. 2026Chain-of-Thought Compression Should Not Be Blind: V-Skip for Efficient Multimodal Reasoning via Dual-Path Anchoring20 Jan
  3. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
  4. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul

Other references · 13

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  5. 2025Qwen3-VL Technical Reportcited by 2,534
  6. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  7. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
  8. 2025Chain of Draft: Thinking Faster by Writing Lesscited by 290
  9. 2025SelfBudgeter: Adaptive Token Allocation for Efficient LLM Reasoningcited by 47
  10. 2025Making Slow Thinking Faster: Compressing LLM Chain-of-Thought via Step Entropycited by 37
  11. 2025DRP: Distilled Reasoning Pruning with Skill-aware Step Decomposition for Efficient Large Reasoning Modelscited by 29
  12. 2025ThinkLess: A Training-Free Inference-Efficient Method for Reducing Reasoning Redundancycited by 17
1 more
  1. 2026On the Optimal Reasoning Length for RL-Trained Language Modelscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Point-RFT: Improving Multimodal Reasoning with Visually Grounded Reinforcement Finetuning
  2. 2026Credit Where It is Due: Cross-Modality Connectivity Drives Precise Reinforcement Learning for MLLM Reasoning
  3. 2026Rethinking Token-Level Policy Optimization for Multimodal Chain-of-Thought
  4. 2026See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs
  5. 2025GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking
  6. 2026DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
  7. 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
  8. 2025v1: Learning to Point Visual Tokens for Multimodal Grounded Reasoning