VISTA: Mitigating Semantic Inertia in Video-LLMs via Training-Free Dynamic Chain-of-Thought Routing
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent advancements in Large Language Models have successfully transitioned towards System 2 reasoning, yet applying these paradigms to video understanding remains challenging. While prevailing research attributes failures in Video-LLMs to perceptual limitations, our empirical analysis reveals a cognitive misalignment termed Semantic Inertia, where models suppress valid visual evidence in favor of dominant language priors. To rectify this, we propose VISTA, a training-free framework designed to align perception with logical deduction. By dynamically routing inference paths and materializing implicit visual features into explicit textual anchors, our approach effectively counterbalances the influence of parametric knowledge. Furthermore, we incorporate a Latent Reasoning Consensus mechanism to mitigate stochastic hallucinations. VISTA showed outstanding results on a wide range of benchmarks, and outperforms its base model by 9.3% on Egochema and 5.6% on VideoEspresso, rivalling or even surpassing larger and proprietary models. Our codebase will be publicly available soon.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 20 of its 45 references that are in the map. First posted on arXiv 17 May 2025.
Builds on
20 of 45 references.
Closest ancestors · 5
Same direction, newest first
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024CoCoT: Contrastive Chain-of-Thought Prompting for Large Multimodal Models with Multiple Image Inputs5 Jan
Other references · 15
- 2023GPT-4 Technical Reportcited by 18,396
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024GPT-4o System Cardcited by 4,588
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2024OpenAI o1 System Cardcited by 1,244
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2024Long Context Transfer from Language to Visioncited by 515
- 2025LIMO: Less is More for Reasoningcited by 498
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
3 more
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
- 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
- 2024TS-LLaVA: Constructing Visual Tokens through Thumbnail-and-Sampling for Training-Free Video Large Language Modelscited by 9
Built on by
Citing papers per year: 2025: 1; 2026: 6.
7 papers.
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Modelscited by 8
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 4
- 2026AVIS: Adaptive Test-Time Scaling for Vision-Language Modelscited by 4
- 2026ZeroSplat: Generalized Referring Segmentation in 3D Gaussian Splattingcited by 3
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialoguecited by 2
- 2026VTI-CoT: Visual-Textual Interleaved Chain of Thought for Video Reasoningcited by 1
- 2026Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoningcited by 0
- 2026ZeroSplat: Generalized Referring Segmentation in 3D Gaussian Splatting21 Jul 2026
- 2026AVIS: Adaptive Test-Time Scaling for Vision-Language Models10 Jun 2026
- 2026Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoning6 Jun 2026
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun 2026
- 2026VTI-CoT: Visual-Textual Interleaved Chain of Thought for Video Reasoning4 Jun 2026
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialogue19 May 2026
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Models6 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Analyzing Reasoning Consistency in Large Multimodal Models under Cross-Modal Conflicts
- 2026From Priors to Perception: Grounding Video-LLMs in Physical Reality
- 2026V-CORE: Temporally Consistent Video Understanding for Video-LLM
- 2026Before It Fades: Reinforcing Temporal Representations at Inference Time in VideoLLMs
- 2025When Thinking Drifts: Evidential Grounding for Robust Video Reasoning
- 2026TempCloze: Can Video-LLMs Identify the Missing Middle?
- 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning
- 2026Video-Oasis: Rethinking Evaluation of Video Understanding