mlsanityData to 14 Oct 2026

VISTA: Mitigating Semantic Inertia in Video-LLMs via Training-Free Dynamic Chain-of-Thought Routing

arXiv 2505.11830 ↗First posted 17 May 2025cs.CV cs.AIcited by 7

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Recent advancements in Large Language Models have successfully transitioned towards System 2 reasoning, yet applying these paradigms to video understanding remains challenging. While prevailing research attributes failures in Video-LLMs to perceptual limitations, our empirical analysis reveals a cognitive misalignment termed Semantic Inertia, where models suppress valid visual evidence in favor of dominant language priors. To rectify this, we propose VISTA, a training-free framework designed to align perception with logical deduction. By dynamically routing inference paths and materializing implicit visual features into explicit textual anchors, our approach effectively counterbalances the influence of parametric knowledge. Furthermore, we incorporate a Latent Reasoning Consensus mechanism to mitigate stochastic hallucinations. VISTA showed outstanding results on a wide range of benchmarks, and outperforms its base model by 9.3% on Egochema and 5.6% on VideoEspresso, rivalling or even surpassing larger and proprietary models. Our codebase will be publicly available soon.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 20 of its 45 references that are in the map. First posted on arXiv 17 May 2025.

Builds on

20 of 45 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
  2. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  3. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
  4. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  5. 2024CoCoT: Contrastive Chain-of-Thought Prompting for Large Multimodal Models with Multiple Image Inputs5 Jan

Other references · 15

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  5. 2024OpenAI o1 System Cardcited by 1,244
  6. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  7. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
  8. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  9. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  10. 2024Long Context Transfer from Language to Visioncited by 515
  11. 2025LIMO: Less is More for Reasoningcited by 498
  12. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
3 more
  1. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
  2. 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
  3. 2024TS-LLaVA: Constructing Visual Tokens through Thumbnail-and-Sampling for Training-Free Video Large Language Modelscited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 6.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Analyzing Reasoning Consistency in Large Multimodal Models under Cross-Modal Conflicts
  2. 2026From Priors to Perception: Grounding Video-LLMs in Physical Reality
  3. 2026V-CORE: Temporally Consistent Video Understanding for Video-LLM
  4. 2026Before It Fades: Reinforcing Temporal Representations at Inference Time in VideoLLMs
  5. 2025When Thinking Drifts: Evidential Grounding for Robust Video Reasoning
  6. 2026TempCloze: Can Video-LLMs Identify the Missing Middle?
  7. 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning
  8. 2026Video-Oasis: Rethinking Evaluation of Video Understanding