mlsanityData to 14 Oct 2026

ChronoVision: Temporal Reasoning via Latent State Reconstruction

arXiv 2608.05631 ↗First posted 6 Aug 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Multimodal large language models excel at passive perception but struggle with complex visual cognitive tasks requiring multi-step temporal reasoning. This degradation largely stems from the inherent ambiguity of language-based reasoning, which often fails to accurately articulate continuous visual transformations. To address this, we propose ChronoVision, a multimodal framework designed to align visual logic with latent imagery. During supervised fine-tuning, a Reconstructive Visual Head predicts the latent representation of the final transformed state, while an ROI Attention Locating module focuses the model on key visual evidence via semantic span queries. In post-training, we apply reinforcement learning with an implicit process grounding mechanism, guided by a composite reward function that evaluates outcome correctness, latent process alignment, and unsupervised visual focus. Furthermore, we introduce Vbvr-VQA, a novel dataset that evaluates temporal tracking by reformulating video reasoning into a strict image-ordering task. Experiments demonstrate that ChronoVision achieves state-of-the-art performance on Vbvr-VQA with 74.8% in-domain and 71.6% out-of-domain accuracy, alongside a strong 55.0% accuracy on IntPhys2, a highly challenging cross-domain benchmark.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 48 of its 53 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

48 of 53 references.

Closest ancestors · 21

Same direction, newest first

  1. 2026A Very Big Video Reasoning Suite23 Feb
  2. 2026VRIQ: Benchmarking and Analyzing Visual-Reasoning IQ of VLMs5 Feb
  3. 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens24 Nov
  4. 2025Latent Sketchpad: Sketching Visual Thoughts to Elicit Multimodal Reasoning in MLLMs28 Oct
  5. 2025Spotlight on Token Perception for Multimodal Reinforcement Learning10 Oct
  6. 2025CoFFT: Chain of Foresight-Focus Thought for Visual Language Models26 Sep
  7. 2025Self-Rewarding Vision-Language Model via Reasoning Decomposition27 Aug
  8. 2025Explain Before You Answer: A Survey on Compositional Visual Reasoning24 Aug
  9. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning1 Jul
  10. 2025FOCUS: Internal MLLM Representations for Efficient Fine-Grained Visual Question Answering26 Jun
  11. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
  12. 2025Visionary-R1: Mitigating Shortcuts in Visual Reasoning with Reinforcement Learning20 May
9 more
  1. 2025Breaking Down Video LLM Benchmarks: Knowledge, Spatial Perception, or True Temporal Understanding?20 May
  2. 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
  3. 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
  4. 2025OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles21 Mar
  5. 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding9 Jan
  6. 2024Visual Agents as Fast and Slow Thinkers16 Aug
  7. 2022A Benchmark for Compositional Visual Reasoning11 Jun
  8. 2022A Review of Emerging Research Directions in Abstract Visual Reasoning21 Feb
  9. 2022Deep Learning Methods for Abstract Visual Reasoning: A Survey on Raven's Progressive Matrices28 Jan

Other references · 27

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  4. 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
  5. 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
  6. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
  7. 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 176
  8. 2025OmniSpatial: Towards Comprehensive Spatial Reasoning Benchmark for Vision Language Modelscited by 114
  9. 2024ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Explorationcited by 103
  10. 2025CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Modelscited by 96
  11. 2020Stratified Rule-Aware Network for Abstract Visual Reasoningcited by 72
  12. 2024Lost in Time: A New Temporal Benchmark for VideoLLMscited by 42
15 more
  1. 2025Perspective-Aware Reasoning in Vision-Language Models via Mental Imagery Simulationcited by 42
  2. 2024StitchFusion: Weaving Any Visual Modalities to Enhance Multimodal Semantic Segmentationcited by 39
  3. 2024Core Knowledge Deficits in Multi-Modal Language Modelscited by 38
  4. 2025Fine-Grained Preference Optimization Improves Spatial Reasoning in VLMscited by 32
  5. 2025Exploring Efficient Open-Vocabulary Segmentation in the Remote Sensingcited by 31
  6. 2026Do Latent-CoT Models Think Step-by-Step? A Mechanistic Study on Sequential Reasoning Taskscited by 12
  7. 2026EgoForge: Goal-Directed Egocentric World Simulatorcited by 12
  8. 2026Dynamics Within Latent Chain-of-Thought: An Empirical Study of Causal Structurecited by 11
  9. 2023Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matricescited by 9
  10. 2024Practical Region-level Attack against Segment Anything Modelscited by 9
  11. 2025Counterfactual Segmentation Reasoning: Diagnosing and Mitigating Pixel-Grounding Hallucinationcited by 7
  12. 2025STRIVE: Structured Representation Integrating VLM Reasoning for Efficient Object Navigationcited by 5
  13. 2025Stress-Testing Multimodal Foundation Models for Crystallographic Reasoningcited by 4
  14. 2026Limited Reasoning Space: The cage of long-horizon reasoning in LLMscited by 3
  15. 2026Evaluating Cognitive Age Alignment in Interactive AI Agentscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Interleaved Latent Visual Reasoning with Selective Perceptual Modeling
  2. 2026Leveraging Latent Visual Reasoning in Silence
  3. 2025Latent Visual Reasoning
  4. 2026Latent Visual Cache for Video Reasoning
  5. 2026Self-Consistent Latent Reasoning: Long Latent Sequence Reasoning for Vision-Language Model
  6. 2026DeepLatent: Think with Images via Parallel Latent Visual Reasoning
  7. 2026GLaQ: Grounding Latent Queries in Visual Evidence for Multimodal Reasoning
  8. 2026Visual Latents Know More Than They Say: Unsilencing Latent Reasoning in MLLMs