CollabVR: Collaborative Video Reasoning with Vision-Language and Video Generation Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent "Thinking with Video" approaches use Video Generation Models (VGMs) for visual reasoning by producing temporally coherent Chain-of-Frames as reasoning artifacts. Even strong VGMs, however, exhibit two recurring failure modes on goal-directed tasks: long-horizon drift on multi-step tasks and mid-clip simulation errors that compound. Both stem from the absence of explicit reasoning built upon the VGM's short-horizon visual prior, a role naturally filled by Vision-Language Models (VLMs), but where to place the VLM is non-trivial: upfront plans commit before any frame is generated and post-hoc critiques over whole videos intervene too late. We propose VLM-VGM Collaborative Video Reasoning (CollabVR), a closed-loop framework that couples the VLM with the VGM at step-level granularity: the VLM plans the immediate next action, inspects the clip the VGM generates, and folds the verifier's diagnosis directly into the next action prompt to repair detected failures. On Gen-ViRe and VBVR-Bench, CollabVR improves both open-source and closed-source VGMs over single-inference, Pass@k, and prior test-time scaling baselines at matched compute, with the largest gains on the hardest tasks. It also yields further improvements on top of a reasoning-fine-tuned VGM, indicating that step-level VLM supervision is orthogonal to and stackable with reasoning-oriented fine-tuning. We provide video samples and additional qualitative results at our project page: https://joow0n-kim.github.io/collabvr-project-page.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 40 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
21 of 40 references.
Closest ancestors · 11
Same direction, newest first
- 2026A Very Big Video Reasoning Suite23 Feb
- 2026Thinking in Frames: How Visual Context and Test-Time Scaling Empower Video Reasoning28 Jan
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation16 Dec
- 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Models20 Nov
- 2025Reasoning via Video: The First Evaluation of Video Models' Reasoning Abilities through Maze-Solving Tasks19 Nov
- 2025Can World Simulators Reason? Gen-ViRe: A Generative Visual Reasoning Benchmark17 Nov
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning30 Oct
- 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmark30 Oct
- 2025Video models are zero-shot learners and reasoners24 Sep
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
- 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learning13 May
Other references · 10
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2025Scaling Image and Video Generation via Test-Time Evolutionary Searchcited by 40
- 2025VChain: Chain-of-Visual-Thought for Reasoning in Video Generationcited by 32
- 2026Self-Refining Video Samplingcited by 15
- 2025Beyond the Last Frame: Process-aware Evaluation for Generative Video Reasoningcited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimizationcited by 5
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Modelscited by 3
- 2026Visual General Intelligence: A White Papercited by 1
- 2026WorldGuide: Goal-Directed Video World Model for Procedural Task Executioncited by 0
- 2026WorldGuide: Goal-Directed Video World Model for Procedural Task Execution8 Oct 2026
- 2026Visual General Intelligence: A White Paper26 Aug 2026
- 2026VGI-Bench: Probing Visual Intelligence in Video Generation Models20 Aug 2026
- 2026VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimization1 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models
- 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Models
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning
- 2026SYNCR: Diagnosing and Learning Cross-Video Reasoning from Simulation
- 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning
- 2025VideoReasonBench: Can MLLMs Perform Vision-Centric Complex Video Reasoning?
- 2026VidNum: Diagnosing VLM Failure Modes in Video-Grounded Numerical Reasoning
- 2026Act2See: Emergent Active Visual Perception for Video Reasoning