OpenCoF: Learning to Reason Through Video Generation
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Reasoning has become a core capability for large models, especially when reliable decisions require understanding logical consequences. Recent video generation models offer a reasoning path distinct from previous Chain-of-Thought (CoT): reasoning can unfold through temporally connected frames, known as Chain-of-Frame (CoF) reasoning. However, existing video generators are primarily trained on general video corpora, still lacking diverse supervision and dedicated designs for CoF reasoning. To address this gap, we introduce OpenCoF, a framework comprising the OpenCoF-17K dataset, a reasoning video dataset spanning 11 task families, and Wan-CoF, a fine-tuned video model for studying whether diverse temporal supervision improves CoF behavior. Across four video reasoning benchmarks, Wan-CoF achieves considerable gains over the Wan2.2-I2V-A14B baseline. Building on this, we empirically explore more advanced designs for CoF capabilities, i.e., equipping the model with visual and textual reasoning tokens. This mechanism respectively captures low-level visual cues and high-level semantic priors for spatial and temporal reasoning. Through performance comparisons and attention analysis, we examine how these tokens contribute across model depth, denoising steps, space, and time. Our results suggest that stronger video reasoning requires both broad temporal supervision and explicit mechanisms for organizing intermediate reasoning state. We open-source the dataset, model, and code to facilitate future research on reasoning-oriented video generation.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 42 of its 48 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
42 of 48 references.
Closest ancestors · 21
Same direction, newest first
- 2026ATLAS: Agentic or Latent Visual Reasoning? One Word is Enough for Both14 May
- 2026MME-CoF-Pro: Evaluating Reasoning Coherence in Video Generative Models with Text and Visual Hints20 Mar
- 2026A Very Big Video Reasoning Suite23 Feb
- 2026Thinking in Frames: How Visual Context and Test-Time Scaling Empower Video Reasoning28 Jan
- 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation16 Dec
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligence2 Dec
- 2025V-ReasonBench: Toward Unified Reasoning Benchmark Suite for Video Generation Models20 Nov
- 2025Reasoning via Video: The First Evaluation of Video Models' Reasoning Abilities through Maze-Solving Tasks19 Nov
- 2025Can World Simulators Reason? Gen-ViRe: A Generative Visual Reasoning Benchmark17 Nov
- 2025TiViBench: Benchmarking Think-in-Video Reasoning for Video Generative Models17 Nov
- 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigm6 Nov
- 2025Are Video Models Ready as Zero-Shot Reasoners? An Empirical Study with the MME-CoF Benchmark30 Oct
9 more
- 2025Video models are zero-shot learners and reasoners24 Sep
- 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning5 Jun
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency13 Feb
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
Other references · 21
- 2017Attention Is All You Needcited by 60,361
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
9 more
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2023G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Modelcited by 210
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
- 2025Visual Planning: Let's Think Only with Imagescited by 85
- 2025Seedance 1.5 pro: A Native Audio-Visual Joint Generation Foundation Modelcited by 80
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generation
- 2025Rethinking Chain-of-Thought Reasoning for Videos
- 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoning
- 2026TwiFF (Think With Future Frames): A Large-Scale Dataset for Dynamic Visual Reasoning
- 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning
- 2026VTI-CoT: Visual-Textual Interleaved Chain of Thought for Video Reasoning
- 2025Beyond the Last Frame: Process-aware Evaluation for Generative Video Reasoning
- 2026Demystifying Video Reasoning