Video-R4: Reinforcing Text-Rich Video Reasoning with Visual Rumination
Not on the map. Why?
Abstract (arXiv)
Understanding text-rich videos requires reading small, transient textual cues that often demand repeated inspection. Yet most video QA models rely on single-pass perception over fixed frames, leading to hallucinations and failures on fine-grained evidence. Inspired by how humans pause, zoom, and re-read critical regions, we introduce Video-R4 (Reinforcing Text-Rich Video Reasoning with Visual Rumination), a video reasoning LMM that performs visual rumination: iteratively selecting frames, zooming into informative regions, re-encoding retrieved pixels, and updating its reasoning state. We construct two datasets with executable rumination trajectories: Video-R4-CoT-17k for supervised practice and Video-R4-RL-30k for reinforcement learning. We propose a multi-stage rumination learning framework that progressively finetunes a 7B LMM to learn atomic and mixing visual operations via SFT and GRPO-based RL. Video-R4-7B achieves state-of-the-art results on M4-ViteVQA and further generalizes to multi-page document QA, slides QA, and generic video QA, demonstrating that iterative rumination is an effective paradigm for pixel-grounded multimodal reasoning. Project Page: https://yunlong10.github.io/Video-R4/
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 85 of its 98 references that are in the map. First posted on arXiv 21 Nov 2025.
Builds on
85 of 98 references.
References · 85
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Visual Instruction Tuningcited by 7,869
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
38 more
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
- 2023VideoChat: Chat-Centric Video Understandingcited by 857
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2024Long Context Transfer from Language to Visioncited by 515
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2019Scene Text Visual Question Answeringcited by 331
- 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
- 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
- 2020Just Ask: Learning to Answer Questions from Millions of Narrated Videoscited by 248
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
- 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 220
- 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 213
- 2024NVILA: Efficient Frontier Visual Language Modelscited by 209
- 2023Video Understanding with Large Language Models: A Surveycited by 206
- 2024Advancing LLM Reasoning Generalists with Preference Treescited by 192
- 2023SlideVQA: A Dataset for Document Visual Question Answering on Multiple Imagescited by 179
- 2022All in One: Exploring Unified Video-Language Pre-trainingcited by 171
- 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 165
- 2024Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolutioncited by 159
- 2021VisualMRC: Machine Reading Comprehension on Document Imagescited by 151
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Modelscited by 144
- 2019Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQAcited by 107
50 most cited of 85 All 85 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026SPARC: Separating Perception And Reasoning Circuits for Test-time Scaling of VLMscited by 7
- 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verificationcited by 7
- 2026OmniReasoner: Thinking with Long Audio-Video via Native Tool Usecited by 3
- 2026VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understandingcited by 2
- 2026LENS: Adaptive Spatio-Temporal Zooming for Keyframe Sampling in Long-Form Videoscited by 2
- 2026TDMM-LM: Bridging Facial Understanding and Animation via Language Modelscited by 0
- 2026LENS: Adaptive Spatio-Temporal Zooming for Keyframe Sampling in Long-Form Videos27 Jul 2026
- 2026OmniReasoner: Thinking with Long Audio-Video via Native Tool Use21 Jul 2026
- 2026VideoKR: Towards Knowledge- and Reasoning-Intensive Video Understanding3 Jun 2026
- 2026VideoZeroBench: Probing the Limits of Video MLLMs with Spatio-Temporal Evidence Verification2 Apr 2026
- 2026TDMM-LM: Bridging Facial Understanding and Animation via Language Models14 Mar 2026
- 2026SPARC: Separating Perception And Reasoning Circuits for Test-time Scaling of VLMs6 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
- 2026Video-ToC: Video Tree-of-Cue Reasoning
- 2025VCRBench: Exploring Long-form Causal Reasoning Capabilities of Large Video Language Models
- 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
- 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting
- 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
- 2026Less from More: Reinforcing Sparse Video Reasoning from Dense References
- 2026Reinforce to Learn, Elect to Reason: A Dual Paradigm for Video Reasoning