mlsanityData to 14 Oct 2026

Video-R4: Reinforcing Text-Rich Video Reasoning with Visual Rumination

arXiv 2511.17490 ↗First posted 21 Nov 2025cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Understanding text-rich videos requires reading small, transient textual cues that often demand repeated inspection. Yet most video QA models rely on single-pass perception over fixed frames, leading to hallucinations and failures on fine-grained evidence. Inspired by how humans pause, zoom, and re-read critical regions, we introduce Video-R4 (Reinforcing Text-Rich Video Reasoning with Visual Rumination), a video reasoning LMM that performs visual rumination: iteratively selecting frames, zooming into informative regions, re-encoding retrieved pixels, and updating its reasoning state. We construct two datasets with executable rumination trajectories: Video-R4-CoT-17k for supervised practice and Video-R4-RL-30k for reinforcement learning. We propose a multi-stage rumination learning framework that progressively finetunes a 7B LMM to learn atomic and mixing visual operations via SFT and GRPO-based RL. Video-R4-7B achieves state-of-the-art results on M4-ViteVQA and further generalizes to multi-page document QA, slides QA, and generic video QA, demonstrating that iterative rumination is an effective paradigm for pixel-grounded multimodal reasoning. Project Page: https://yunlong10.github.io/Video-R4/

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 85 of its 98 references that are in the map. First posted on arXiv 21 Nov 2025.

Builds on

85 of 98 references.

References · 85

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  8. 2025Qwen2.5-VL Technical Reportcited by 5,587
  9. 2024GPT-4o System Cardcited by 4,588
  10. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  11. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  12. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
38 more
  1. 2020Longformer: The Long-Document Transformercited by 3,413
  2. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  3. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  4. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  5. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
  6. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  7. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  8. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  9. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
  10. 2023VideoChat: Chat-Centric Video Understandingcited by 857
  11. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
  12. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
  13. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
  14. 2024Long Context Transfer from Language to Visioncited by 515
  15. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
  16. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
  17. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
  18. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
  19. 2019Scene Text Visual Question Answeringcited by 331
  20. 2025From System 1 to System 2: A Survey of Reasoning Large Language Modelscited by 320
  21. 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
  22. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 301
  23. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
  24. 2020Just Ask: Learning to Answer Questions from Millions of Narrated Videoscited by 248
  25. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
  26. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
  27. 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 220
  28. 2024Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understandingcited by 213
  29. 2024NVILA: Efficient Frontier Visual Language Modelscited by 209
  30. 2023Video Understanding with Large Language Models: A Surveycited by 206
  31. 2024Advancing LLM Reasoning Generalists with Preference Treescited by 192
  32. 2023SlideVQA: A Dataset for Document Visual Question Answering on Multiple Imagescited by 179
  33. 2022All in One: Exploring Unified Video-Language Pre-trainingcited by 171
  34. 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 165
  35. 2024Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolutioncited by 159
  36. 2021VisualMRC: Machine Reading Comprehension on Document Imagescited by 151
  37. 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Modelscited by 144
  38. 2019Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQAcited by 107

50 most cited of 85 All 85 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learning
  2. 2026Video-ToC: Video Tree-of-Cue Reasoning
  3. 2025VCRBench: Exploring Long-form Causal Reasoning Capabilities of Large Video Language Models
  4. 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
  5. 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting
  6. 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
  7. 2026Less from More: Reinforcing Sparse Video Reasoning from Dense References
  8. 2026Reinforce to Learn, Elect to Reason: A Dual Paradigm for Video Reasoning