MOSS-ChatV: Reinforcement Learning with Process Reasoning Reward for Video Temporal Reasoning
On the map: LLM reasoning → Multimodal reasoning
also in 2 more
Abstract (arXiv)
Video reasoning has emerged as a critical capability for multimodal large language models (MLLMs), requiring models to move beyond static perception toward coherent understanding of temporal dynamics in complex scenes. Yet existing MLLMs often exhibit process inconsistency, where intermediate reasoning drifts from video dynamics even when the final answer is correct, undermining interpretability and robustness. To address this issue, we introduce MOSS-ChatV, a reinforcement learning framework with a Dynamic Time Warping (DTW)-based process reward. This rule-based reward aligns reasoning traces with temporally grounded references, enabling efficient process supervision without auxiliary reward models. We further identify dynamic state prediction as a key measure of video reasoning and construct MOSS-Video, a benchmark with annotated reasoning traces, where the training split is used to fine-tune MOSS-ChatV and the held-out split is reserved for evaluation. MOSS-ChatV achieves 87.2% on MOSS-Video (test) and improves performance on general video benchmarks such as MVBench and MMVU. The framework consistently yields gains across different architectures, including Qwen2.5-VL and Phi-2, confirming its broad applicability. Evaluations with GPT-4o-as-judge further show that MOSS-ChatV produces more consistent and stable reasoning traces.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 32 references that are in the map. First posted on arXiv 25 Sep 2025.
Builds on
25 of 32 references.
Closest ancestors · 8
Same direction, newest first
- 2025RTV-Bench: Benchmarking MLLM Continuous Perception, Understanding and Reasoning through Real-Time Video4 May
- 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning13 Apr
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition7 May
Other references · 17
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
- 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 386
- 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 352
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
- 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
5 more
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2024The Revolution of Multimodal Large Language Models: A Surveycited by 134
- 2025Unhackable Temporal Rewarding for Scalable Video MLLMscited by 33
- 2025Process-Supervised Reinforcement Learning for Code Generationcited by 21
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understandingcited by 26
- 2026AndroTMem: From Interaction Trajectories to Anchored Memory in Long-Horizon GUI Agentscited by 10
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Modelscited by 8
- 2026OralGPT-Plus: Learning to Use Visual Tools via Reinforcement Learning for Panoramic X-ray Analysiscited by 4
- 2026Reinforce to Learn, Elect to Reason: A Dual Paradigm for Video Reasoningcited by 1
- 2026MuseBench: Benchmarking Intent-Level Audiovisual Arts Understanding in MLLMscited by 1
- 2026PhoenixNest-Video: Evidence-Grounded Multimodal Agent Framework for Automated Video Interview Assessmentcited by 0
- 2026PhoenixNest-Video: Evidence-Grounded Multimodal Agent Framework for Automated Video Interview Assessment2 Sep 2026
- 2026MuseBench: Benchmarking Intent-Level Audiovisual Arts Understanding in MLLMs29 Jun 2026
- 2026Reinforce to Learn, Elect to Reason: A Dual Paradigm for Video Reasoning6 Apr 2026
- 2026AndroTMem: From Interaction Trajectories to Anchored Memory in Long-Horizon GUI Agents19 Mar 2026
- 2026OralGPT-Plus: Learning to Use Visual Tools via Reinforcement Learning for Panoramic X-ray Analysis6 Mar 2026
- 2025Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding5 Dec 2025
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Models6 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026TimeThink: Reasoning with Time for Video LLMs
- 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
- 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
- 2025VIDEOP2R: Video Understanding from Perception to Reasoning
- 2025TempR1: Improving Temporal Understanding of MLLMs via Temporal-Aware Multi-Task Reinforcement Learning
- 2026Temporal-Aware Reasoning Optimization for Video Temporal Grounding
- 2026Video Models Can Reason with Verifiable Rewards
- 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1