mlsanityData to 7 Oct 2026

MOSS-ChatV: Reinforcement Learning with Process Reasoning Reward for Video Temporal Reasoning

arXiv 2509.21113 ↗First posted 25 Sep 2025cs.CVcited by 7

On the map: LLM reasoning → Multimodal reasoning

also in 2 more
Abstract (arXiv)

Video reasoning has emerged as a critical capability for multimodal large language models (MLLMs), requiring models to move beyond static perception toward coherent understanding of temporal dynamics in complex scenes. Yet existing MLLMs often exhibit process inconsistency, where intermediate reasoning drifts from video dynamics even when the final answer is correct, undermining interpretability and robustness. To address this issue, we introduce MOSS-ChatV, a reinforcement learning framework with a Dynamic Time Warping (DTW)-based process reward. This rule-based reward aligns reasoning traces with temporally grounded references, enabling efficient process supervision without auxiliary reward models. We further identify dynamic state prediction as a key measure of video reasoning and construct MOSS-Video, a benchmark with annotated reasoning traces, where the training split is used to fine-tune MOSS-ChatV and the held-out split is reserved for evaluation. MOSS-ChatV achieves 87.2% on MOSS-Video (test) and improves performance on general video benchmarks such as MVBench and MMVU. The framework consistently yields gains across different architectures, including Qwen2.5-VL and Phi-2, confirming its broad applicability. Evaluations with GPT-4o-as-judge further show that MOSS-ChatV produces more consistent and stable reasoning traces.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 32 references that are in the map. First posted on arXiv 25 Sep 2025.

Builds on

25 of 32 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025RTV-Bench: Benchmarking MLLM Continuous Perception, Understanding and Reasoning through Real-Time Video4 May
  2. 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning13 Apr
  3. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning9 Apr
  4. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
  5. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
  6. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  7. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  8. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition7 May

Other references · 17

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  6. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  7. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  8. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
  9. 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 386
  10. 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 352
  11. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
  12. 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
5 more
  1. 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
  2. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
  3. 2024The Revolution of Multimodal Large Language Models: A Surveycited by 134
  4. 2025Unhackable Temporal Rewarding for Scalable Video MLLMscited by 33
  5. 2025Process-Supervised Reinforcement Learning for Code Generationcited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026TimeThink: Reasoning with Time for Video LLMs
  2. 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
  3. 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
  4. 2025VIDEOP2R: Video Understanding from Perception to Reasoning
  5. 2025TempR1: Improving Temporal Understanding of MLLMs via Temporal-Aware Multi-Task Reinforcement Learning
  6. 2026Temporal-Aware Reasoning Optimization for Video Temporal Grounding
  7. 2026Video Models Can Reason with Verifiable Rewards
  8. 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1