ReasonAct: Progressive Training for Fine-Grained Video Reasoning in Small Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
While recent multimodal models have shown progress in vision-language tasks, small-scale variants still struggle with the fine-grained temporal reasoning required for video understanding. We introduce ReasonAct, a method that enhances video reasoning in smaller models through a three-stage training process: first building a foundation with text-only reasoning, then fine-tuning on video, and finally refining with temporal-aware reinforcement learning. We build upon Temporal Group Relative Policy Optimization (T-GRPO) by incorporating temporal consistency modeling into policy optimization. We also propose a biomechanically-motivated sub-action decomposition mechanism that provides graduated rewards for constituent action phases. Through experiments on HMDB51, UCF-101, and Kinetics-400, our 3B-parameter model achieves 67.2%, 94.1%, and 78.9% accuracy respectively, demonstrating improvements of 17.9, 15.8, and 12.3 points over baselines. Ablation studies validate that our progressive training enables smaller models to achieve competitive video reasoning performance while maintaining computational efficiency.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 23 of its 48 references that are in the map. First posted on arXiv 3 Aug 2025.
Builds on
23 of 48 references.
Closest ancestors · 3
Same direction, newest first
- 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar
- 2024TemporalVLM: Video LLMs for Temporal Reasoning in Long Videos4 Dec
- 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
Other references · 20
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2015VQA: Visual Question Answeringcited by 2,506
- 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,164
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
8 more
- 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
- 2022Large Language Models Can Self-Improvecited by 664
- 2017Temporal Relational Reasoning in Videoscited by 324
- 2019COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysiscited by 318
- 2017Temporal Action Detection with Structured Segment Networkscited by 267
- 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 217
- 2020Video Super Resolution Based on Deep Learning: A Comprehensive Surveycited by 54
- 2025OmniVec2 -- A Novel Transformer based Network for Large Scale Multimodal and Multitask Learningcited by 14
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026RAM: Recover Any 3D Human Motion in-the-Wildcited by 12
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Modelscited by 8
- 2026MultiPress: A Multi-Agent Framework for Interpretable Multimodal News Classificationcited by 2
- 2026SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigationcited by 0
- 2026SAVOR: Self-Aware Visual Grounding via Confidence-Calibrated Reinforcement Learning for Multimodal Hallucination Mitigation15 Sep 2026
- 2026MultiPress: A Multi-Agent Framework for Interpretable Multimodal News Classification4 Apr 2026
- 2026RAM: Recover Any 3D Human Motion in-the-Wild20 Mar 2026
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Models6 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Find, Fix, Reason: Context Repair for Video Reasoning
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning
- 2025TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning
- 2025Video Reasoning without Training
- 2025Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
- 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
- 2026Video-KTR: Reinforcing Video Reasoning via Key Token Attribution
- 2025ViSS-R1: Self-Supervised Reinforcement Video Reasoning