mlsanityData to 7 Oct 2026

DeepSport: A Multimodal Large Language Model for Comprehensive Sports Video Reasoning via Agentic Reinforcement Learning

arXiv 2511.12908 ↗First posted 17 Nov 2025cs.CV cs.AIcited by 5

On the map: LLM reasoning → Multimodal reasoning

also in 2 more
Abstract (arXiv)

Sports video understanding requires perceiving high-speed dynamics, complex rules, and long temporal contexts. Yet, current Multimodal Large Language Models (MLLMs) remain narrowly focused on single sports, specific tasks, or training-free paradigms. We introduce DeepSport, the first end-to-end trained MLLM for multi-task, multi-sport video understanding. DeepSport shifts from passive frame processing to active, iterative reasoning, dynamically extracting frames to "think with videos." To train our model, we curate a unified 78k-sample dataset via a rigorous three-step text-and-vision distillation pipeline. We then employ a progressive two-stage training strategy: a Sports Curriculum Supervised Fine-Tuning phase to build foundational perception, followed by Agentic Reinforcement Learning with a novel tool-use reward. Extensive experiments on a comprehensive 6.7k benchmark demonstrate that DeepSport achieves state-of-the-art performance, outperforming powerful proprietary and open-source models, while utilizing significantly fewer frames. Furthermore, it exhibits strong zero-shot transferability to unseen sports and broad motion recognition tasks, establishing a highly efficient and generalized foundation for complex video reasoning.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 42 of its 75 references that are in the map. First posted on arXiv 17 Nov 2025.

Builds on

42 of 75 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025SportR: A Benchmark for Multimodal Large Language Model Reasoning in Sports9 Nov
  2. 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting29 Sep
  3. 2025FineQuest: Adaptive Knowledge-Assisted Sports Video Understanding via Agent-of-Thoughts Reasoning15 Sep
  4. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
  5. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning6 Aug
  6. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
  7. 2025GRIT: Teaching MLLMs to Think with Images21 May
  8. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  9. 2025T*: Re-thinking Temporal Search for Long-Form Video Understanding3 Apr
  10. 2025Video-R1: Reinforcing Video Reasoning in MLLMs27 Mar

Other references · 32

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  7. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  8. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
  9. 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 275
  10. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 195
  11. 2024MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understandingcited by 180
  12. 2024Tarsier: Recipes for Training and Evaluating Large Video Description Modelscited by 140
20 more
  1. 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learningcited by 82
  2. 2025MotionBench: Benchmarking and Improving Fine-grained Video Motion Understanding for Vision Language Modelscited by 69
  3. 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 57
  4. 2021Camera Calibration and Player Localization in SoccerNet-v2 and Investigation of their Representations for Action Spottingcited by 43
  5. 2024Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sportscited by 41
  6. 2025VideoITG: Multimodal Video Understanding with Instructed Temporal Groundingcited by 28
  7. 2024SPORTU: A Comprehensive Sports Understanding Benchmark for Multimodal Large Language Modelscited by 24
  8. 2024ActionAtlas: A VideoQA Benchmark for Domain-specialized Action Recognitioncited by 21
  9. 2024Towards Universal Soccer Video Understandingcited by 21
  10. 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learningcited by 20
  11. 2025Multi-Agent System for Comprehensive Soccer Understandingcited by 18
  12. 2024SportQA: A Benchmark for Sports Understanding in Large Language Modelscited by 15
  13. 2025TimeSoccer: An End-to-End Multimodal Large Language Model for Soccer Commentary Generationcited by 13
  14. 2024Language and Multimodal Models in Sports: A Survey of Datasets and Applicationscited by 10
  15. 2025SoccerChat: Integrating Multimodal Data for Enhanced Soccer Game Understandingcited by 8
  16. 2025JointDiff: Bridging Continuous and Discrete in Multi-Agent Trajectory Generationcited by 5
  17. 2022Automated player identification and indexing using two-stage deep learning networkcited by 3
  18. 2024FACTS: Fine-Grained Action Classification for Tactical Sportscited by 3
  19. 2025SV3.3B: A Sports Video Understanding Model for Action Recognitioncited by 3
  20. 2025TennisTV: Do Multimodal Large Language Models Understand Tennis Rallies?cited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond the Single Camera: Agentic Multi-View Reasoning in Sports Video Understanding
  2. 2026TennisVAR: A Stroke-Evidence-Grounded Multimodal Large Language Model for Tactical Reasoning in Tennis Videos
  3. 2025FineBadminton: A Multi-Level Dataset for Fine-Grained Badminton Video Understanding
  4. 2024Sports Intelligence: Assessing the Sports Understanding Capabilities of Language Models through Question Answering from Text to Video
  5. 2026SportsGrounder: Proposal-Aided Interleaved Grounding for Dense Sports Video Reasoning
  6. 2026BoxComm: Benchmarking Category-Aware Commentary Generation and Narration Rhythm in Boxing
  7. 2025Domain Adaptation of VLM for Soccer Video Understanding
  8. 2025Scaling RL to Long Videos