SportsGrounder: Proposal-Aided Interleaved Grounding for Dense Sports Video Reasoning
Not on the map. Why?
Abstract (arXiv)
Sports video analysis is crucial for athletic analytics and broadcasting enhancement. Dense sports video reasoning, however, demands a fine-grained understanding of numerous small-scale, highly interactive, and visually homogeneous entities (e.g., players sharing identical uniforms, the ball) across long temporal contexts. Current Large Multimodal Models (LMMs) inherently struggle with such dense visual complexities. Due to the lack of fine-grained visual details, these models often over-rely on textual priors to guess answers, especially when distinguishing visually similar actions and players. To address this, we propose SportsGrounder, a framework that leverages an open-vocabulary visual expert to aid interleaved grounding specifically for dense sports video reasoning. To achieve precise spatial localization, we extract domain-guided object proposals and introduce an Interleaved Grounding Fusion (IGF) mechanism. The IGF frame-by-frame integrates explicit bounding box coordinates and implicit visual semantics with global grid features. This design preserves strict temporal alignment and prevents sequence length explosion. Furthermore, we design an Action-Aware Supervision (AAS) module that directly regularizes the model's hidden states, forcing the network to learn accurate motion representations rather than relying on language bias. Optimized with Mixed Preference Optimization (MPO) to better distinguish deceptive distractors, our extensive experiments on newly curated dense sports VQA datasets (derived from SoccerNet and FineSports) demonstrate that SportsGrounder significantly improves fine-grained reasoning and achieves state-of-the-art accuracy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 57 references that are in the map. First posted on arXiv 8 Aug 2026.
Builds on
33 of 57 references.
References · 33
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 484
- 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 239
- 2025Adaptive Keyframe Sampling for Long Video Understandingcited by 167
- 2024Direct Preference Optimization of Video Large Multimodal Models from Language Model Rewardcited by 147
- 2025T*: Re-thinking Temporal Search for Long-Form Video Understandingcited by 82
- 2025LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understandingcited by 59
21 more
- 2024Beyond Bare Queries: Open-Vocabulary Object Grounding with 3D Scene Graphcited by 32
- 2024Uncovering Bias in Large Vision-Language Models at Scale with Counterfactualscited by 28
- 2024OV-DINO: Unified Open-Vocabulary Detection with Language-Aware Selective Fusioncited by 28
- 2025Improving LLM Video Understanding with 16 Frames Per Secondcited by 26
- 2024ActionAtlas: A VideoQA Benchmark for Domain-specialized Action Recognitioncited by 21
- 2024VideoLLaMB: Long Streaming Video Understanding with Recurrent Memory Bridgescited by 20
- 2024Motion-Grounded Video Reasoning: Understanding and Perceiving Motion at Pixel Levelcited by 19
- 2024HyperGLM: HyperGraph for Video Scene Graph Generation and Anticipationcited by 19
- 2025Multi-Agent System for Comprehensive Soccer Understandingcited by 18
- 2025SportR: A Benchmark for Multimodal Large Language Model Reasoning in Sportscited by 17
- 2026GUI-Libra: Training Native GUI Agents to Reason and Act with Action-aware Supervision and Partially Verifiable RLcited by 16
- 2025Scene-R1: Video-Grounded Large Language Models for 3D Scene Reasoning without 3D Annotationscited by 14
- 2025Object-centric Video Question Answering with Visual Grounding and Referringcited by 13
- 2024Addressing Blind Guessing: Calibration of Selection Bias in Multiple-Choice Question Answering by Video Language Modelscited by 11
- 2026SlowFocus: Enhancing Fine-grained Temporal Understanding in Video LLMcited by 11
- 2025SoccerMaster: A Vision Foundation Model for Soccer Understandingcited by 10
- 2024Multi-Preference Optimization: Generalizing DPO via Set-Level Contrastscited by 9
- 2025SceneCOT: Eliciting Grounded Chain-of-Thought Reasoning in 3D Scenescited by 8
- 2025F3Set: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videoscited by 7
- 2025FineQuest: Adaptive Knowledge-Assisted Sports Video Understanding via Agent-of-Thoughts Reasoningcited by 5
- 2026LongVPO: From Anchored Cues to Self-Reasoning for Long-Form Video Preference Optimizationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond the Single Camera: Agentic Multi-View Reasoning in Sports Video Understanding
- 2026Towards Temporal Compositional Reasoning in Long-Form Sports Videos
- 2025DeepSport: A Multimodal Large Language Model for Comprehensive Sports Video Reasoning via Agentic Reinforcement Learning
- 2026SoccerLens: Grounded Soccer Video Understanding Beyond Accuracy
- 2026Learning Consistent Temporal Grounding between Related Tasks in Sports Coaching
- 2026TennisVAR: A Stroke-Evidence-Grounded Multimodal Large Language Model for Tactical Reasoning in Tennis Videos
- 2025FineBadminton: A Multi-Level Dataset for Fine-Grained Badminton Video Understanding
- 2026Efficient Spatio-Temporal Grounding with Multimodal Large Models via Second-Level Tracking and RL Verification