Towards Comprehensive Basketball Understanding
Not on the map. Why?
Abstract (arXiv)
Understanding a basketball game requires recognizing events, localizing actions, identifying players, and relating these to structured game knowledge. Existing benchmarks primarily evaluate these abilities one at a time, leaving the interactions among these abilities under-explored. We introduce BasketballBench, a multimodal benchmark comprising 7,980 questions across ten tasks in text, image, and video. It is built from the 2025-2026 NBA season and includes official playby-play, rosters and profiles for 530 active players, and 2,501 possession-level broadcast clips. We further propose BasketballSkills, an agent that composes eight basketball-specific perception and retrieval tools under four reusable skills that specify tool order, evidence bindings, and stopping conditions. Experiments show that current MLLMs struggle particularly on questions requiring the integration of multiple capabilities, whereas BasketballSkills outperforms them, highlighting the effectiveness of explicitly composing domain-specific capabilities for comprehensive basketball understanding.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 37 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
19 of 37 references.
References · 19
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2022Visual Programming: Compositional visual reasoning without trainingcited by 516
- 2018SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videoscited by 150
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 139
- 2021End-to-End Dense Video Captioning with Parallel Decodingcited by 133
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 131
- 2021MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actionscited by 84
- 2024Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sportscited by 41
- 2024MatchTime: Towards Automatic Soccer Game Commentary Generationcited by 37
7 more
- 2015Detecting events and key actors in multi-person videoscited by 26
- 2025Multi-Agent System for Comprehensive Soccer Understandingcited by 18
- 2025BASKET: A Large-Scale Video Dataset for Fine-Grained Skill Estimationcited by 17
- 2025SportR: A Benchmark for Multimodal Large Language Model Reasoning in Sportscited by 17
- 2024A General Framework for Jersey Number Recognition in Sports Videocited by 11
- 2026Towards Temporal Compositional Reasoning in Long-Form Sports Videoscited by 1
- 2026Beyond the Single Camera: Agentic Multi-View Reasoning in Sports Video Understandingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024SPORTU: A Comprehensive Sports Understanding Benchmark for Multimodal Large Language Models
- 2024Sports Intelligence: Assessing the Sports Understanding Capabilities of Language Models through Question Answering from Text to Video
- 2025FineBadminton: A Multi-Level Dataset for Fine-Grained Badminton Video Understanding
- 2024When Reasoning Meets Information Aggregation: A Case Study with Sports Narratives
- 2025SPORTSQL: An Interactive System for Real-Time Sports Reasoning and Visualization
- 2026Stepping VLMs onto the Court: Benchmarking Spatial Intelligence in Sports
- 2025TennisTV: Do Multimodal Large Language Models Understand Tennis Rallies?
- 2024SportQA: A Benchmark for Sports Understanding in Large Language Models