mlsanityData to 14 Oct 2026

Multi-Agent System for Comprehensive Soccer Understanding

arXiv 2505.03735 ↗First posted 6 May 2025cs.CVcited by 18

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Recent advances in soccer understanding have demonstrated rapid progress, yet existing research predominantly focuses on isolated or narrow tasks. To bridge this gap, we propose a comprehensive framework for holistic soccer understanding. Concretely, we make the following contributions in this paper: (i) we construct SoccerWiki, the first large-scale multimodal soccer knowledge base, integrating rich domain knowledge about players, teams, referees, and venues to enable knowledge-driven reasoning; (ii) we present SoccerBench, the largest and most comprehensive soccer-specific benchmark, featuring around 10K multimodal (text, image, video) multi-choice QA pairs across 13 distinct tasks; (iii) we introduce SoccerAgent, a novel multi-agent system that decomposes complex soccer questions via collaborative reasoning, leveraging domain expertise from SoccerWiki and achieving robust performance; (iv) extensive evaluations and comparisons with representative MLLMs on SoccerBench highlight the superiority of our agentic system.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 32 of its 68 references that are in the map. First posted on arXiv 6 May 2025.

Builds on

32 of 68 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Generative Multi-Agent Collaboration in Embodied AI: A Systematic Review17 Feb

Other references · 31

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2015VQA: Visual Question Answeringcited by 2,506
  4. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  5. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  6. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  7. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  8. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  9. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
  10. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  11. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  12. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
19 more
  1. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  2. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
  3. 2020FineGym: A Hierarchical Video Dataset for Fine-grained Action Understandingcited by 234
  4. 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 220
  5. 2018SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videoscited by 150
  6. 2020SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videoscited by 131
  7. 2022FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessmentcited by 107
  8. 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulatorcited by 101
  9. 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 82
  10. 2024GTA: A Benchmark for General Tool Agentscited by 77
  11. 2024MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Modelscited by 67
  12. 2023TacticAI: an AI assistant for football tacticscited by 44
  13. 2024MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videoscited by 43
  14. 2024Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sportscited by 41
  15. 2024MatchTime: Towards Automatic Soccer Game Commentary Generationcited by 37
  16. 2024SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimapcited by 34
  17. 2023GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generationcited by 28
  18. 2024A General Framework for Jersey Number Recognition in Sports Videocited by 11
  19. 2025SGA-INTERACT: A 3D Skeleton-based Benchmark for Group Activity Understanding in Modern Basketball Tacticcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 12.

18 papers.

Sort:

By area:

  1. 2025SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligencecited by 24
  2. 2025SportR: A Benchmark for Multimodal Large Language Model Reasoning in Sportscited by 17
  3. 2025SoccerMaster: A Vision Foundation Model for Soccer Understandingcited by 10
  4. 2025DeepSport: A Multimodal Large Language Model for Comprehensive Sports Video Reasoning via Agentic Reinforcement Learningcited by 5
  5. 2025SciEducator: Scientific Video Understanding and Educating via Deming-Cycle Multi-Agent Systemcited by 4
  6. 2026GenTac: Generative Modeling and Forecasting of Soccer Tacticscited by 3
  7. 2026Stepping VLMs onto the Court: Benchmarking Spatial Intelligence in Sportscited by 2
  8. 2025Multi-Modal Soccer Scene Analysis with Masked Pre-Trainingcited by 1
  9. 2026Learning Consistent Temporal Grounding between Related Tasks in Sports Coachingcited by 1
  10. 2026Towards Automatic Soccer Commentary Generation with Knowledge-Enhanced Visual Reasoningcited by 1
  11. 2026SoccerNet 2026 Challenges Resultscited by 1
  12. 2026Towards Comprehensive Basketball Understandingcited by 1
6 more
  1. 2026SoccerRef-Agents: Multi-Agent System for Automated Soccer Refereeingcited by 0
  2. 2026MSUE: Multi-Modal Soccer Understanding Expertcited by 0
  3. 2026TreeSoc: Tree-Structured Dynamic Reasoning and Tool Synergy for Soccer Video Understandingcited by 0
  4. 2026BasketEvent: Understanding Who Did What and When in Basketball Videoscited by 0
  5. 2026SportsGrounder: Proposal-Aided Interleaved Grounding for Dense Sports Video Reasoningcited by 0
  6. 2026Semantic Action Graph: A Shared Representation for Agent Grounding and Human Interpretation of Sports Highlightscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025GridMind: A Multi-Agent NLP Framework for Unified, Cross-Modal NFL Data Insights
  2. 2024Sports Intelligence: Assessing the Sports Understanding Capabilities of Language Models through Question Answering from Text to Video
  3. 2024SPORTU: A Comprehensive Sports Understanding Benchmark for Multimodal Large Language Models
  4. 2024X-VARS: Introducing Explainability in Football Refereeing with Multi-Modal Large Language Model
  5. 2024SportQA: A Benchmark for Sports Understanding in Large Language Models
  6. 2026Beyond the Single Camera: Agentic Multi-View Reasoning in Sports Video Understanding
  7. 2025Domain Adaptation of VLM for Soccer Video Understanding
  8. 2023Action valuation of on- and off-ball soccer players based on multi-agent deep reinforcement learning