Digitizing Coaching Intelligence: An Agentic Framework for Holistic Athlete Profiling using VLM and RAG
Not on the map. Why?
Abstract (arXiv)
Athlete assessment is a critical process for tracking physical progress and identifying elite talent. However, during mass recruitment drives, traditional methods rely on manual observation, which is inherently subjective and unscalable, or basic computer vision (CV) systems limited to quantitative repetition counting. These standard approaches lack the "coaching intelligence" required to evaluate qualitative physiological markers such as form degradation, spinal articulation, and fatigue. This paper presents a novel, LLM-based hybrid agentic framework for automated, holistic athlete profiling that strictly aligns with the Sports Authority of India (SAI) assessment protocols. Orchestrated via LangGraph, our dual-pipeline architecture synthesizes the geometric precision of CV (MediaPipe) for kinematic tracking with the semantic reasoning of Vision-Language Models (Llama-4-scout). To overcome the latency and token constraints associated with multimodal video processing, we introduce a 3 X 3 "Smart Grid" temporal chunking strategy, reducing computational overhead by over 88% while preserving critical temporal continuity. To ensure data integrity and mitigate hallucination, the framework pioneers an autonomous "LLM-as-a-Judge" self-correction loop that cross-references quantitative and qualitative metrics before persistence. Finally, we implement a dual-persistence Retrieval-Augmented Generation (RAG) pipeline utilizing a vector search engine (ChromaDB). This enables coaches to bypass rigid SQL databases and perform complex semantic queries (e.g., "Identify athletes with high endurance but poor core rigidity") using natural language. Experimental results demonstrate that this multi-agent approach significantly bridges the gap between raw biometric tracking and actionable coaching insights, offering a scalable, objective solution for national talent identification.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 20 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
8 of 20 references.
References · 8
- 2024RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model Feedbackcited by 156
- 2024Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAGcited by 123
- 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervisioncited by 86
- 2026AgentDoG: A Diagnostic Guardrail Framework for AI Agent Safety and Securitycited by 50
- 2024SPFresh: Incremental In-Place Update for Billion-Scale Vector Searchcited by 28
- 2023Vector Search with OpenAI Embeddings: Lucene Is All You Needcited by 12
- 2026From Governance Norms to Enforceable Controls: A Layered Translation Method for Runtime Guardrails in Agentic AIcited by 7
- 2024A Survey of Transformer-based Language Models with Focus on Efficiencycited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Synthesizing the Expert: A Validated Multimodal Dataset for Trustworthy AI-Assisted Swimming Coaching
- 2025SportsGPT: An LLM-driven Framework for Interpretable Sports Motion Assessment and Training Guidance
- 2026CricRAG: Retrieval Augmented Vision-Language Models for Personalized Cricket Coaching
- 2026Learning Consistent Temporal Grounding between Related Tasks in Sports Coaching
- 2026MyoMechanix: Biomechanically-Grounded Compositional Skilled Activity Understanding and Coaching
- 2025GridMind: A Multi-Agent NLP Framework for Unified, Cross-Modal NFL Data Insights
- 2025Learning Skill-Attributes for Transferable Assessment in Video
- 2026Stepping VLMs onto the Court: Benchmarking Spatial Intelligence in Sports