BioGait-VLM: A Tri-Modal Vision-Language-Biomechanics Framework for Interpretable Clinical Gait Assessment
Not on the map. Why?
Abstract (arXiv)
Video-based Clinical Gait Analysis often suffers from poor generalization as models overfit environmental biases instead of capturing pathological motion. To address this, we propose BioGait-VLM, a tri-modal Vision-Language-Biomechanics framework for interpretable clinical gait assessment. Unlike standard video encoders, our architecture incorporates a Temporal Evidence Distillation branch to capture rhythmic dynamics and a Biomechanical Tokenization branch that projects 3D skeleton sequences into language-aligned semantic tokens. This enables the model to explicitly reason about joint mechanics independent of visual shortcuts. To ensure rigorous benchmarking, we augment the public GAVD dataset with a high-fidelity Degenerative Cervical Myelopathy (DCM) cohort to form a unified 8-class taxonomy, establishing a strict subject-disjoint protocol to prevent data leakage. Under this setting, BioGait-VLM achieves state-of-the-art recognition accuracy. Furthermore, a blinded expert study confirms that biomechanical tokens significantly improve clinical plausibility and evidence grounding, offering a path toward transparent, privacy-enhanced gait assessment.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
18 of 29 references.
References · 18
- 2023Visual Instruction Tuningcited by 7,869
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
- 2017Temporal Segment Networks for Action Recognition in Videoscited by 279
- 2025From Skin to Skeleton: Towards Biomechanically Accurate 3D Digital Humanscited by 27
6 more
- 2025Reconstructing Humans with a Biomechanically Accurate Skeletoncited by 22
- 2024Gait Patterns as Biomarkers: A Video-Based Approach for Classifying Scoliosiscited by 12
- 2024Computer Vision for Clinical Gait Analysis: A Gait Abnormality Video Datasetcited by 9
- 2025ProGait: A Multi-Purpose Video Dataset and Benchmark for Transfemoral Prosthesis Userscited by 3
- 2025Text-Guided Multi-Instance Learning for Scoliosis Screening via Gait Video Analysiscited by 2
- 2024Developing Normative Gait Cycle Parameters for Clinical Analysis Using Human Pose Estimationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026DrGait: Biomechanically Grounded Visual Reasoning for Interpretable Clinical Gait Analysis
- 2026BiomechAgent: AI-Assisted Biomechanical Analysis Through Code-Generating Agents
- 2025AGIR: Assessing 3D Gait Impairment with Reasoning based on LLMs
- 2024Enhancing Gait Video Analysis in Neurodegenerative Diseases by Knowledge Augmentation in Vision Language Model
- 2025The Potential and Limitations of Vision-Language Models for Human Motion Understanding: A Case Study in Data-Driven Stroke Rehabilitation
- 2025Explainable Parkinsons Disease Gait Recognition Using Multimodal RGB-D Fusion and Large Language Models
- 2025GAITGen: Disentangled Motion-Pathology Impaired Gait Generative Model -- Bringing Motion Generation to the Clinical Domain
- 2026Decoding Children's Gait Behavior