mlsanityData to 14 Oct 2026

BioGait-VLM: A Tri-Modal Vision-Language-Biomechanics Framework for Interpretable Clinical Gait Assessment

arXiv 2603.08564 ↗First posted 9 Mar 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Video-based Clinical Gait Analysis often suffers from poor generalization as models overfit environmental biases instead of capturing pathological motion. To address this, we propose BioGait-VLM, a tri-modal Vision-Language-Biomechanics framework for interpretable clinical gait assessment. Unlike standard video encoders, our architecture incorporates a Temporal Evidence Distillation branch to capture rhythmic dynamics and a Biomechanical Tokenization branch that projects 3D skeleton sequences into language-aligned semantic tokens. This enables the model to explicitly reason about joint mechanics independent of visual shortcuts. To ensure rigorous benchmarking, we augment the public GAVD dataset with a high-fidelity Degenerative Cervical Myelopathy (DCM) cohort to form a unified 8-class taxonomy, establishing a strict subject-disjoint protocol to prevent data leakage. Under this setting, BioGait-VLM achieves state-of-the-art recognition accuracy. Furthermore, a blinded expert study confirms that biomechanical tokens significantly improve clinical plausibility and evidence grounding, offering a path toward transparent, privacy-enhanced gait assessment.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 9 Mar 2026.

Builds on

18 of 29 references.

References · 18

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  5. 2018SlowFast Networks for Video Recognitioncited by 1,867
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  7. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  8. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
  9. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  10. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
  11. 2017Temporal Segment Networks for Action Recognition in Videoscited by 279
  12. 2025From Skin to Skeleton: Towards Biomechanically Accurate 3D Digital Humanscited by 27
6 more
  1. 2025Reconstructing Humans with a Biomechanically Accurate Skeletoncited by 22
  2. 2024Gait Patterns as Biomarkers: A Video-Based Approach for Classifying Scoliosiscited by 12
  3. 2024Computer Vision for Clinical Gait Analysis: A Gait Abnormality Video Datasetcited by 9
  4. 2025ProGait: A Multi-Purpose Video Dataset and Benchmark for Transfemoral Prosthesis Userscited by 3
  5. 2025Text-Guided Multi-Instance Learning for Scoliosis Screening via Gait Video Analysiscited by 2
  6. 2024Developing Normative Gait Cycle Parameters for Clinical Analysis Using Human Pose Estimationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026DrGait: Biomechanically Grounded Visual Reasoning for Interpretable Clinical Gait Analysis
  2. 2026BiomechAgent: AI-Assisted Biomechanical Analysis Through Code-Generating Agents
  3. 2025AGIR: Assessing 3D Gait Impairment with Reasoning based on LLMs
  4. 2024Enhancing Gait Video Analysis in Neurodegenerative Diseases by Knowledge Augmentation in Vision Language Model
  5. 2025The Potential and Limitations of Vision-Language Models for Human Motion Understanding: A Case Study in Data-Driven Stroke Rehabilitation
  6. 2025Explainable Parkinsons Disease Gait Recognition Using Multimodal RGB-D Fusion and Large Language Models
  7. 2025GAITGen: Disentangled Motion-Pathology Impaired Gait Generative Model -- Bringing Motion Generation to the Clinical Domain
  8. 2026Decoding Children's Gait Behavior