# On the Explanation of Machine Learning Predictions in Clinical Gait Analysis

arXiv: https://arxiv.org/abs/1912.07737 · HTML: https://mlsanity.com/paper/1912.07737/

## Key facts

- Cited by 15 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 Dec 2019.

## Built on by (most cited first, 15 of 15)

- [Software for Dataset-wide XAI: From Local Explanations to Global Insights with Zennit, CoRelAy, and ViRelAy](https://mlsanity.com/paper/2106.13200/) (2021)
- [Explainable AI for clinical and remote health applications: a survey on tabular and time series data](https://mlsanity.com/paper/2209.06528/) (2022)
- [Explainable AI for Time Series via Virtual Inspection Layers](https://mlsanity.com/paper/2303.06365/) (2023)
- [Explaining Predictive Uncertainty by Exposing Second-Order Effects](https://mlsanity.com/paper/2401.17441/) (2024)
- [How Human-Centered Explainable AI Interface Are Designed and Evaluated: A Systematic Survey](https://mlsanity.com/paper/2403.14496/) (2024)
- [Trustworthy Visual Analytics in Clinical Gait Analysis: A Case Study for Patients with Cerebral Palsy](https://mlsanity.com/paper/2208.05232/) (2022)
- [MicroXercise: A Micro-Level Comparative and Explainable System for Remote Physical Therapy](https://mlsanity.com/paper/2408.11837/) (2024)
- [Ensuring Medical AI Safety: Interpretability-Driven Detection and Mitigation of Spurious Model Behavior and Associated Data](https://mlsanity.com/paper/2501.13818/) (2025)
- [Exploring the Plausibility of Hate and Counter Speech Detectors with Explainable AI](https://mlsanity.com/paper/2407.20274/) (2024)
- [Machine Learning in Biomechanics: Key Applications and Limitations in Walking, Running, and Sports Movements](https://mlsanity.com/paper/2503.03717/) (2025)
- [Classification of anomalous gait using Machine Learning techniques and embedded sensors](https://mlsanity.com/paper/2110.06139/) (2021)
- [MA^2: A Self-Supervised and Motion Augmenting Autoencoder for Gait-Based Automatic Disease Detection](https://mlsanity.com/paper/2411.03129/) (2024)
- [Outlier Detection in Plantar Pressure: Human-Centered Comparison of Statistical Parametric Mapping and Explainable Machine Learning](https://mlsanity.com/paper/2509.21943/) (2025)
- [Explainable Machine-Learning based Detection of Knee Injuries in Runners](https://mlsanity.com/paper/2602.11668/) (2026)
- [On the Role of Inductive Bias in Time-Series Pretraining: A Case Study in Learning Generalizable Representations for Clinical Time Series](https://mlsanity.com/paper/2605.26194/) (2026)

## Abstract (arXiv)

Machine learning (ML) is increasingly used to support decision-making in the healthcare sector. While ML approaches provide promising results with regard to their classification performance, most share a central limitation, namely their black-box character. Motivated by the interest to understand the functioning of ML models, methods from the field of Explainable Artificial Intelligence (XAI) have recently become important. This article investigates the usefulness of XAI methods in clinical gait classification. For this purpose, predictions of state-of-the-art classification methods are explained with an established XAI method, i.e., Layer-wise Relevance Propagation (LRP). We propose to evaluate the obtained explanations with two complementary approaches: a statistical analysis of the underlying data using Statistical Parametric Mapping and a qualitative evaluation by a clinical expert. A gait dataset comprising ground reaction force measurements from 132 patients with different lower-body gait disorders and 62 healthy controls is utilized. We investigate several gait classification tasks, employ multiple classification methods, and analyze the impact of data normalization and different signal components for classification performance and explanation quality. Our experiments show that explanations obtained by LRP exhibit promising statistical properties concerning inter-class discriminativity and are also in line with clinically relevant biomechanical gait characteristics.