Unveiling Interpretability in Self-Supervised Speech Representations for Parkinson's Diagnosis
Not on the map. Why?
Abstract (arXiv)
Recent works in pathological speech analysis have increasingly relied on powerful self-supervised speech representations, leading to promising results. However, the complex, black-box nature of these embeddings and the limited research on their interpretability significantly restrict their adoption for clinical diagnosis. To address this gap, we propose a novel, interpretable framework specifically designed to support Parkinson's Disease (PD) diagnosis. Through the design of simple yet effective cross-attention mechanisms for both embedding- and temporal-level analysis, the proposed framework offers interpretability from two distinct but complementary perspectives. Experimental findings across five well-established speech benchmarks for PD detection demonstrate the framework's capability to identify meaningful speech patterns within self-supervised representations for a wide range of assessment tasks. Fine-grained temporal analyses further underscore its potential to enhance the interpretability of deep-learning pathological speech models, paving the way for the development of more transparent, trustworthy, and clinically applicable computer-assisted diagnosis systems in this domain. Moreover, in terms of classification accuracy, our method achieves results competitive with state-of-the-art approaches, while also demonstrating robustness in cross-lingual scenarios when applied to spontaneous speech production.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 12 of its 86 references that are in the map. First posted on arXiv 2 Dec 2024.
Builds on
12 of 86 references.
References · 12
- 2017Attention Is All You Needcited by 59,932
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2019Attention is not Explanationcited by 916
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
- 2021Layer-wise Analysis of a Self-supervised Speech Representation Modelcited by 293
- 2022Comparative layer-wise analysis of self-supervised speech modelscited by 155
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Taskscited by 70
- 2022Detecting Dysfluencies in Stuttering Therapy Using wav2vec 2.0cited by 26
- 2022TRILLsson: Distilled Universal Paralinguistic Speech Representationscited by 16
- 2024NeuroVoz: a Castillian Spanish corpus of parkinsonian speechcited by 13
- 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cuescited by 11
- 2022Multi-class Detection of Pathological Speech with Latent Features: How does it perform on unseen data?cited by 4
Built on by
Citing papers per year: 2025: 3; 2026: 5.
8 papers.
- 2025Evaluating the Usefulness of Non-Diagnostic Speech Data for Developing Parkinson's Disease Classifierscited by 2
- 2025RECA-PD: A Robust Explainable Cross-Attention Method for Speech-based Parkinson's Disease Classificationcited by 1
- 2025From Black Box to Biomarker: Sparse Autoencoders for Interpreting Speech Models of Parkinson's Diseasecited by 1
- 2026The Role of Prosodic and Lexical Cues in Turn-Taking with Self-Supervised Speech Representationscited by 1
- 2026SAND: The Challenge on Speech Analysis for Neurodegenerative Disease Assessmentcited by 0
- 2026A Benchmark for Early-stage Parkinson's Disease Detection from Speechcited by 0
- 2026Multi-View Speech Representation Learning for Parkinson's Disease Detection Using Context-guided Cross-modal Attentioncited by 0
- 2026Cross-Lingual Parkinson's Disease Severity Assessment Using Pre-trained Speech Embeddings: A Multi-Class Evaluationcited by 0
- 2026Cross-Lingual Parkinson's Disease Severity Assessment Using Pre-trained Speech Embeddings: A Multi-Class Evaluation16 Sep 2026
- 2026Multi-View Speech Representation Learning for Parkinson's Disease Detection Using Context-guided Cross-modal Attention8 Jun 2026
- 2026A Benchmark for Early-stage Parkinson's Disease Detection from Speech13 May 2026
- 2026SAND: The Challenge on Speech Analysis for Neurodegenerative Disease Assessment7 Apr 2026
- 2026The Role of Prosodic and Lexical Cues in Turn-Taking with Self-Supervised Speech Representations20 Jan 2026
- 2025From Black Box to Biomarker: Sparse Autoencoders for Interpreting Speech Models of Parkinson's Disease16 Jul 2025
- 2025RECA-PD: A Robust Explainable Cross-Attention Method for Speech-based Parkinson's Disease Classification4 Jul 2025
- 2025Evaluating the Usefulness of Non-Diagnostic Speech Data for Developing Parkinson's Disease Classifiers24 May 2025