mlsanityData to 7 Oct 2026

Unveiling Interpretability in Self-Supervised Speech Representations for Parkinson's Diagnosis

arXiv 2412.02006 ↗First posted 2 Dec 2024cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Recent works in pathological speech analysis have increasingly relied on powerful self-supervised speech representations, leading to promising results. However, the complex, black-box nature of these embeddings and the limited research on their interpretability significantly restrict their adoption for clinical diagnosis. To address this gap, we propose a novel, interpretable framework specifically designed to support Parkinson's Disease (PD) diagnosis. Through the design of simple yet effective cross-attention mechanisms for both embedding- and temporal-level analysis, the proposed framework offers interpretability from two distinct but complementary perspectives. Experimental findings across five well-established speech benchmarks for PD detection demonstrate the framework's capability to identify meaningful speech patterns within self-supervised representations for a wide range of assessment tasks. Fine-grained temporal analyses further underscore its potential to enhance the interpretability of deep-learning pathological speech models, paving the way for the development of more transparent, trustworthy, and clinically applicable computer-assisted diagnosis systems in this domain. Moreover, in terms of classification accuracy, our method achieves results competitive with state-of-the-art approaches, while also demonstrating robustness in cross-lingual scenarios when applied to spontaneous speech production.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 12 of its 86 references that are in the map. First posted on arXiv 2 Dec 2024.

Builds on

12 of 86 references.

References · 12

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  3. 2019Attention is not Explanationcited by 916
  4. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  5. 2021Layer-wise Analysis of a Self-supervised Speech Representation Modelcited by 293
  6. 2022Comparative layer-wise analysis of self-supervised speech modelscited by 155
  7. 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Taskscited by 70
  8. 2022Detecting Dysfluencies in Stuttering Therapy Using wav2vec 2.0cited by 26
  9. 2022TRILLsson: Distilled Universal Paralinguistic Speech Representationscited by 16
  10. 2024NeuroVoz: a Castillian Spanish corpus of parkinsonian speechcited by 13
  11. 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cuescited by 11
  12. 2022Multi-class Detection of Pathological Speech with Latent Features: How does it perform on unseen data?cited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 5.

8 papers.