Label-Free Parkinson's Disease Screening from Face and Voice through Mechanistic Interpretability
On the map: Mechanistic interpretability → Interpreting biomedical and science models
Abstract (arXiv)
Parkinson's disease (PD) is the second most common neurodegenerative disorder. Typical machine learning screening methods require PD labels, but the available data is limited by privacy concerns and the need for expert annotation. We propose a label-free face-plus-voice PD screen built entirely on frozen pretrained encoders--a face-expression Vision Transformer and HuBERT--in which no PD label touches any fit; the reference is training controls only. The voice modality uses a synthetic-dysarthria contrastive activation addition (CAA) direction built from time-stretch and breathy degradation of healthy speech; the face modality uses a k-nearest-neighbor anomaly score to the control embedding cluster. We introduce the alignment principle, a post-hoc analysis showing that a synthetic-degradation CAA detector works when the cosine similarity between the synthetic and real disease directions exceeds zero. Measured on the YouTubePD benchmark, this cosine is +0.37 for voice (CAA works, AUROC 0.765) and -0.48 for face (CAA fails; anomaly succeeds, AUROC 0.751). Equal-weight late fusion reaches AUROC 0.802 (95% CI [0.70,0.89]) with NPV 0.95, supporting a rule-out triage interpretation. An overfitting audit shows the voice detector transfers cleanly, while the face-side--and thus fused--AUROC is potentially optimistic pending external validation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Interpreting biomedical and science models, one of 13 directions in Mechanistic interpretability. Builds on 14 of its 25 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
14 of 25 references.
References · 14
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
- 2013Challenges in Representation Learning: A report on three machine learning contestscited by 302
- 2020Deep Nearest Neighbor Anomaly Detectioncited by 104
- 2019Real-time Facial Surface Geometry from Monocular Video on Mobile GPUscited by 73
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Zero-Shot Parkinson's Disease Detection from Speech: Comparing Large Audio and Language Models
- 2025From Black Box to Biomarker: Sparse Autoencoders for Interpreting Speech Models of Parkinson's Disease
- 2026Unifying Acoustic Features and Text with Multimodal LLMs for Neurodegenerative Screening
- 2025National Institute on Aging PREPARE Challenge: Early Detection of Cognitive Impairment Using Speech -- The SpeechCARE Solution
- 2025NeuroXVocal: Detection and Explanation of Alzheimer's Disease through Non-invasive Analysis of Picture-prompted Speech
- 2025Automatic Screening of Parkinson's Disease from Visual Explorations
- 2025Improved Intelligibility of Dysarthric Speech using Conditional Flow Matching
- 2025Understanding Dementia Speech Alignment with Diffusion-Based Image Generation