Unified Acoustic Representations for Screening Neurological and Respiratory Pathologies from Voice
Not on the map. Why?
Abstract (arXiv)
Voice-based health assessment offers unprecedented opportunities for scalable, non-invasive disease screening, yet existing approaches typically focus on single conditions and fail to leverage the rich, multi-faceted information embedded in speech. We present MARVEL (Multi-task Acoustic Representations for Voice-based Health Analysis), a privacy-conscious multitask learning framework that simultaneously detects nine distinct neurological, respiratory, and voice disorders using only derived acoustic features, eliminating the need for raw audio transmission. Our dual-branch architecture employs specialized encoders with task-specific heads sharing a common acoustic backbone, enabling effective cross-condition knowledge transfer. Evaluated on the large-scale Bridge2AI-Voice v2.0 dataset, MARVEL achieves an overall AUROC of 0.78, with exceptional performance on neurological disorders (AUROC = 0.89), particularly for Alzheimer's disease/mild cognitive impairment (AUROC = 0.97). Our framework consistently outperforms single-modal baselines by 5-19% and surpasses state-of-the-art self-supervised models on 7 of 9 tasks, while correlation analysis reveals that the learned representations exhibit meaningful similarities with established acoustic features, indicating that the model's internal representations are consistent with clinically recognized acoustic patterns. By demonstrating that a single unified model can effectively screen for diverse conditions, this work establishes a foundation for deployable voice-based diagnostics in resource-constrained and remote healthcare settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 49 references that are in the map. First posted on arXiv 28 Aug 2025.
Builds on
12 of 49 references.
References · 12
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
- 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 192
- 2021Detecting cognitive decline using speech only: The ADReSSo Challengecited by 81
- 2021Pseudo-Labeling for Massively Multilingual Speech Recognitioncited by 24
- 2022Investigating Self-supervised Pretraining Frameworks for Pathological Speech Recognitioncited by 15
- 2018The Effectiveness of Multitask Learning for Phenotyping with Electronic Health Records Datacited by 6
- 2020Convolutional Neural Networks and a Transfer Learning Strategy to Classify Parkinson's Disease from Speech in Three Different Languagescited by 5
Built on by
Not cited yet.