MINT: Multimodal Imaging-to-Speech Knowledge Transfer for Early Alzheimer's Screening
Not on the map. Why?
Abstract (arXiv)
Alzheimer's disease is a progressive neurodegenerative disorder in which mild cognitive impairment (MCI) precedes dementia. Structural MRI provides biomarkers but requires costly infrastructure, limiting population-scale deployment. Speech offers a non-invasive alternative, yet speech-only classifiers are developed independently of neuroimaging and lack biological grounding for CN-versus-MCI classification. We propose MINT (Multimodal Imaging-to-Speech Knowledge Transfer), a three-stage framework that transfers MRI-derived biomarker structure to speech during training. An MRI teacher defines a compact embedding space for CN-versus-MCI classification, while a residual projection head aligns speech representations to this space using a combined geometric loss. The frozen MRI classifier enables imaging-free inference. On ADNI-4, aligned speech achieves performance comparable to speech baselines, while multimodal fusion improves over MRI alone. Ablations identify dropout regularization and self-supervised pretraining as important design choices. To our knowledge, MINT is the first demonstration of MRI-to-speech knowledge transfer for early Alzheimer's screening without imaging at inference.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 38 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
11 of 38 references.
References · 11
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2024Useful Blunders: Can Automated Speech Recognition Errors Improve Downstream Dementia Classification?cited by 9
- 2024TE-SSL: Time and Event-aware Self Supervised Learning for Alzheimer's Disease Progression Analysiscited by 5
- 2023Joint Self-Supervised and Supervised Contrastive Learning for Multimodal MRI Data: Towards Predicting Abnormal Neurodevelopmentcited by 3
- 2025Predicting Cognitive Decline: A Multimodal AI Approach to Dementia Screening from Speechcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.