mlsanityData to 7 Oct 2026

MINT: Multimodal Imaging-to-Speech Knowledge Transfer for Early Alzheimer's Screening

arXiv 2602.23994 ↗First posted 27 Feb 2026cs.LG cs.AI cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Alzheimer's disease is a progressive neurodegenerative disorder in which mild cognitive impairment (MCI) precedes dementia. Structural MRI provides biomarkers but requires costly infrastructure, limiting population-scale deployment. Speech offers a non-invasive alternative, yet speech-only classifiers are developed independently of neuroimaging and lack biological grounding for CN-versus-MCI classification. We propose MINT (Multimodal Imaging-to-Speech Knowledge Transfer), a three-stage framework that transfers MRI-derived biomarker structure to speech during training. An MRI teacher defines a compact embedding space for CN-versus-MCI classification, while a residual projection head aligns speech representations to this space using a combined geometric loss. The frozen MRI classifier enables imaging-free inference. On ADNI-4, aligned speech achieves performance comparable to speech baselines, while multimodal fusion improves over MRI alone. Ablations identify dropout regularization and self-supervised pretraining as important design choices. To our knowledge, MINT is the first demonstration of MRI-to-speech knowledge transfer for early Alzheimer's screening without imaging at inference.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 11 of its 38 references that are in the map. First posted on arXiv 27 Feb 2026.

Builds on

11 of 38 references.

References · 11

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  6. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  7. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  8. 2024Useful Blunders: Can Automated Speech Recognition Errors Improve Downstream Dementia Classification?cited by 9
  9. 2024TE-SSL: Time and Event-aware Self Supervised Learning for Alzheimer's Disease Progression Analysiscited by 5
  10. 2023Joint Self-Supervised and Supervised Contrastive Learning for Multimodal MRI Data: Towards Predicting Abnormal Neurodevelopmentcited by 3
  11. 2025Predicting Cognitive Decline: A Multimodal AI Approach to Dementia Screening from Speechcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.