mlsanityData to 7 Oct 2026

AT-Attn: Temporal-Aware Cross-Attention for Longitudinal Multimodal Alzheimer's Disease Diagnosis

arXiv 2607.07091 ↗First posted 8 Jul 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In longitudinal Alzheimer's disease (AD) diagnosis support, clinical and imaging information is often collected at irregular visits. Integrating these multimodal observations may improve diagnostic assessment, but naive fusion can degrade performance when MRI is noisy or intermittently unavailable. We propose AT-Attn, a temporal-aware multimodal framework that combines Change-and-Time encoding, time-biased asymmetric cross-attention, and gated fusion to integrate MRI with longitudinal clinical information. We evaluate AT-Attn on an MRI-retained ADNI cohort of 1,520 patients using structural MRI, six cognitive-scale trajectories, and seven static clinical variables under patient-level five-fold cross-validation. The main asymmetric AT-Attn model achieves accuracy 0.719+/-0.024, macro F1 0.721+/-0.023, ROC-AUC 0.873+/-0.013, and PR-AUC 0.783+/-0.018, outperforming unimodal and naive multimodal fusion baselines while remaining competitive with strong tabular baselines. These results suggest that a temporal-aware and constrained fusion strategy can help structural MRI contribute clinically relevant complementary information for patient-level AD diagnosis support.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 46 references that are in the map. First posted on arXiv 8 Jul 2026.

Builds on

12 of 46 references.

References · 12

  1. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  2. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 548
  3. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
  4. 2019What Makes Training Multi-Modal Classification Networks Hard?cited by 340
  5. 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 288
  6. 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 282
  7. 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 259
  8. 2021Multi-Time Attention Networks for Irregularly Sampled Time Seriescited by 234
  9. 2019GRU-ODE-Bayes: Continuous modeling of sporadically-observed time seriescited by 230
  10. 2016Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequencescited by 98
  11. 2024TA-RNN: an Attention-based Time-aware Recurrent Neural Network Architecture for Electronic Health Recordscited by 6
  12. 2024DiaMond: Dementia Diagnosis with Multi-Modal Vision Transformers Using MRI and PETcited by 6

Built on by

Not cited yet.