mlsanityData to 14 Oct 2026

Multi-View Imputation and Cross-Attention Network Based on Incomplete Longitudinal and Multimodal Data for Conversion Prediction of Mild Cognitive Impairment

arXiv 2206.08019 ↗First posted 16 Jun 2022eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Predicting whether subjects with mild cognitive impairment (MCI) will convert to Alzheimer's disease is a significant clinical challenge. Longitudinal variations and complementary information inherent in longitudinal and multimodal data are crucial for MCI conversion prediction, but persistent issue of missing data in these data may hinder their effective application. Additionally, conversion prediction should be achieved in the early stages of disease progression in clinical practice, specifically at baseline visit (BL). Therefore, longitudinal data should only be incorporated during training to capture disease progression information. To address these challenges, a multi-view imputation and cross-attention network (MCNet) was proposed to integrate data imputation and MCI conversion prediction in a unified framework. First, a multi-view imputation method combined with adversarial learning was presented to handle various missing data scenarios and reduce imputation errors. Second, two cross-attention blocks were introduced to exploit the potential associations in longitudinal and multimodal data. Finally, a multi-task learning model was established for data imputation, longitudinal classification, and conversion prediction tasks. When the model was appropriately trained, the disease progression information learned from longitudinal data can be leveraged by BL data to improve MCI conversion prediction at BL. MCNet was tested on two independent testing sets and single-modal BL data to verify its effectiveness and flexibility in MCI conversion prediction. Results showed that MCNet outperformed several competitive methods. Moreover, the interpretability of MCNet was demonstrated. Thus, our MCNet may be a valuable tool in longitudinal and multimodal data analysis for MCI conversion prediction. Codes are available at https://github.com/Meiyan88/MCNET.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 66 references that are in the map. First posted on arXiv 16 Jun 2022.

Builds on

8 of 66 references.

References · 8

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  3. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 803
  4. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
  5. 2019Automated brain extraction of multi-sequence MRI using artificial neural networkscited by 134
  6. 2017Estimating Missing Data in Temporal Data Streams Using Multi-directional Recurrent Neural Networkscited by 86
  7. 2019Training recurrent neural networks robust to incomplete data: application to Alzheimer's disease progression modelingcited by 14
  8. 2017MinimalRNN: Toward More Interpretable and Trainable Recurrent Neural Networkscited by 10

Built on by

Not cited yet.