Multimodal Visual Surrogate Compression for Alzheimer's Disease Classification
Not on the map. Why?
Abstract (arXiv)
High-dimensional structural MRI (sMRI) images are widely used for Alzheimer's Disease (AD) diagnosis. Most existing methods for sMRI representation learning rely on 3D architectures (e.g., 3D CNNs), slice-wise feature extraction with late aggregation, or apply training-free feature extractions using 2D foundation models (e.g., DINO). However, these three paradigms suffer from high computational cost, loss of cross-slice relations, and limited ability to extract discriminative features, respectively. To address these challenges, we propose Multimodal Visual Surrogate Compression (MVSC). It learns to compress and adapt large 3D sMRI volumes into compact 2D features, termed as visual surrogates, which are better aligned with frozen 2D foundation models to extract powerful representations for final AD classification. MVSC has two key components: a Volume Context Encoder that captures global cross-slice context under textual guidance, and an Adaptive Slice Fusion module that aggregates slice-level information in a text-enhanced, patch-wise manner. Extensive experiments on three large-scale Alzheimer's disease benchmarks demonstrate our MVSC performs favourably on both binary and multi-class classification tasks compared against state-of-the-art methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 47 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
24 of 47 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 703
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
- 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 235
- 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 210
- 2022SynthStrip: Skull-Stripping for Any Brain Imagecited by 126
12 more
- 2024Merlin: A Computed Tomography Vision-Language Foundation Model and Datasetcited by 97
- 2024VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imagingcited by 62
- 2024Enhancing Spatiotemporal Disease Progression Models via Latent Diffusion and Prior Knowledgecited by 35
- 2021PyTorchVideo: A Deep Learning Library for Video Understandingcited by 32
- 2025Brain Harmony: A Multimodal Foundation Model Unifying Morphology and Function into 1D Tokenscited by 15
- 2025Raptor: Scalable Train-Free Embeddings for 3D Medical Volumes Leveraging Pretrained 2D Foundation Modelscited by 13
- 2023Longformer: Longitudinal Transformer for Alzheimer's Disease Classification with Structural MRIscited by 12
- 2025MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representationscited by 11
- 2025Towards Generalisable Foundation Models for Brain MRIcited by 8
- 2024AXIAL: Attention-based eXplainability for Interpretable Alzheimer's Localized Diagnosis using 2D CNNs on 3D MRI brain scanscited by 4
- 2025DinoAtten3D: Slice-Level Attention Aggregation of DinoV2 for 3D Brain MRI Anomaly Classificationcited by 3
- 2025TomoGraphView: 3D Medical Image Classification with Omnidirectional Slice Representations and Graph Neural Networkscited by 1
Built on by
Not cited yet.