From Classical Machine Learning to Emerging Foundation Models: Review on Multimodal Data Integration for Cancer Research
Not on the map. Why?
Abstract (arXiv)
Cancer research is increasingly driven by the integration of diverse data modalities, spanning from genomics and proteomics to imaging and clinical factors. However, extracting actionable insights from these vast and heterogeneous datasets remains a key challenge. The rise of foundation models (FMs) -- large deep-learning models pretrained on extensive amounts of data serving as a backbone for a wide range of downstream tasks -- offers new avenues for discovering biomarkers, improving diagnosis, and personalizing treatment. This paper presents a comprehensive review of widely adopted integration strategies of multimodal data to assist advance the computational approaches for data-driven discoveries in oncology. We examine emerging trends in machine learning (ML) and deep learning (DL), including methodological frameworks, validation protocols, and open-source resources targeting cancer subtype classification, biomarker discovery, treatment guidance, and outcome prediction. This study also comprehensively covers the shift from traditional ML to FMs for multimodal integration. We present a holistic view of recent FMs advancements and challenges faced during the integration of multi-omics with advanced imaging data. We identify the state-of-the-art FMs, publicly available multi-modal repositories, and advanced tools and methods for data integration. We argue that current state-of-the-art integrative methods provide the essential groundwork for developing the next generation of large-scale, pre-trained models poised to further revolutionize oncology. To the best of our knowledge, this is the first review to systematically map the transition from conventional ML to advanced FM for multimodal data integration in oncology, while also framing these developments as foundational for the forthcoming era of large-scale AI models in cancer research.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 30 of its 221 references that are in the map. First posted on arXiv 11 Jul 2025.
Builds on
30 of 221 references.
References · 30
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 199
- 2019Pathomic Fusion: An Integrated Framework for Fusing Histopathology and Genomic Features for Cancer Diagnosis and Prognosiscited by 165
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 162
- 2024HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysiscited by 107
- 2024Segment Anything Model for Medical Image Segmentation: Current Applications and Future Directionscited by 97
- 2024Advancing Multimodal Medical Capabilities of Geminicited by 90
- 2024PRISM: A Multi-Modal Generative Foundation Model for Slide-Level Histopathologycited by 85
- 2022Federated Learning Enables Big Data for Rare Cancer Boundary Detectioncited by 84
- 2023MolFM: A Multimodal Molecular Foundation Modelcited by 50
18 more
- 2024Recent Advances of Foundation Language Models-based Continual Learning: A Surveycited by 46
- 2024RudolfV: A Foundation Model by Pathologists for Pathologistscited by 41
- 2017Deep Generalized Canonical Correlation Analysiscited by 33
- 2023Pathology-and-genomics Multimodal Transformer for Survival Outcome Predictioncited by 32
- 2024Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillationcited by 31
- 2024scDiffusion: conditional generation of high-quality single-cell data using diffusion modelcited by 24
- 2024STimage-1K4M: A histopathology image-gene expression dataset for spatial transcriptomicscited by 23
- 2019Improving Missing Data Imputation with Deep Generative Modelscited by 19
- 2020Multimodal Spatial Attention Module for Targeting Multimodal PET-CT Lung Tumor Segmentationcited by 19
- 2024PLUTO: Pathology-Universal Transformercited by 17
- 2022Learning to Predict RNA Sequence Expressions from Whole Slide Images with Applications for Search and Classificationcited by 14
- 2024Multimodal Data Integration for Precision Oncology: Challenges and Future Directionscited by 10
- 2022CustOmics: A versatile deep-learning based strategy for multi-omics integrationcited by 6
- 2023Interpretable Deep Learning Methods for Multiview Learningcited by 5
- 2024Path-GPTOmic: A Balanced Multi-modal Learning Framework for Survival Outcome Predictioncited by 5
- 2022SDGCCA: Supervised Deep Generalized Canonical Correlation Analysis for Multi-omics Integrationcited by 3
- 2025Fair Foundation Models for Medical Image Analysis: Challenges and Perspectivescited by 3
- 2023Improving diagnosis and prognosis of lung cancer using vision transformers: A scoping reviewcited by 2
Built on by
Citing papers per year: 2025: 4; 2026: 2.
6 papers.
- 2025MorphGen: Morphology-Guided Representation Learning for Robust Single-Domain Generalization in Histopathological Cancer Classificationcited by 2
- 2025Foundation Models in Biomedical Imaging: Turning Hype into Realitycited by 2
- 2025The Next Layer: Augmenting Foundation Models with Structure-Preserving and Attention-Guided Learning for Local Patches to Global Context Awareness in Computational Pathologycited by 0
- 2025Deep Learning-Based Computer Vision Models for Early Cancer Detection Using Multimodal Medical Imaging and Radiogenomic Integration Frameworkscited by 0
- 2026CARL-CXR: Continual Adapter-Based Routing for Task-Unknown Chest Radiograph Classificationcited by 0
- 2026Towards Responsible Multimodal Medical Reasoning via Context-Aligned Vision-Language Modelscited by 0
- 2026Towards Responsible Multimodal Medical Reasoning via Context-Aligned Vision-Language Models9 Apr 2026
- 2026CARL-CXR: Continual Adapter-Based Routing for Task-Unknown Chest Radiograph Classification17 Feb 2026
- 2025Foundation Models in Biomedical Imaging: Turning Hype into Reality17 Dec 2025
- 2025Deep Learning-Based Computer Vision Models for Early Cancer Detection Using Multimodal Medical Imaging and Radiogenomic Integration Frameworks30 Nov 2025
- 2025MorphGen: Morphology-Guided Representation Learning for Robust Single-Domain Generalization in Histopathological Cancer Classification30 Aug 2025
- 2025The Next Layer: Augmenting Foundation Models with Structure-Preserving and Attention-Guided Learning for Local Patches to Global Context Awareness in Computational Pathology27 Aug 2025