Multimodal Learning for Multi-Omics: A Survey
Not on the map. Why?
Abstract (arXiv)
With advanced imaging, sequencing, and profiling technologies, multiple omics data become increasingly available and hold promises for many healthcare applications such as cancer diagnosis and treatment. Multimodal learning for integrative multi-omics analysis can help researchers and practitioners gain deep insights into human diseases and improve clinical decisions. However, several challenges are hindering the development in this area, including the availability of easily accessible open-source tools. This survey aims to provide an up-to-date overview of the data challenges, fusion approaches, datasets, and software tools from several new perspectives. We identify and investigate various omics data challenges that can help us understand the field better. We categorize fusion approaches comprehensively to cover existing methods in this area. We collect existing open-source tools to facilitate their broader utilization and development. We explore a broad range of omics data modalities and a list of accessible datasets. Finally, we summarize future directions that can potentially address existing gaps and answer the pressing need to advance multimodal learning for multi-omics data analysis.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 24 of its 279 references that are in the map. First posted on arXiv 29 Nov 2022.
Builds on
24 of 279 references.
References · 24
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
- 2022Multimodal Learning with Transformers: A Surveycited by 399
- 2017Gated Multimodal Units for Information Fusioncited by 244
- 2016MOSI: Multimodal Corpus of Sentiment Intensity and Subjectivity Analysis in Online Opinion Videoscited by 193
- 2019Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)cited by 173
- 2021MultiBench: Multiscale Benchmarks for Multimodal Representation Learningcited by 143
- 2019UR-FUNNY: A Multimodal Language Dataset for Understanding Humorcited by 130
- 2018CentralNet: a Multilayer Approach for Multimodal Fusioncited by 86
- 2019Multimodal Transformer with Multi-View Visual Representation for Image Captioningcited by 86
- 2019Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Taskscited by 80
- 2021Graph Representation Learning in Biomedicinecited by 79
12 more
- 2018Multimodal Language Analysis with Recurrent Multistage Fusioncited by 43
- 2015Deep Multimodal Learning for Audio-Visual Speech Recognitioncited by 37
- 2020Multimodal Sensor Fusion with Differentiable Filterscited by 29
- 2017Structural Learning and Integrative Decomposition of Multi-View Datacited by 20
- 2021Cooperative learning for multiview analysiscited by 19
- 2019A Comprehensive Overview of Biometric Fusioncited by 18
- 2015Tensor Factorization via Matrix Factorizationcited by 15
- 2019Multimodal Deep Learning for Finance: Integrating and Forecasting International Stock Marketscited by 15
- 2019Integrated Multi-omics Analysis Using Variational Autoencoders: Application to Pan-cancer Classificationcited by 14
- 2020GripNet: Graph Information Propagation on Supergraph for Heterogeneous Graphscited by 4
- 2019Adventures in Multi-Omics I: Combining heterogeneous data sets via relationships matricescited by 1
- 2021Graph Representation Learning on Tissue-Specific Multi-Omicscited by 1
Built on by
Citing papers per year: 2024: 2; 2025: 1.
3 papers.