mlsanityData to 7 Oct 2026

MuSe-GNN: Learning Unified Gene Representation From Multimodal Biological Graph Data

arXiv 2310.02275 ↗First posted 29 Sep 2023cs.LG q-bio.GNcited by 14

Not on the map. Why?

Abstract (arXiv)

Discovering genes with similar functions across diverse biomedical contexts poses a significant challenge in gene representation learning due to data heterogeneity. In this study, we resolve this problem by introducing a novel model called Multimodal Similarity Learning Graph Neural Network, which combines Multimodal Machine Learning and Deep Graph Neural Networks to learn gene representations from single-cell sequencing and spatial transcriptomic data. Leveraging 82 training datasets from 10 tissues, three sequencing techniques, and three species, we create informative graph structures for model training and gene representations generation, while incorporating regularization with weighted similarity learning and contrastive learning to learn cross-data gene-gene relationships. This novel design ensures that we can offer gene representations containing functional similarity across different contexts in a joint space. Comprehensive benchmarking analysis shows our model's capacity to effectively capture gene function similarity across multiple modalities, outperforming state-of-the-art methods in gene representation learning by up to 97.5%. Moreover, we employ bioinformatics tools in conjunction with gene representations to uncover pathway enrichment, regulation causal networks, and functions of disease-associated or dosage-sensitive genes. Therefore, our model efficiently produces unified gene representations for the analysis of gene functions, tissue functions, diseases, and species evolution.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 31 of its 116 references that are in the map. First posted on arXiv 29 Sep 2023.

Builds on

31 of 116 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Graph Attention Networkscited by 8,854
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  8. 2017Inductive Representation Learning on Large Graphscited by 6,284
  9. 2018How Powerful are Graph Neural Networks?cited by 4,355
  10. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  11. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  12. 2016Variational Graph Auto-Encoderscited by 1,373
19 more
  1. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  2. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
  3. 2020Deep Graph Contrastive Representation Learningcited by 535
  4. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 500
  5. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  6. 2018From Louvain to Leiden: guaranteeing well-connected communitiescited by 379
  7. 2020Few-Shot Learning via Learning the Representation, Provablycited by 213
  8. 2020Graph Neural Networks with Heterophilycited by 202
  9. 2020On the Theory of Transfer Learning: The Importance of Task Diversitycited by 186
  10. 2020Provable Meta-Learning of Linear Representationscited by 161
  11. 2021What Makes Multi-modal Learning Better than Single (Provably)cited by 151
  12. 2017Predicting multicellular function through multi-layer tissue networkscited by 138
  13. 2023Rethinking the Expressive Power of GNNs via Graph Biconnectivitycited by 119
  14. 2020GraphNorm: A Principled Approach to Accelerating Graph Neural Network Trainingcited by 116
  15. 2019Auto-GNN: Neural Architecture Search of Graph Neural Networkscited by 73
  16. 2020VD-BERT: A Unified Vision and Dialog Transformer with BERTcited by 54
  17. 2022Multimodal learning with graphscited by 54
  18. 2020Multi-hop Attention Graph Neural Networkcited by 53
  19. 2021A Generalizable Model-and-Data Driven Approach for Open-Set RFF Authenticationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 7; 2026: 1.

14 papers.

Sort:

By area: