MuSe-GNN: Learning Unified Gene Representation From Multimodal Biological Graph Data
Not on the map. Why?
Abstract (arXiv)
Discovering genes with similar functions across diverse biomedical contexts poses a significant challenge in gene representation learning due to data heterogeneity. In this study, we resolve this problem by introducing a novel model called Multimodal Similarity Learning Graph Neural Network, which combines Multimodal Machine Learning and Deep Graph Neural Networks to learn gene representations from single-cell sequencing and spatial transcriptomic data. Leveraging 82 training datasets from 10 tissues, three sequencing techniques, and three species, we create informative graph structures for model training and gene representations generation, while incorporating regularization with weighted similarity learning and contrastive learning to learn cross-data gene-gene relationships. This novel design ensures that we can offer gene representations containing functional similarity across different contexts in a joint space. Comprehensive benchmarking analysis shows our model's capacity to effectively capture gene function similarity across multiple modalities, outperforming state-of-the-art methods in gene representation learning by up to 97.5%. Moreover, we employ bioinformatics tools in conjunction with gene representations to uncover pathway enrichment, regulation causal networks, and functions of disease-associated or dosage-sensitive genes. Therefore, our model efficiently produces unified gene representations for the analysis of gene functions, tissue functions, diseases, and species evolution.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 31 of its 116 references that are in the map. First posted on arXiv 29 Sep 2023.
Builds on
31 of 116 references.
References · 31
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2016Variational Graph Auto-Encoderscited by 1,373
19 more
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 500
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
- 2018From Louvain to Leiden: guaranteeing well-connected communitiescited by 379
- 2020Few-Shot Learning via Learning the Representation, Provablycited by 213
- 2020Graph Neural Networks with Heterophilycited by 202
- 2020On the Theory of Transfer Learning: The Importance of Task Diversitycited by 186
- 2020Provable Meta-Learning of Linear Representationscited by 161
- 2021What Makes Multi-modal Learning Better than Single (Provably)cited by 151
- 2017Predicting multicellular function through multi-layer tissue networkscited by 138
- 2023Rethinking the Expressive Power of GNNs via Graph Biconnectivitycited by 119
- 2020GraphNorm: A Principled Approach to Accelerating Graph Neural Network Trainingcited by 116
- 2019Auto-GNN: Neural Architecture Search of Graph Neural Networkscited by 73
- 2020VD-BERT: A Unified Vision and Dialog Transformer with BERTcited by 54
- 2022Multimodal learning with graphscited by 54
- 2020Multi-hop Attention Graph Neural Networkcited by 53
- 2021A Generalizable Model-and-Data Driven Approach for Open-Set RFF Authenticationcited by 7
Built on by
Citing papers per year: 2024: 6; 2025: 7; 2026: 1.
14 papers.
Sort:
By area:
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Visioncited by 37
- 2024Towards Graph Contrastive Learning: A Survey and Beyondcited by 26
- 2025CellForge: Agentic Design of Virtual Cell Modelscited by 11
- 2024Multimodal Data Integration for Precision Oncology: Challenges and Future Directionscited by 10
- 2025Graph Data Selection for Domain Adaptation: A Model-Free Approachcited by 7
- 2024DELTA: Dual Consistency Delving with Topological Uncertainty for Active Graph Domain Adaptationcited by 2
- 2025Double-Bounded Nonlinear Optimal Transport for Size Constrained Min Cut Clusterincited by 1
- 2025Multi-Omics Analysis for Cancer Subtype Inference via Unrolling Graph Smoothness Priorscited by 1
- 2024Data-Error Scaling Laws in Machine Learning on Combinatorial Mutation-prone Sets: Proteins and Small Moleculescited by 0
- 2024SFR-GNN: Simple and Fast Robust GNNs against Structural Attackscited by 0
- 2024Seeking the Sufficiency and Necessity Causal Features in Multimodal Representation Learningcited by 0
- 2025Supervised Graph Contrastive Learning for Gene Regulatory Networkscited by 0
- 2026GRAFT: Biological Graph and Hypergraph Benchmarks for Linked Gene Expression and Phenotypic Trait Prediction in Arabidopsis thaliana25 Jun 2026
- 2025SEASONED: Semantic-Enhanced Self-Counterfactual Explainable Detection of Adversarial Exploiter Contracts6 Sep 2025
- 2025Multi-Omics Analysis for Cancer Subtype Inference via Unrolling Graph Smoothness Priors8 Aug 2025
- 2025CellForge: Agentic Design of Virtual Cell Models4 Aug 2025
- 2025Supervised Graph Contrastive Learning for Gene Regulatory Networks23 May 2025
- 2025Graph Data Selection for Domain Adaptation: A Model-Free Approach22 May 2025
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Vision3 Apr 2025
- 2025Double-Bounded Nonlinear Optimal Transport for Size Constrained Min Cut Clusterin30 Jan 2025
- 2024DELTA: Dual Consistency Delving with Topological Uncertainty for Active Graph Domain Adaptation13 Sep 2024
- 2024Seeking the Sufficiency and Necessity Causal Features in Multimodal Representation Learning29 Aug 2024
- 2024SFR-GNN: Simple and Fast Robust GNNs against Structural Attacks29 Aug 2024
- 2024Multimodal Data Integration for Precision Oncology: Challenges and Future Directions28 Jun 2024
- 2025CellForge: Agentic Design of Virtual Cell Modelscited by 11
- 2025CellForge: Agentic Design of Virtual Cell Models4 Aug 2025
- 2024Towards Graph Contrastive Learning: A Survey and Beyondcited by 26
- 2024Multimodal Data Integration for Precision Oncology: Challenges and Future Directionscited by 10
- 2025Graph Data Selection for Domain Adaptation: A Model-Free Approachcited by 7
- 2024DELTA: Dual Consistency Delving with Topological Uncertainty for Active Graph Domain Adaptationcited by 2
- 2025Double-Bounded Nonlinear Optimal Transport for Size Constrained Min Cut Clusterincited by 1
- 2025Multi-Omics Analysis for Cancer Subtype Inference via Unrolling Graph Smoothness Priorscited by 1
- 2024Data-Error Scaling Laws in Machine Learning on Combinatorial Mutation-prone Sets: Proteins and Small Moleculescited by 0
- 2024SFR-GNN: Simple and Fast Robust GNNs against Structural Attackscited by 0
- 2024Seeking the Sufficiency and Necessity Causal Features in Multimodal Representation Learningcited by 0
- 2025Supervised Graph Contrastive Learning for Gene Regulatory Networkscited by 0
- 2025SEASONED: Semantic-Enhanced Self-Counterfactual Explainable Detection of Adversarial Exploiter Contractscited by 0
- 2026GRAFT: Biological Graph and Hypergraph Benchmarks for Linked Gene Expression and Phenotypic Trait Prediction in Arabidopsis thalianacited by 0
- 2026GRAFT: Biological Graph and Hypergraph Benchmarks for Linked Gene Expression and Phenotypic Trait Prediction in Arabidopsis thaliana25 Jun 2026
- 2025SEASONED: Semantic-Enhanced Self-Counterfactual Explainable Detection of Adversarial Exploiter Contracts6 Sep 2025
- 2025Multi-Omics Analysis for Cancer Subtype Inference via Unrolling Graph Smoothness Priors8 Aug 2025
- 2025Supervised Graph Contrastive Learning for Gene Regulatory Networks23 May 2025
- 2025Graph Data Selection for Domain Adaptation: A Model-Free Approach22 May 2025
- 2025Double-Bounded Nonlinear Optimal Transport for Size Constrained Min Cut Clusterin30 Jan 2025
- 2024DELTA: Dual Consistency Delving with Topological Uncertainty for Active Graph Domain Adaptation13 Sep 2024
- 2024Seeking the Sufficiency and Necessity Causal Features in Multimodal Representation Learning29 Aug 2024
- 2024SFR-GNN: Simple and Fast Robust GNNs against Structural Attacks29 Aug 2024
- 2024Multimodal Data Integration for Precision Oncology: Challenges and Future Directions28 Jun 2024
- 2024Towards Graph Contrastive Learning: A Survey and Beyond20 May 2024
- 2024Data-Error Scaling Laws in Machine Learning on Combinatorial Mutation-prone Sets: Proteins and Small Molecules8 May 2024