mlsanityData to 7 Oct 2026

MMPG: MoE-based Adaptive Multi-Perspective Graph Fusion for Protein Representation Learning

arXiv 2601.10157 ↗First posted 15 Jan 2026cs.AIcited by 0

On the map: Mixture-of-experts → Medical and biomedical MoE

Abstract (arXiv)

Graph Neural Networks (GNNs) have been widely adopted for Protein Representation Learning (PRL), as residue interaction networks can be naturally represented as graphs. Current GNN-based PRL methods typically rely on single-perspective graph construction strategies, which capture partial properties of residue interactions, resulting in incomplete protein representations. To address this limitation, we propose MMPG, a framework that constructs protein graphs from multiple perspectives and adaptively fuses them via Mixture of Experts (MoE) for PRL. MMPG constructs graphs from physical, chemical, and geometric perspectives to characterize different properties of residue interactions. To capture both perspective-specific features and their synergies, we develop an MoE module, which dynamically routes perspectives to specialized experts, where experts learn intrinsic features and cross-perspective interactions. We quantitatively verify that MoE automatically specializes experts in modeling distinct levels of interaction from individual representations, to pairwise inter-perspective synergies, and ultimately to a global consensus across all perspectives. Through integrating this multi-level information, MMPG produces superior protein representations and achieves advanced performance on four different downstream protein tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and biomedical MoE, one of 12 directions in Mixture-of-experts. Builds on 8 of its 40 references that are in the map. First posted on arXiv 15 Jan 2026.

Builds on

8 of 40 references.

References · 8

  1. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  2. 2020Learning from Protein Structure with Geometric Vector Perceptronscited by 308
  3. 2022Protein Representation Learning by Geometric Structure Pretrainingcited by 161
  4. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
  5. 2022Learning Hierarchical Protein Representations via Complete 3D Graph Networkscited by 54
  6. 2022Contrastive Representation Learning for 3D Protein Structurescited by 30
  7. 2024Evaluating representation learning on the protein structure universecited by 16
  8. 2021Encoding protein dynamic information in graph representation for functional residue identificationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025PRING: Rethinking Protein-Protein Interaction Prediction from Pairs to Graphs
  2. 2025Adaptive Substructure-Aware Expert Model for Molecular Property Prediction
  3. 2025MolGraph-xLSTM: A graph-based dual-level xLSTM framework with multi-head mixture-of-experts for enhanced molecular representation and interpretability
  4. 2026Topology-Aware Multiscale Mixture of Experts for Efficient Molecular Property Prediction
  5. 2025Structure-Aligned Protein Language Model
  6. 2025A Generalist Cross-Domain Molecular Learning Framework for Structure-Based Drug Discovery
  7. 2025PPDiff: Diffusing in Hybrid Sequence-Structure Space for Protein-Protein Complex Design
  8. 2024Exploring Hierarchical Molecular Graph Representation in Multimodal LLMs