Toward Effective Multimodal Graph Foundation Model: A Divide-and-Conquer Based Approach
Not on the map. Why?
Abstract (arXiv)
Graph Foundation Models (GFMs) have achieved remarkable success in generalizing across diverse domains. However, they mainly focus on Text-Attributed Graphs (TAGs), leaving Multimodal-Attributed Graphs (MAGs) largely untapped. Developing Multimodal Graph Foundation Models (MGFMs) allows for leveraging the rich multimodal information in MAGs, and extends applicability to broader types of downstream tasks. While recent MGFMs integrate diverse modality information, our empirical investigation reveals two fundamental limitations of existing MGFMs: (1)they fail to explicitly model modality interaction, essential for capturing intricate cross-modal semantics beyond simple aggregation, and (2)they exhibit sub-optimal modality alignment, which is critical for bridging the significant semantic disparity between distinct modal spaces. To address these challenges, we propose PLANET (graPh topoLogy-aware modAlity iNteraction and alignmEnT), a novel framework employing a Divide-and-Conquer strategy to decouple modality interaction and alignment across distinct granularities. At the embedding granularity, (1)Embedding-wise Domain Gating (EDG) performs local semantic enrichment by adaptively infusing topology-aware cross-modal context, achieving modality interaction. At the node granularity, (2)Node-wise Discretization Retrieval (NDR) ensures global modality alignment by constructing a Discretized Semantic Representation Space (DSRS) to bridge modality gaps. Extensive experiments demonstrate that PLANET significantly outperforms state-of-the-art baselines across diverse graph-centric and multimodal generative tasks.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 36 of its 48 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
36 of 48 references.
References · 36
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2016Layer Normalizationcited by 5,579
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2020A Generalization of Transformer Networks to Graphscited by 653
- 2020Deep Graph Contrastive Representation Learningcited by 535
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
- 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 223
- 2020Learning Robust Representations via Multi-View Information Bottleneckcited by 189
- 2024LLaGA: Large Language and Graph Assistantcited by 177
24 more
- 2020Graph Information Bottleneckcited by 168
- 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 131
- 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 101
- 2023PRODIGY: Enabling In-context Learning Over Graphscited by 97
- 2024ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphscited by 83
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 82
- 2021Mining Latent Structures for Multimedia Recommendationcited by 79
- 2024OpenGraph: Towards Open Graph Foundation Modelscited by 75
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 61
- 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 60
- 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
- 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 56
- 2024AnyGraph: Graph Foundation Model in the Wildcited by 51
- 2025UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphscited by 47
- 2022Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completioncited by 44
- 2022Multi-modal Graph Learning for Disease Predictioncited by 34
- 2025RiemannGFM: Learning a Graph Foundation Model from Riemannian Geometrycited by 32
- 2024Mosaic of Modalities: A Comprehensive Benchmark for Multimodal Graph Learningcited by 28
- 2023Multimodal Graph Learning for Generative Taskscited by 27
- 2024Learning on Multimodal Graphs: A Surveycited by 22
- 2024When Graph meets Multimodal: Benchmarking and Meditating on Multimodal Attributed Graphs Learningcited by 20
- 2025GRAPHGPT-O: Synergistic Multimodal Comprehension and Generation on Graphscited by 17
- 2024InstructG2I: Synthesizing Images from Multimodal Attributed Graphscited by 14
- 2025Towards A Universal Graph Structural Encodercited by 7
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Toward Federated Multimodal Graph Foundation Models: A Topology-Aware Multimodal Alignment Frameworkcited by 1
- 2026SMGFM: Spectral Multimodal Graph Pretraining for Multimodal-Attributed Graphscited by 0
- 2026ReCoG: Reciprocal Co-Evolution for Multimodal Graph Learningcited by 0
- 2026Towards Unified Multimodal Graph Foundation Model: A Bridge-Router-Adapter Based Approachcited by 0
- 2026ICE: Task-Aligned Clifford Latent Fields for Multimodal Graph Foundation Modelscited by 0
- 2026Coupling Perception and Reasoning in Federated Multimodal Graph Foundation Modelscited by 0
- 2026Coupling Perception and Reasoning in Federated Multimodal Graph Foundation Models24 Sep 2026
- 2026ICE: Task-Aligned Clifford Latent Fields for Multimodal Graph Foundation Models24 Sep 2026
- 2026Towards Unified Multimodal Graph Foundation Model: A Bridge-Router-Adapter Based Approach6 Sep 2026
- 2026ReCoG: Reciprocal Co-Evolution for Multimodal Graph Learning24 Aug 2026
- 2026Toward Federated Multimodal Graph Foundation Models: A Topology-Aware Multimodal Alignment Framework17 Jul 2026
- 2026SMGFM: Spectral Multimodal Graph Pretraining for Multimodal-Attributed Graphs11 Jun 2026