mlsanityData to 7 Oct 2026

Toward Effective Multimodal Graph Foundation Model: A Divide-and-Conquer Based Approach

arXiv 2602.04116 ↗First posted 4 Feb 2026cs.LG cs.AI cs.SIcited by 6

Not on the map. Why?

Abstract (arXiv)

Graph Foundation Models (GFMs) have achieved remarkable success in generalizing across diverse domains. However, they mainly focus on Text-Attributed Graphs (TAGs), leaving Multimodal-Attributed Graphs (MAGs) largely untapped. Developing Multimodal Graph Foundation Models (MGFMs) allows for leveraging the rich multimodal information in MAGs, and extends applicability to broader types of downstream tasks. While recent MGFMs integrate diverse modality information, our empirical investigation reveals two fundamental limitations of existing MGFMs: (1)they fail to explicitly model modality interaction, essential for capturing intricate cross-modal semantics beyond simple aggregation, and (2)they exhibit sub-optimal modality alignment, which is critical for bridging the significant semantic disparity between distinct modal spaces. To address these challenges, we propose PLANET (graPh topoLogy-aware modAlity iNteraction and alignmEnT), a novel framework employing a Divide-and-Conquer strategy to decouple modality interaction and alignment across distinct granularities. At the embedding granularity, (1)Embedding-wise Domain Gating (EDG) performs local semantic enrichment by adaptively infusing topology-aware cross-modal context, achieving modality interaction. At the node granularity, (2)Node-wise Discretization Retrieval (NDR) ensures global modality alignment by constructing a Discretized Semantic Representation Space (DSRS) to bridge modality gaps. Extensive experiments demonstrate that PLANET significantly outperforms state-of-the-art baselines across diverse graph-centric and multimodal generative tasks.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 36 of its 48 references that are in the map. First posted on arXiv 4 Feb 2026.

Builds on

36 of 48 references.

References · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2016Layer Normalizationcited by 5,579
  5. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  6. 2020A Generalization of Transformer Networks to Graphscited by 653
  7. 2020Deep Graph Contrastive Representation Learningcited by 535
  8. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
  9. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 239
  10. 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 223
  11. 2020Learning Robust Representations via Multi-View Information Bottleneckcited by 189
  12. 2024LLaGA: Large Language and Graph Assistantcited by 177
24 more
  1. 2020Graph Information Bottleneckcited by 168
  2. 2023GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learnercited by 131
  3. 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 101
  4. 2023PRODIGY: Enabling In-context Learning Over Graphscited by 97
  5. 2024ZeroG: Investigating Cross-dataset Zero-shot Transferability in Graphscited by 83
  6. 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 82
  7. 2021Mining Latent Structures for Multimedia Recommendationcited by 79
  8. 2024OpenGraph: Towards Open Graph Foundation Modelscited by 75
  9. 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 61
  10. 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 60
  11. 2024GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphscited by 58
  12. 2024GOFA: A Generative One-For-All Model for Joint Graph Language Modelingcited by 56
  13. 2024AnyGraph: Graph Foundation Model in the Wildcited by 51
  14. 2025UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphscited by 47
  15. 2022Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completioncited by 44
  16. 2022Multi-modal Graph Learning for Disease Predictioncited by 34
  17. 2025RiemannGFM: Learning a Graph Foundation Model from Riemannian Geometrycited by 32
  18. 2024Mosaic of Modalities: A Comprehensive Benchmark for Multimodal Graph Learningcited by 28
  19. 2023Multimodal Graph Learning for Generative Taskscited by 27
  20. 2024Learning on Multimodal Graphs: A Surveycited by 22
  21. 2024When Graph meets Multimodal: Benchmarking and Meditating on Multimodal Attributed Graphs Learningcited by 20
  22. 2025GRAPHGPT-O: Synergistic Multimodal Comprehension and Generation on Graphscited by 17
  23. 2024InstructG2I: Synthesizing Images from Multimodal Attributed Graphscited by 14
  24. 2025Towards A Universal Graph Structural Encodercited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.