Towards Unified Multimodal Graph Foundation Model: A Bridge-Router-Adapter Based Approach
Not on the map. Why?
Abstract (arXiv)
Multimodal graphs couple node attributes in different modalities, such as text and images, with relational structure, enabling topological structure and cross-modality attributes to be modeled jointly. Multimodal graph foundation models seek unified representations from such data that transfer across different graph domains and downstream tasks. However, existing methods exhibit two fundamental limitations. (1) Cross-Scope Context Entanglement. They merge scope-specific graph contexts into a unified representation, obscuring their distinctions during multimodal construction. (2) Scope-Ignorant Modality Routing. They route modalities within a fixed graph scope, overlooking how modality relevance varies across neighborhood ranges. To address these challenges, we propose BRAIN, a unified model that focuses on graph context that combines neighborhood scope with modality composition. BRAIN comprises a scope-conditioned Bridge that combines structural information spanning local-to-global neighborhood scopes with different modality compositions; a hierarchical Router that estimates the relevance between the scope and the task, and selects compositions separately within each scope, allowing modality utility to vary with graph range; and a lightweight residual Adapter that further specializes the routed embedding for downstream prediction. BRAIN is trained through multi-graph pretraining followed by task-specific adaptation. Experiments across nine datasets and four task families demonstrate its broad effectiveness, improving node-classification and link-prediction performance by up to 4.73% relative to the strongest baseline, while achieving an average relative improvement of 14.72% across four graph-to-text and two graph-to-image metrics.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 24 references that are in the map. First posted on arXiv 6 Sep 2026.
Builds on
18 of 24 references.
References · 18
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
- 2024Position: Graph Foundation Models are Already Herecited by 86
- 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 85
- 2021Mining Latent Structures for Multimedia Recommendationcited by 79
- 2025UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphscited by 49
- 2025Multi-Domain Graph Foundation Models: Robust Knowledge Transfer via Topology Alignmentcited by 42
- 2025RiemannGFM: Learning a Graph Foundation Model from Riemannian Geometrycited by 35
- 2023Multimodal Graph Learning for Generative Taskscited by 27
- 2025GRAPHGPT-O: Synergistic Multimodal Comprehension and Generation on Graphscited by 17
6 more
- 2025Graph4MM: Weaving Multimodal Learning with Structural Informationcited by 17
- 2025Cross-Contrastive Clustering for Multimodal Attributed Graphs with Dual Graph Filteringcited by 14
- 2026OpenMAG: A Comprehensive Benchmark for Multimodal-Attributed Graphcited by 13
- 2025MLaGA: Multimodal Large Language and Graph Assistantcited by 12
- 2026Toward Effective Multimodal Graph Foundation Model: A Divide-and-Conquer Based Approachcited by 7
- 2026Multimodal Graph Representation Learning with Dynamic Information Pathwayscited by 2
Built on by
Not cited yet.