mlsanityData to 14 Oct 2026

Toward Federated Multimodal Graph Foundation Models: A Topology-Aware Multimodal Alignment Framework

arXiv 2607.15687 ↗First posted 17 Jul 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Multimodal-attributed graphs (MAGs), whose nodes carry modalities such as images and text alongside topological structure, now pervade applications including social platforms, e-commerce, and biomedical networks, offering richer semantic signals than single-modality graphs. In practice, such graphs are fragmented across privacy-restricted silos owned by different platforms and institutions, so learning a broadly transferable model over them demands collaborative training that never exposes raw data. This places the task at the intersection of multimodal graph learning and federated learning, yet existing methods cover only one side of it. To address the challenges from these two perspectives, we propose FedGAMMA, casting federated multimodal graph foundation learning as a two-stage semantic-structural alignment problem of federated pre-training and prompt-based fine-tuning. During pre-training, a shared-private semantic enhancer disentangles cross-modal commonality from modality-specific information, aligning it through optimal transport, a topology-aware graph fusion module decouples semantic and structural views via semantic residual graphs and dual positional encodings, and a dual-channel affinity-aware aggregation mechanism estimates client similarity from feature and graph centroids without exposing raw data. During fine-tuning, FedGAMMA adapts the pretrained encoder through lightweight graph-aware prompts, a shared prompt pool with controlled exploration, and channel-wise prompt synchronization. Experiments on twelve multimodal graph datasets show FedGAMMA consistently surpassing a broad range of baselines across downstream tasks, with gains of up to 12.96%. FedGAMMA further outperforms competitive baselines accross multi-domain datasets on multiple tasks with up to 5.71% under few-shot learning scenario.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 49 of its 59 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

49 of 59 references.

References · 49

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2017Graph Attention Networkscited by 8,923
  6. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  7. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  8. 2017Neural Discrete Representation Learningcited by 4,712
  9. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  10. 2019Advances and Open Problems in Federated Learningcited by 3,046
  11. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  12. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
37 more
  1. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
  2. 2016Variational Graph Auto-Encoderscited by 1,382
  3. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  4. 2018Deep Graph Infomaxcited by 1,106
  5. 2020Deep Graph Contrastive Representation Learningcited by 539
  6. 2015Optimal Transport for Domain Adaptationcited by 463
  7. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
  8. 2022Multimodal Learning with Transformers: A Surveycited by 400
  9. 2021FedProto: Federated Prototype Learning across Heterogeneous Clientscited by 352
  10. 2023Multimodal Deep Learningcited by 258
  11. 2023One for All: Towards Training One Graph Model for All Classification Taskscited by 243
  12. 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 207
  13. 2021Subgraph Federated Learning with Missing Neighbor Generationcited by 132
  14. 2021Federated Graph Classification over Non-IID Graphscited by 114
  15. 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmarkcited by 99
  16. 2024GFT: Graph Foundation Model with Transferable Tree Vocabularycited by 85
  17. 2024UniGraph: Learning a Unified Cross-Domain Foundation Model for Text-Attributed Graphscited by 66
  18. 2022Personalized Subgraph Federated Learningcited by 54
  19. 2024AnyGraph: Graph Foundation Model in the Wildcited by 53
  20. 2025UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphscited by 49
  21. 2024FedGTA: Topology-aware Averaging for Federated Graph Learningcited by 44
  22. 2022FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learningcited by 43
  23. 2021A Bayesian Federated Learning Framework with Online Laplace Approximationcited by 41
  24. 2024Federated Graph Semantic and Structural Learningcited by 30
  25. 2024FedTAD: Topology-aware Data-free Knowledge Distillation for Subgraph Federated Learningcited by 27
  26. 2024AdaFGL: A New Paradigm for Federated Node Classification with Topology Heterogeneitycited by 25
  27. 2025Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglementcited by 14
  28. 2022Distributed Learning of Generalized Linear Causal Networkscited by 13
  29. 2026MM-OpenFGL: A Comprehensive Benchmark for Multimodal Federated Graph Learningcited by 11
  30. 2025FedBook: A Unified Federated Graph Foundation Codebook with Intra-domain and Inter-domain Knowledge Modelingcited by 8
  31. 2021Multiplex Graph Networks for Multimodal Brain Network Analysiscited by 7
  32. 2026Toward Effective Multimodal Graph Foundation Model: A Divide-and-Conquer Based Approachcited by 7
  33. 2026Mario: Multimodal Graph Reasoning with Large Language Modelscited by 3
  34. 2026TMTE: Effective Multimodal Graph Learning with Task-aware Modality and Topology Co-evolutioncited by 3
  35. 2026RoleMAG: Learning Neighbor Roles in Multimodal Graphscited by 3
  36. 2026Rethinking Federated Graph Foundation Models: A Graph-Language Alignment-based Approachcited by 2
  37. 2026CAMPA: Efficient and Aligned Multimodal Graph Learning via Decoupled Propagation and Aggregationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.