ReCoG: Reciprocal Co-Evolution for Multimodal Graph Learning
Not on the map. Why?
Abstract (arXiv)
Multimodal graph learning requires jointly training over graph structure and heterogeneous node attributes, yet existing methods largely decouple these processes: prior multimodal graph neural networks (GNNs) focus on aligning modalities in a shared embedding space while operating on fixed or weakly adapted graph structures, and graph structure learning approaches infer topology from unimodal node representations without accounting for multimodal interactions. This separation fundamentally limits the ability of GNNs to capture semantically meaningful relationships in multimodal settings, where observed edges are often noisy, incomplete, or misaligned with underlying semantics. We propose ReCoG (Reciprocal Co-Evolution for Multimodal Graph Learning), a new learning paradigm that tightly couples graph structure learning and multimodal representation learning through end-to-end reciprocal interaction. Concretely, ReCoG integrates (i) a multimodal graph refiner that infers and corrects edges using cross-modal semantic evidence, and (ii) a coupled cross-modal message passing mechanism that performs joint intra- and inter-modality propagation over the refined graph. This unified design yields greater expressiveness than decoupled or two-stage formulations and allows dynamic interaction between topology and representation learning. Across diverse benchmarks for node classification and link prediction, ReCoG consistently outperforms strong multimodal graph structure learning baselines, including graph foundation models. Our results demonstrate that reciprocal co-evolution of structure and semantics is important for effective multimodal graph learning, challenging the prevailing separation between topology and representation learning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 36 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
25 of 36 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2023Qwen Technical Reportcited by 3,344
- 2019Simplifying Graph Convolutional Networkscited by 1,477
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
- 2019Heterogeneous Graph Attention Networkcited by 734
- 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
- 2020Graph Neural Networks in Recommender Systems: A Surveycited by 494
- 2020Graph Structure Learning for Robust Graph Neural Networkscited by 371
13 more
- 2020Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node Embeddingscited by 214
- 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 210
- 2022Learning on Large-scale Text-attributed Graphs via Variational Inferencecited by 155
- 2021Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Predictioncited by 138
- 2021SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networkscited by 110
- 2025UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphscited by 49
- 2024Linear-Time Graph Neural Networks for Scalable Recommendationscited by 31
- 2024Mosaic of Modalities: A Comprehensive Benchmark for Multimodal Graph Learningcited by 29
- 2020Knowing your FATE: Friendship, Action and Temporal Explanations for User Engagement Prediction on Social Appscited by 23
- 2024When Graph meets Multimodal: Benchmarking and Meditating on Multimodal Attributed Graphs Learningcited by 22
- 2023LazyGNN: Large-Scale Graph Neural Networks via Lazy Propagationcited by 16
- 2026Toward Effective Multimodal Graph Foundation Model: A Divide-and-Conquer Based Approachcited by 7
- 2026Modality as Heterogeneity: Node Splitting and Graph Rewiring for Multimodal Graph Learningcited by 1
Built on by
Not cited yet.