Decoupling and Damping: Structurally-Regularized Gradient Matching for Multimodal Graph Condensation
Not on the map. Why?
Abstract (arXiv)
In multimodal graph learning, graph structures that integrate information from multiple sources, such as vision and text, can more comprehensively model complex entity relationships. However, the continuous growth of their data scale poses a significant computational bottleneck for training. Graph condensation methods provide a feasible path forward by synthesizing compact and representative datasets. Nevertheless, existing condensation approaches generally suffer from performance limitations in multimodal scenarios, mainly due to two reasons: (1) semantic misalignment between different modalities leads to gradient conflicts; (2) the message-passing mechanism of graph neural networks further structurally amplifies such gradient noise. Based on this, we propose Structural Regularized Gradient Matching (SR-GM), a condensation framework for multimodal graphs. This method alleviates gradient conflicts between modalities through a gradient decoupling mechanism and introduces a structural damping regularizer to suppress the propagation of gradient noise in the topology, thereby transforming the graph structure from a noise amplifier into a training stabilizer. Extensive experiments on four multimodal graph datasets demonstrate the effectiveness of SR-GM, highlighting its state-of-the-art performance and cross-architecture generalization capabilities in multimodal graph dataset condensation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 26 of its 52 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
26 of 52 references.
References · 26
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
- 2018Link Prediction Based on Graph Neural Networkscited by 832
- 2020Dataset Condensation with Gradient Matchingcited by 516
- 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 459
- 2020Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Modelscited by 169
- 2021Graph Condensation for Graph Neural Networkscited by 150
- 2020CoDEx: A Comprehensive Knowledge Graph Completion Benchmarkcited by 102
14 more
- 2022Condensing Graphs via One-Step Gradient Matchingcited by 100
- 2021Dirichlet Energy Constrained Learning for Deep Graph Neural Networkscited by 97
- 2023Structure-free Graph Condensation: From Large-scale Graphs to Condensed Graph-free Datacited by 71
- 2022Graph Condensation via Receptive Field Distribution Matchingcited by 60
- 2020Efficient Continuous Pareto Exploration in Multi-Task Learningcited by 57
- 2023Does Graph Distillation See Like Vision Dataset Counterpart?cited by 45
- 2019Product Knowledge Graph Embedding for E-commercecited by 36
- 2020Rethinking Graph Regularization for Graph Neural Networkscited by 36
- 2023Fast Graph Condensation with Structure-based Neural Tangent Kernelcited by 36
- 2024Mosaic of Modalities: A Comprehensive Benchmark for Multimodal Graph Learningcited by 29
- 2020Detecting Beneficial Feature Interactions for Recommender Systemscited by 22
- 2024EXGC: Bridging Efficiency and Explainability in Graph Condensationcited by 20
- 2022Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graphcited by 13
- 2025Beyond Modality Collapse: Representations Blending for Multimodal Dataset Distillationcited by 7
Built on by
Citing papers per year: 2026: 2.
2 papers.