mlsanityData to 14 Oct 2026

Heterogeneous Graph Alignment for Joint Reasoning and Interpretability

arXiv 2601.22593 ↗First posted 30 Jan 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-graph learning is crucial for extracting meaningful signals from collections of heterogeneous graphs. However, effectively integrating information across graphs with differing topologies, scales, and semantics, often in the absence of shared node identities, remains a significant challenge. We present the Multi-Graph Meta-Transformer (MGMT), a unified, scalable, and interpretable framework for cross-graph learning. MGMT first applies Graph Transformer encoders to each graph, mapping structure and attributes into a shared latent space. It then selects task-relevant supernodes via attention and builds a meta-graph that connects functionally aligned supernodes across graphs using similarity in the latent space. Additional Graph Transformer layers on this meta-graph enable joint reasoning over intra- and inter-graph structure. The meta-graph provides built-in interpretability: supernodes and superedges highlight influential substructures and cross-graph alignments. Evaluating MGMT on both synthetic datasets and real-world neuroscience applications, we show that MGMT consistently outperforms existing state-of-the-art models in graph-level prediction tasks while offering interpretable representations that facilitate scientific discoveries. Our work establishes MGMT as a unified framework for structured multi-graph learning, advancing representation techniques in domains where graph-based data plays a central role.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 64 references that are in the map. First posted on arXiv 30 Jan 2026.

Builds on

42 of 64 references.

References · 42

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Graph Attention Networkscited by 8,923
  4. 2019Simplifying Graph Convolutional Networkscited by 1,477
  5. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
  6. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  7. 2018Hierarchical Graph Representation Learning with Differentiable Poolingcited by 787
  8. 2019Graph Neural Networks for Social Recommendationcited by 714
  9. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
  10. 2020A Generalization of Transformer Networks to Graphscited by 661
  11. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 506
  12. 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
30 more
  1. 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 443
  2. 2023Multimodal Deep Learningcited by 258
  3. 2020Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node Embeddingscited by 214
  4. 2022Representing Long-Range Context for Graph Neural Networks with Global Attentioncited by 195
  5. 2022Pure Transformers are Powerful Graph Learnerscited by 188
  6. 2022Are Multimodal Transformers Robust to Missing Modality?cited by 186
  7. 2023Exphormer: Sparse Transformers for Graphscited by 170
  8. 2023Graph Inductive Biases in Transformers without Message Passingcited by 153
  9. 2021Global Self-Attention as a Replacement for Graph Convolutioncited by 114
  10. 2021Causal Attention for Interpretable and Generalizable Graph Classificationcited by 108
  11. 2021On the Unreasonable Effectiveness of Feature propagation in Learning on Graphs with Missing Node Featurescited by 63
  12. 2022MedFuse: Multi-modal fusion with clinical time-series data and chest X-ray imagescited by 54
  13. 2025UniGraph2: Learning a Unified Embedding Space to Bind Multimodal Graphscited by 49
  14. 2022Multi-modal Graph Learning for Disease Predictioncited by 34
  15. 2022Evidence-aware Fake News Detection with Graph Neural Networkscited by 30
  16. 2023Counterfactual Learning on Graphs: A Surveycited by 22
  17. 2023AMIGO: Sparse Multi-Modal Graph Transformer with Shared-Context Processing for Representation Learning of Giga-pixel Imagescited by 18
  18. 2023Enhancing Graph Transformers with Hierarchical Distance Structural Encodingcited by 16
  19. 2024GraphAlign: Pretraining One Graph Neural Network on Multiple Graphs via Feature Alignmentcited by 15
  20. 2023MultiModN- Multimodal, Multi-Task, Interpretable Modular Networkscited by 14
  21. 2024GraphFM: A generalist graph transformer that learns transferable representations across diverse domainscited by 14
  22. 2023Learning to Count Isomorphisms with Graph Neural Networkscited by 13
  23. 2022The Devil is in the Conflict: Disentangled Information Graph Neural Networks for Fraud Detectioncited by 11
  24. 2019A Survey of Data Fusion in Smart City Applicationscited by 10
  25. 2023Multi-modal Graph Neural Network for Early Diagnosis of Alzheimer's Disease from sMRI and PET Scanscited by 9
  26. 2024FlexCare: Leveraging Cross-Task Synergy for Flexible Multimodal Healthcare Predictioncited by 6
  27. 2023MaxCorrMGNN: A Multi-Graph Neural Network Framework for Generalized Multimodal Fusion of Medical Data for Outcome Predictioncited by 2
  28. 2024MVGT: A Multi-view Graph Transformer Based on Spatial Relations for EEG Emotion Recognitioncited by 2
  29. 2023A Model-Agnostic Graph Neural Network for Integrating Local and Global Informationcited by 1
  30. 2025SamGoG: A Sampling-Based Graph-of-Graphs Framework for Imbalanced Graph Classificationcited by 1

Built on by

Not cited yet.