Few-Shot Causal Representation Learning for Out-of-Distribution Generalization on Heterogeneous Graphs
Not on the map. Why?
Abstract (arXiv)
Heterogeneous graph few-shot learning (HGFL) has been developed to address the label sparsity issue in heterogeneous graphs (HGs), which consist of various types of nodes and edges. The core concept of HGFL is to extract knowledge from rich-labeled classes in a source HG, transfer this knowledge to a target HG to facilitate learning new classes with few-labeled training data, and finally make predictions on unlabeled testing data. Existing methods typically assume that the source HG, training data, and testing data all share the same distribution. However, in practice, distribution shifts among these three types of data are inevitable due to two reasons: (1) the limited availability of the source HG that matches the target HG distribution, and (2) the unpredictable data generation mechanism of the target HG. Such distribution shifts result in ineffective knowledge transfer and poor learning performance in existing methods, thereby leading to a novel problem of out-of-distribution (OOD) generalization in HGFL. To address this challenging problem, we propose a novel Causal OOD Heterogeneous graph Few-shot learning model, namely COHF. In COHF, we first characterize distribution shifts in HGs with a structural causal model, establishing an invariance principle for OOD generalization in HGFL. Then, following this invariance principle, we propose a new variational autoencoder-based heterogeneous graph neural network to mitigate the impact of distribution shifts. Finally, by integrating this network with a novel meta-learning framework, COHF effectively transfers knowledge to the target HG to predict new classes with few-labeled data. Extensive experiments on seven real-world datasets have demonstrated the superior performance of COHF over the state-of-the-art methods.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 52 of its 93 references that are in the map. First posted on arXiv 7 Jan 2024.
Builds on
52 of 93 references.
References · 52
- 2017Attention Is All You Needcited by 59,932
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
- 2018Link Prediction Based on Graph Neural Networkscited by 829
- 2021How Attentive are Graph Attention Networks?cited by 818
38 more
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
- 2019Heterogeneous Graph Attention Networkcited by 732
- 2019Graph Transformer Networkscited by 520
- 2014Semi-Supervised Learning with Deep Generative Modelscited by 494
- 2018GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoderscited by 375
- 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
- 2022Discovering Invariant Rationales for Graph Neural Networkscited by 186
- 2021Are we really making much progress? Revisiting, benchmarking, and refining heterogeneous graph neural networkscited by 176
- 2019A Meta-Transfer Objective for Learning to Disentangle Causal Mechanismscited by 158
- 2022Learning Causally Invariant Representations for Out-of-Distribution Generalization on Graphscited by 144
- 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 140
- 2020A Survey on Heterogeneous Graph Embedding: Methods, Techniques, Applications and Sourcescited by 126
- 2015A Survey of Heterogeneous Information Network Analysiscited by 109
- 2021Causal Attention for Interpretable and Generalizable Graph Classificationcited by 108
- 2020Visual Commonsense R-CNNcited by 106
- 2019Meta-GNN: On Few-shot Node Classification in Graph Meta-learningcited by 105
- 2017Learning Structural Node Embeddings Via Diffusion Waveletscited by 97
- 2020Graph Prototypical Networks for Few-shot Learning on Attributed Networkscited by 90
- 2020Graph Meta Learning via Local Subgraphscited by 89
- 2022Debiasing Graph Neural Networks via Learning Disentangled Causal Substructurecited by 83
- 2021Size-Invariant Graph Representations for Graph Classification Extrapolationscited by 82
- 2019An Attention-based Graph Neural Network for Heterogeneous Structural Learningcited by 71
- 2021Graph Convolution for Semi-Supervised Classification: Improved Linear Separability and Out-of-Distribution Generalizationcited by 70
- 2020Interpretable and Efficient Heterogeneous Graph Convolutional Networkcited by 48
- 2022GOOD-D: On Unsupervised Graph Out-Of-Distribution Detectioncited by 47
- 2023Rethinking Out-of-distribution (OOD) Detection: Masked Image Modeling is All You Needcited by 46
- 2022Tree Mover's Distance: Bridging Graph Metrics and Stability of Graph Neural Networkscited by 39
- 2023HINormer: Representation Learning On Heterogeneous Information Networks with Graph Transformercited by 35
- 2023HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networkscited by 32
- 2023Heterogeneous Graph Contrastive Learning for Recommendationcited by 28
- 2019A Flexible Generative Framework for Graph-based Semi-supervised Learningcited by 24
- 2019Relation Structure-Aware Heterogeneous Information Network Embeddingcited by 19
- 2020Leveraging Meta-path Contexts for Classification in Heterogeneous Information Networkscited by 19
- 2016Task-Guided and Path-Augmented Heterogeneous Network Embedding for Author Identificationcited by 18
- 2022Few-Shot Learning on Graphscited by 11
- 2022Zero-shot Transfer Learning within a Heterogeneous Graph via Knowledge Transfer Networkscited by 10
- 2023Task-Equivariant Graph Few-shot Learningcited by 8
- 2020Semi-Supervised Disentangled Framework for Transferable Named Entity Recognitioncited by 7
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 3.
6 papers.
- 2024Few-shot Learning on Heterogeneous Graphs: Challenges, Progress, and Prospectscited by 0
- 2025Towards Comprehensive and Prerequisite-Free Explainer for Graph Neural Networkscited by 0
- 2025Causal Disentanglement Learning for Accurate Anomaly Detection in Multivariate Time Seriescited by 0
- 2026Causal Direct Preference Optimization for Distributionally Robust Generative Recommendationcited by 0
- 2026CGRL: Causal-Guided Representation Learning for Node-Level Out-of-Distribution Generalizationcited by 0
- 2026A Robust Watermark-based Fingerprint Framework for GNNs Ownership Verificationcited by 0
- 2026A Robust Watermark-based Fingerprint Framework for GNNs Ownership Verification4 Sep 2026
- 2026CGRL: Causal-Guided Representation Learning for Node-Level Out-of-Distribution Generalization25 Mar 2026
- 2026Causal Direct Preference Optimization for Distributionally Robust Generative Recommendation21 Mar 2026
- 2025Causal Disentanglement Learning for Accurate Anomaly Detection in Multivariate Time Series13 Oct 2025
- 2025Towards Comprehensive and Prerequisite-Free Explainer for Graph Neural Networks20 May 2025
- 2024Few-shot Learning on Heterogeneous Graphs: Challenges, Progress, and Prospects10 Mar 2024