Quantifying Distributional Invariance in Causal Subgraph for IRM-Free Graph Generalization
Not on the map. Why?
Abstract (arXiv)
Out-of-distribution generalization under distributional shifts remains a critical challenge for graph neural networks. Existing methods generally adopt the Invariant Risk Minimization (IRM) framework, requiring costly environment annotations or heuristically generated synthetic splits. To circumvent these limitations, in this work, we aim to develop an IRM-free method for capturing causal subgraphs. We first identify that causal subgraphs exhibit substantially smaller distributional variations than non-causal components across diverse environments, which we formalize as the Invariant Distribution Criterion and theoretically prove in this paper. Building on this criterion, we systematically uncover the quantitative relationship between distributional shift and representation norm for identifying the causal subgraph, and investigate its underlying mechanisms in depth. Finally, we propose an IRM-free method by introducing a norm-guided invariant distribution objective for causal subgraph discovery and prediction. Extensive experiments on two widely used benchmarks demonstrate that our method consistently outperforms state-of-the-art methods in graph generalization.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 34 of its 47 references that are in the map. First posted on arXiv 23 Oct 2025.
Builds on
34 of 47 references.
References · 34
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 742
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 737
- 2015Causal inference using invariant prediction: identification and confidence intervalscited by 536
- 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
- 2020Parameterized Explainer for Graph Neural Networkcited by 426
22 more
- 2016Rationalizing Neural Predictionscited by 281
- 2022Discovering Invariant Rationales for Graph Neural Networkscited by 188
- 2022Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanismcited by 171
- 2022Learning Causally Invariant Representations for Out-of-Distribution Generalization on Graphscited by 144
- 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 141
- 2017Invariant Causal Prediction for Nonlinear Modelscited by 140
- 2022Debiasing Graph Neural Networks via Learning Disentangled Causal Substructurecited by 83
- 2022Graph Rationalization with Environment-based Augmentationscited by 70
- 2017Invariant Causal Prediction for Sequential Datacited by 63
- 2022ZIN: When and How to Learn Invariance Without Environment Partition?cited by 58
- 2022Implicit Regularization Towards Rank Minimization in ReLU Networkscited by 53
- 2023Does Invariant Graph Learning via Environment Augmentation Learn Invariance?cited by 42
- 2023Joint Learning of Label and Environment Causal Independence for Graph Out-of-Distribution Generalizationcited by 29
- 2023Learning Invariant Molecular Representation in Latent Discrete Spacecited by 19
- 2024GOODAT: Towards Test-time Graph Out-of-Distribution Detectioncited by 17
- 2025Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamicscited by 16
- 2024Empowering Graph Invariance Learning with Deep Spurious Infomaxcited by 14
- 2024Investigating Out-of-Distribution Generalization of GNNs: An Architecture Perspectivecited by 13
- 2024DIVE: Subgraph Disagreement for Graph Out-of-Distribution Generalizationcited by 7
- 2025Breaking Free from MMI: A New Frontier in Rationalization by Probing Input Utilizationcited by 6
- 2025The Panaceas for Improving Low-Rank Decomposition in Communication-Efficient Federated Learningcited by 5
- 2025BoRA: Towards More Expressive Low-Rank Adaptation with Block Diversitycited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.