mlsanityData to 7 Oct 2026

CGRL: Causal-Guided Representation Learning for Node-Level Out-of-Distribution Generalization

arXiv 2603.24304 ↗First posted 25 Mar 2026stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs) deliver strong performance on graph tasks, but their accuracy drops significantly under out-of-distribution (OOD) scenarios. Under distribution shifts, GNNs often fit environmental noise and spurious correlations instead of stable causal mechanisms, leading to weak OOD robustness and unstable predictive representations. Existing solutions based on environment invariance or causal reasoning are insufficient for node classification, as they do not explicitly model the fine-grained latent geometry required by the task. We further observe a training instability named Info-Jitter, where the mutual information between predictive representations and ground-truth labels fluctuates throughout training. To address these issues, we construct a node-classification-specific causal graph derived from the task's geometric objective. Using do-calculus to block non-causal paths caused by environmental noise, we derive a deconfounded interventional objective and a variational lower bound to disentangle representations into intra-class and inter-class components. We then propose Causal-Guided Representation Learning (CGRL), a framework with two core modules. First, a multi-branch re-weighted representation learning (RRL) module learns a causal modulation matrix to amplify causal signals and suppress environmental noise during message passing. Second, an optimization strategy combining intra-class aggregation, inter-class separation, energy-based reconstruction and supervised prediction regularizes the latent space for robust node-level generalization. Experiments on multiple benchmark datasets show that CGRL outperforms strong baselines across various distribution shifts and effectively mitigates the Info-Jitter phenomenon.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 58 references that are in the map. First posted on arXiv 25 Mar 2026.

Builds on

37 of 58 references.

References · 37

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2017Graph Attention Networkscited by 8,854
  4. 2017Inductive Representation Learning on Large Graphscited by 6,284
  5. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  6. 2018How Powerful are Graph Neural Networks?cited by 4,355
  7. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  8. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  9. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
  10. 2019Invariant Risk Minimizationcited by 1,832
  11. 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
  12. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
25 more
  1. 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 713
  2. 2019Your Classifier is Secretly an Energy Based Model and You Should Treat it Like Onecited by 402
  3. 2020Environment Inference for Invariant Learningcited by 306
  4. 2021Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalizationcited by 220
  5. 2022Handling Distribution Shifts on Graphs: An Invariance Perspectivecited by 163
  6. 2022Learning Causally Invariant Representations for Out-of-Distribution Generalization on Graphscited by 144
  7. 2022GOOD: A Graph Out-of-Distribution Benchmarkcited by 140
  8. 2020From Local Structures to Size Generalization in Graph Neural Networkscited by 119
  9. 2021Causal Attention for Interpretable and Generalizable Graph Classificationcited by 108
  10. 2024Discrete-state Continuous-time Diffusion for Graph Generationcited by 73
  11. 2022ZIN: When and How to Learn Invariance Without Environment Partition?cited by 58
  12. 2023Does Invariant Graph Learning via Environment Augmentation Learn Invariance?cited by 42
  13. 2024Graph Out-of-Distribution Generalization via Causal Interventioncited by 30
  14. 2023Guiding Energy-based Models via Contrastive Latent Variablescited by 17
  15. 2023Causal Inference with Conditional Front-Door Adjustment and Identifiable Variational Autoencodercited by 17
  16. 2024Learning Invariant Representations of Graph Neural Networks via Cluster Generalizationcited by 10
  17. 2024Node Identifiers: Compact, Discrete Representations for Efficient Graph Learningcited by 10
  18. 2025GCAL: Adapting Graph Models to Evolving Domain Shiftscited by 8
  19. 2024Few-Shot Causal Representation Learning for Out-of-Distribution Generalization on Heterogeneous Graphscited by 6
  20. 2024Dissecting the Failure of Invariant Learning on Graphscited by 5
  21. 2025A Unified Invariant Learning Framework for Graph Classificationcited by 5
  22. 2023Tackling Size Generalization of Graph Neural Networks on Biological Data from a Spectral Perspectivecited by 3
  23. 2025Optimizing Social Network Interventions via Hypergradient-Based Recommender System Designcited by 3
  24. 2024Learning Divergence Fields for Shift-Robust Graph Representationscited by 2
  25. 2024Graph Neural Network Generalization with Gaussian Mixture Model Based Augmentationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023When Graph Neural Network Meets Causality: Opportunities, Methodologies and An Outlook
  2. 2026Causal Concept Graphs in LLM Latent Space for Stepwise Reasoning
  3. 2026Optimizing Graph Causal Classification Models: Estimating Causal Effects and Addressing Confounders
  4. 2026CauScale: Neural Causal Discovery at Scale
  5. 2025Causal Process Models: Reframing Dynamic Causal Graph Discovery as a Reinforcement Learning Problem
  6. 2024Causal Concept Graph Models: Beyond Causal Opacity in Deep Learning
  7. 2024Sparse Decomposition of Graph Neural Networks
  8. 2023Dynamic Causal Explanation Based Diffusion-Variational Graph Neural Network for Spatio-temporal Forecasting