mlsanityData to 7 Oct 2026

Graph Representation Learning via Causal Diffusion for Out-of-Distribution Recommendation

arXiv 2408.00490 ↗First posted 1 Aug 2024cs.LG cs.AI cs.IRcited by 11

Not on the map. Why?

Abstract (arXiv)

Graph Neural Networks (GNNs)-based recommendation algorithms typically assume that training and testing data are drawn from independent and identically distributed (IID) spaces. However, this assumption often fails in the presence of out-of-distribution (OOD) data, resulting in significant performance degradation. In this study, we construct a Structural Causal Model (SCM) to analyze interaction data, revealing that environmental confounders (e.g., the COVID-19 pandemic) lead to unstable correlations in GNN-based models, thus impairing their generalization to OOD data. To address this issue, we propose a novel approach, graph representation learning via causal diffusion (CausalDiffRec) for OOD recommendation. This method enhances the model's generalization on OOD data by eliminating environmental confounding factors and learning invariant graph representations. Specifically, we use backdoor adjustment and variational inference to infer the real environmental distribution, thereby eliminating the impact of environmental confounders. This inferred distribution is then used as prior knowledge to guide the representation learning in the reverse phase of the diffusion process to learn the invariant representation. In addition, we provide a theoretical derivation that proves optimizing the objective function of CausalDiffRec can encourage the model to learn environment-invariant graph representations, thereby achieving excellent generalization performance in recommendations under distribution shifts. Our extensive experiments validate the effectiveness of CausalDiffRec in improving the generalization of OOD data, and the average improvement is up to 10.69% on Food, 18.83% on KuaiRec, 22.41% on Yelp2018, and 11.65% on Douban datasets.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 53 of its 70 references that are in the map. First posted on arXiv 1 Aug 2024.

Builds on

53 of 70 references.

References · 53

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  3. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
  4. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  5. 2017Neural Collaborative Filteringcited by 1,108
  6. 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
  7. 2019Neural Graph Collaborative Filteringcited by 660
  8. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  9. 2020Graph Neural Networks in Recommender Systems: A Surveycited by 493
  10. 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
  11. 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
  12. 2019KGAT: Knowledge Graph Attention Network for Recommendationcited by 342
38 more
  1. 2020Environment Inference for Invariant Learningcited by 306
  2. 2020Self-supervised Graph Learning for Recommendationcited by 305
  3. 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
  4. 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
  5. 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
  6. 2020A Survey on Knowledge Graph-Based Recommender Systemscited by 170
  7. 2022Handling Distribution Shifts on Graphs: An Invariance Perspectivecited by 163
  8. 2022Learning Causally Invariant Representations for Out-of-Distribution Generalization on Graphscited by 144
  9. 2020Disentangled Graph Collaborative Filteringcited by 118
  10. 2018Attention Branch Network: Learning of Attention Mechanism for Visual Explanationcited by 108
  11. 2022Self-Supervised Learning for Recommender Systems: A Surveycited by 95
  12. 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
  13. 2023DiffuRec: A Diffusion Model for Sequential Recommendationcited by 91
  14. 2021Sequential Recommendation with Graph Neural Networkscited by 89
  15. 2019Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferencescited by 87
  16. 2023Diffusion Recommender Modelcited by 87
  17. 2023LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendationcited by 72
  18. 2021Graph Learning based Recommender Systems: A Reviewcited by 59
  19. 2021A Survey of Machine Learning for Computer Architecture and Systemscited by 53
  20. 2023DiffKG: Knowledge Graph Diffusion Model for Recommendationcited by 41
  21. 2023Automated Self-Supervised Learning for Recommendationcited by 37
  22. 2024Plug-in Diffusion Model for Sequential Recommendationcited by 37
  23. 2023Adaptive Graph Contrastive Learning for Recommendationcited by 31
  24. 2024Graph Out-of-Distribution Generalization via Causal Interventioncited by 30
  25. 2021DisenHAN: Disentangled Heterogeneous Graph Attention Network for Recommendationcited by 28
  26. 2023Graph Transformer for Recommendationcited by 28
  27. 2023Environment-Aware Dynamic Graph Learning for Out-of-Distribution Generalizationcited by 26
  28. 2023A Diffusion model for POI recommendationcited by 24
  29. 2023Empowering Collaborative Filtering with Principled Adversarial Contrastive Losscited by 24
  30. 2023Invariant Collaborative Filtering to Popularity Distribution Shiftcited by 23
  31. 2024RecDiff: Diffusion Model for Social Recommendationcited by 20
  32. 2021Session-based Recommendation with Hypergraph Attention Networkscited by 19
  33. 2024Spectral Invariant Learning for Dynamic Graphs under Distribution Shiftscited by 18
  34. 2022CausPref: Causal Preference Learning for Out-of-Distribution Recommendationcited by 17
  35. 2024Distributionally Robust Graph-based Recommendation Systemcited by 17
  36. 2023Contrastive Self-supervised Learning in Recommender Systems: A Surveycited by 14
  37. 2023Robust Collaborative Filtering to Popularity Distribution Shiftcited by 12
  38. 2022Towards Out-of-Distribution Sequential Event Prediction: A Causal Treatmentcited by 10

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 6; 2026: 4.

11 papers.