Pre-training Graph Neural Network for Cross Domain Recommendation
Not on the map. Why?
Abstract (arXiv)
A recommender system predicts users' potential interests in items, where the core is to learn user/item embeddings. Nevertheless, it suffers from the data-sparsity issue, which the cross-domain recommendation can alleviate. However, most prior works either jointly learn the source domain and target domain models, or require side-features. However, jointly training and side features would affect the prediction on the target domain as the learned embedding is dominated by the source domain containing bias information. Inspired by the contemporary arts in pre-training from graph representation learning, we propose a pre-training and fine-tuning diagram for cross-domain recommendation. We devise a novel Pre-training Graph Neural Network for Cross-Domain Recommendation (PCRec), which adopts the contrastive self-supervised pre-training of a graph encoder. Then, we transfer the pre-trained graph encoder to initialize the node embeddings on the target domain, which benefits the fine-tuning of the single domain recommender system on the target domain. The experimental results demonstrate the superiority of PCRec. Detailed analyses verify the superiority of PCRec in transferring information while avoiding biases from source domains.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 21 of its 39 references that are in the map. First posted on arXiv 16 Nov 2021.
Builds on
21 of 39 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2017Neural Collaborative Filteringcited by 1,108
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2020Contrastive Multi-View Representation Learning on Graphscited by 651
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
- 2020Self-supervised Graph Learning for Recommendationcited by 305
9 more
- 2014Collaborative Deep Learning for Recommender Systemscited by 95
- 2018CoNet: Collaborative Cross Networks for Cross-Domain Recommendationcited by 81
- 2021Cross-Domain Recommendation: Challenges, Progress, and Prospectscited by 74
- 2019DDTCDR: Deep Dual Transfer Cross Domain Recommendationcited by 71
- 2021Contrastive Self-supervised Sequential Recommendation with Robust Augmentationcited by 56
- 2020BasConv: Aggregating Heterogeneous Interactions for Basket Recommendation with Graph Convolutional Neural Networkcited by 16
- 2020Basket Recommendation with Multi-Intent Translation Graph Neural Networkcited by 16
- 2019JSCN: Joint Spectral Convolutional Network for Cross Domain Recommendationcited by 8
- 2018Cross-Domain Recommendation for Cold-Start Users via Neighborhood Based Feature Mappingcited by 6
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 5; 2024: 1; 2025: 4; 2026: 1.
14 papers.
Sort:
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 61
- 2021Federated Social Recommendation with Graph Neural Networkcited by 56
- 2022Sequential Recommendation via Stochastic Self-Attentioncited by 37
- 2023Embedding in Recommender Systems: A Surveycited by 19
- 2023Multi-task Item-attribute Graph Pre-training for Strict Cold-start Item Recommendationcited by 13
- 2023Zero-shot Item-based Recommendation via Multi-task Product Knowledge Graph Pre-Trainingcited by 12
- 2023MAP: A Model-agnostic Pretraining Framework for Click-through Rate Predictioncited by 10
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendationcited by 6
- 2023Hybrid Contrastive Constraints for Multi-Scenario Ad Rankingcited by 4
- 2022Sequential Recommendation with Auxiliary Item Relationships via Multi-Relational Transformercited by 3
- 2025A Survey of Cross-domain Graph Learning: Progress and Future Directionscited by 2
- 2025Separated Contrastive Learning for Matching in Cross-domain Recommendation with Curriculum Schedulingcited by 0
- 2026Debiasing Message Passing to Mitigate Popularity Bias in GNN-based Collaborative Filtering11 May 2026
- 2025TextBridgeGNN: Pre-training Graph Neural Network for Cross-Domain Recommendation via Text-Guided Transfer25 Nov 2025
- 2025A Survey of Cross-domain Graph Learning: Progress and Future Directions14 Mar 2025
- 2025Separated Contrastive Learning for Matching in Cross-domain Recommendation with Curriculum Scheduling22 Feb 2025
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptation8 Feb 2025
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendation4 Apr 2024
- 2023Embedding in Recommender Systems: A Survey28 Oct 2023
- 2023MAP: A Model-agnostic Pretraining Framework for Click-through Rate Prediction3 Aug 2023
- 2023Multi-task Item-attribute Graph Pre-training for Strict Cold-start Item Recommendation26 Jun 2023
- 2023Zero-shot Item-based Recommendation via Multi-task Product Knowledge Graph Pre-Training12 May 2023
- 2023Hybrid Contrastive Constraints for Multi-Scenario Ad Ranking6 Feb 2023
- 2022Sequential Recommendation with Auxiliary Item Relationships via Multi-Relational Transformer24 Oct 2022
2 more
- 2022Sequential Recommendation via Stochastic Self-Attention16 Jan 2022
- 2021Federated Social Recommendation with Graph Neural Network21 Nov 2021
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptationcited by 61
- 2021Federated Social Recommendation with Graph Neural Networkcited by 56
- 2022Sequential Recommendation via Stochastic Self-Attentioncited by 37
- 2023Embedding in Recommender Systems: A Surveycited by 19
- 2023Multi-task Item-attribute Graph Pre-training for Strict Cold-start Item Recommendationcited by 13
- 2023Zero-shot Item-based Recommendation via Multi-task Product Knowledge Graph Pre-Trainingcited by 12
- 2023MAP: A Model-agnostic Pretraining Framework for Click-through Rate Predictioncited by 10
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendationcited by 6
- 2023Hybrid Contrastive Constraints for Multi-Scenario Ad Rankingcited by 4
- 2022Sequential Recommendation with Auxiliary Item Relationships via Multi-Relational Transformercited by 3
- 2025A Survey of Cross-domain Graph Learning: Progress and Future Directionscited by 2
- 2025Separated Contrastive Learning for Matching in Cross-domain Recommendation with Curriculum Schedulingcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Debiasing Message Passing to Mitigate Popularity Bias in GNN-based Collaborative Filtering11 May 2026
- 2025TextBridgeGNN: Pre-training Graph Neural Network for Cross-Domain Recommendation via Text-Guided Transfer25 Nov 2025
- 2025A Survey of Cross-domain Graph Learning: Progress and Future Directions14 Mar 2025
- 2025Separated Contrastive Learning for Matching in Cross-domain Recommendation with Curriculum Scheduling22 Feb 2025
- 2025SAMGPT: Text-free Graph Foundation Model for Multi-domain Pre-training and Cross-domain Adaptation8 Feb 2025
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendation4 Apr 2024
- 2023Embedding in Recommender Systems: A Survey28 Oct 2023
- 2023MAP: A Model-agnostic Pretraining Framework for Click-through Rate Prediction3 Aug 2023
- 2023Multi-task Item-attribute Graph Pre-training for Strict Cold-start Item Recommendation26 Jun 2023
- 2023Zero-shot Item-based Recommendation via Multi-task Product Knowledge Graph Pre-Training12 May 2023
- 2023Hybrid Contrastive Constraints for Multi-Scenario Ad Ranking6 Feb 2023
- 2022Sequential Recommendation with Auxiliary Item Relationships via Multi-Relational Transformer24 Oct 2022
12 newest of 14 All 14 (JSON)