Self-Supervised Hypergraph Transformer for Recommender Systems
Not on the map. Why?
Abstract (arXiv)
Graph Neural Networks (GNNs) have been shown as promising solutions for collaborative filtering (CF) with the modeling of user-item interaction graphs. The key idea of existing GNN-based recommender systems is to recursively perform the message passing along the user-item interaction edge for refining the encoded embeddings. Despite their effectiveness, however, most of the current recommendation models rely on sufficient and high-quality training data, such that the learned representations can well capture accurate user preference. User behavior data in many practical recommendation scenarios is often noisy and exhibits skewed distribution, which may result in suboptimal representation performance in GNN-based models. In this paper, we propose SHT, a novel Self-Supervised Hypergraph Transformer framework (SHT) which augments user representations by exploring the global collaborative relationships in an explicit way. Specifically, we first empower the graph neural CF paradigm to maintain global collaborative effects among users and items with a hypergraph transformer network. With the distilled global context, a cross-view generative self-supervised learning component is proposed for data augmentation over the user-item interaction graph, so as to enhance the robustness of recommender systems. Extensive experiments demonstrate that SHT can significantly improve the performance over various state-of-the-art baselines. Further ablation studies show the superior representation ability of our SHT recommendation framework in alleviating the data sparsity and noise issues. The source code and evaluation datasets are available at: https://github.com/akaxlh/SHT.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 30 of its 42 references that are in the map. First posted on arXiv 28 Jul 2022.
Builds on
30 of 42 references.
References · 30
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
- 2017Neural Collaborative Filteringcited by 1,108
- 2018Deep Graph Infomaxcited by 1,101
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
- 2019Heterogeneous Graph Attention Networkcited by 732
- 2020Self-supervised Learning: Generative or Contrastivecited by 693
- 2019Neural Graph Collaborative Filteringcited by 660
- 2018Variational Autoencoders for Collaborative Filteringcited by 308
- 2020Self-supervised Graph Learning for Recommendationcited by 305
- 2020Graph Representation Learning via Graphical Mutual Information Maximizationcited by 217
18 more
- 2020Neural Collaborative Filtering vs. Matrix Factorization Revisitedcited by 123
- 2020Revisiting Graph based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approachcited by 119
- 2020Disentangled Graph Collaborative Filteringcited by 118
- 2021Causal Intervention for Leveraging Popularity Bias in Recommendationcited by 116
- 2021Self-Supervised Multi-Channel Hypergraph Convolutional Network for Social Recommendationcited by 101
- 2022Knowledge Graph Contrastive Learning for Recommendationcited by 69
- 2022Hypergraph Contrastive Collaborative Filteringcited by 63
- 2019STAR-GCN: Stacked and Reconstructed Graph Convolutional Networks for Recommender Systemscited by 54
- 2021Knowledge-aware Coupled Graph Neural Network for Social Recommendationcited by 49
- 2021Knowledge-Enhanced Hierarchical Graph Transformer Network for Multi-Behavior Recommendationcited by 39
- 2020Self-supervised Auxiliary Learning with Meta-paths for Heterogeneous Graphscited by 38
- 2020A Model of Two Tales: Dual Transfer Learning Framework for Improved Long-tail Item Recommendationcited by 38
- 2021Graph Meta Network for Multi-Behavior Recommendationcited by 38
- 2021DisenHAN: Disentangled Heterogeneous Graph Attention Network for Recommendationcited by 28
- 2020Sequential Recommendation with Self-Attentive Multi-Adversarial Networkcited by 26
- 2021Hyper Meta-Path Contrastive Learning for Multi-Behavior Recommendationcited by 21
- 2021Concept-Aware Denoising Graph Neural Network for Micro-Video Recommendationcited by 18
- 2021Recent Advances in Heterogeneous Relation Learning for Recommendationcited by 13
Built on by
Citing papers per year: 2022: 1; 2023: 9; 2024: 12; 2025: 7; 2026: 3.
32 papers.
Sort:
By area:
- 2023LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendationcited by 72
- 2024Graph Transformers: A Surveycited by 32
- 2023Graph Masked Autoencoder for Sequential Recommendationcited by 19
- 2024HypeBoy: Generative Self-Supervised Representation Learning on Hypergraphscited by 15
- 2023A Survey on Fairness-aware Recommender Systemscited by 14
- 2023TransGNN: Harnessing the Collaborative Power of Transformers and Graph Neural Networks for Recommender Systemscited by 11
- 2024RevGNN: Negative Sampling Enhanced Contrastive Graph Learning for Academic Reviewer Recommendationcited by 8
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendationcited by 6
- 2024Hypergraph Self-supervised Learning with Sampling-efficient Signalscited by 6
- 2024Space-aware Socioeconomic Indicator Inference with Heterogeneous Graphscited by 5
- 2022Graph Learning and Its Advancements on Large Language Models: A Holistic Surveycited by 4
- 2023How Expressive are Graph Neural Networks in Recommendation?cited by 3
20 more
- 2023RDGCL: Reaction-Diffusion Graph Contrastive Learning for Recommendationcited by 3
- 2023Topology-guided Hypergraph Transformer Network: Unveiling Structural Insights for Improved Representationcited by 2
- 2024COOL: A Conjoint Perspective on Spatio-Temporal Graph Neural Network for Traffic Forecastingcited by 2
- 2025HiTeC: Hierarchical Contrastive Learning on Text-Attributed Hypergraph with Semantic-Aware Augmentationcited by 2
- 2026Tackling Over-smoothing on Hypergraphs: A Ricci Flow-guided Neural Diffusion Approachcited by 2
- 2023Capturing Popularity Trends: A Simplistic Non-Personalized Approach for Enhanced Item Recommendationcited by 1
- 2024Heterogeneous Hypergraph Embedding for Recommendation Systemscited by 1
- 2024SiMilarity-Enhanced Homophily for Multi-View Heterophilous Graph Clusteringcited by 1
- 2025Handling Heterophily in Recommender Systems with Wavelet Hypergraph Diffusioncited by 1
- 2025Two-dimensional Taxonomy for N-ary Knowledge Representation Learning Methodscited by 1
- 2023Hypergraph Enhanced Knowledge Tree Prompt Learning for Next-Basket Recommendationcited by 0
- 2024Matrix Completion with Hypergraphs:Sharp Thresholds and Efficient Algorithmscited by 0
- 2024Bilateral Unsymmetrical Graph Contrastive Learning for Recommendationcited by 0
- 2024HyperSMOTE: A Hypergraph-based Oversampling Approach for Imbalanced Node Classificationscited by 0
- 2025Hypergraph Diffusion for High-Order Recommender Systemscited by 0
- 2025Academic Network Representation via Prediction-Sampling Incorporated Tensor Factorizationcited by 0
- 2025Structure-aware Hypergraph Transformer for Diagnosis Prediction in Electronic Health Recordscited by 0
- 2025Hypergraph Contrastive Learning for both Homophilic and Heterophilic Hypergraphscited by 0
- 2026RaDAR: Relation-aware Diffusion-Asymmetric Graph Contrastive Learning for Recommendationcited by 0
- 2026Joint Behavior-guided and Modality-coherence Conditional Graph Diffusion Denoising for Multi Modal Recommendationcited by 0
- 2026Joint Behavior-guided and Modality-coherence Conditional Graph Diffusion Denoising for Multi Modal Recommendation4 Apr 2026
- 2026RaDAR: Relation-aware Diffusion-Asymmetric Graph Contrastive Learning for Recommendation17 Mar 2026
- 2026Tackling Over-smoothing on Hypergraphs: A Ricci Flow-guided Neural Diffusion Approach16 Mar 2026
- 2025Hypergraph Contrastive Learning for both Homophilic and Heterophilic Hypergraphs24 Nov 2025
- 2025Structure-aware Hypergraph Transformer for Diagnosis Prediction in Electronic Health Records28 Aug 2025
- 2025HiTeC: Hierarchical Contrastive Learning on Text-Attributed Hypergraph with Semantic-Aware Augmentation5 Aug 2025
- 2025Two-dimensional Taxonomy for N-ary Knowledge Representation Learning Methods5 Jun 2025
- 2025Academic Network Representation via Prediction-Sampling Incorporated Tensor Factorization11 Apr 2025
- 2025Hypergraph Diffusion for High-Order Recommender Systems28 Jan 2025
- 2025Handling Heterophily in Recommender Systems with Wavelet Hypergraph Diffusion24 Jan 2025
- 2024SiMilarity-Enhanced Homophily for Multi-View Heterophilous Graph Clustering4 Oct 2024
- 2024HyperSMOTE: A Hypergraph-based Oversampling Approach for Imbalanced Node Classifications9 Sep 2024
20 more
- 2024RevGNN: Negative Sampling Enhanced Contrastive Graph Learning for Academic Reviewer Recommendation30 Jul 2024
- 2024Graph Transformers: A Survey13 Jul 2024
- 2024Heterogeneous Hypergraph Embedding for Recommendation Systems4 Jul 2024
- 2024Space-aware Socioeconomic Indicator Inference with Heterogeneous Graphs23 May 2024
- 2024Hypergraph Self-supervised Learning with Sampling-efficient Signals18 Apr 2024
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendation4 Apr 2024
- 2024HypeBoy: Generative Self-Supervised Representation Learning on Hypergraphs31 Mar 2024
- 2024Bilateral Unsymmetrical Graph Contrastive Learning for Recommendation22 Mar 2024
- 2024COOL: A Conjoint Perspective on Spatio-Temporal Graph Neural Network for Traffic Forecasting2 Mar 2024
- 2024Matrix Completion with Hypergraphs:Sharp Thresholds and Efficient Algorithms16 Jan 2024
- 2023RDGCL: Reaction-Diffusion Graph Contrastive Learning for Recommendation27 Dec 2023
- 2023Hypergraph Enhanced Knowledge Tree Prompt Learning for Next-Basket Recommendation26 Dec 2023
- 2023Topology-guided Hypergraph Transformer Network: Unveiling Structural Insights for Improved Representation14 Oct 2023
- 2023TransGNN: Harnessing the Collaborative Power of Transformers and Graph Neural Networks for Recommender Systems28 Aug 2023
- 2023How Expressive are Graph Neural Networks in Recommendation?22 Aug 2023
- 2023Capturing Popularity Trends: A Simplistic Non-Personalized Approach for Enhanced Item Recommendation17 Aug 2023
- 2023A Survey on Fairness-aware Recommender Systems1 Jun 2023
- 2023Graph Masked Autoencoder for Sequential Recommendation8 May 2023
- 2023LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendation16 Feb 2023
- 2022Graph Learning and Its Advancements on Large Language Models: A Holistic Survey17 Dec 2022
- 2023LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendationcited by 72
- 2024Graph Transformers: A Surveycited by 32
- 2023Graph Masked Autoencoder for Sequential Recommendationcited by 19
- 2024HypeBoy: Generative Self-Supervised Representation Learning on Hypergraphscited by 15
- 2023A Survey on Fairness-aware Recommender Systemscited by 14
- 2023TransGNN: Harnessing the Collaborative Power of Transformers and Graph Neural Networks for Recommender Systemscited by 11
- 2024RevGNN: Negative Sampling Enhanced Contrastive Graph Learning for Academic Reviewer Recommendationcited by 8
- 2024A Comprehensive Survey on Self-Supervised Learning for Recommendationcited by 6
- 2024Hypergraph Self-supervised Learning with Sampling-efficient Signalscited by 6
- 2024Space-aware Socioeconomic Indicator Inference with Heterogeneous Graphscited by 5
- 2022Graph Learning and Its Advancements on Large Language Models: A Holistic Surveycited by 4
- 2023How Expressive are Graph Neural Networks in Recommendation?cited by 3
12 most cited of 31 All 31 (JSON)
- 2026RaDAR: Relation-aware Diffusion-Asymmetric Graph Contrastive Learning for Recommendation17 Mar 2026
- 2026Tackling Over-smoothing on Hypergraphs: A Ricci Flow-guided Neural Diffusion Approach16 Mar 2026
- 2025Hypergraph Contrastive Learning for both Homophilic and Heterophilic Hypergraphs24 Nov 2025
- 2025Structure-aware Hypergraph Transformer for Diagnosis Prediction in Electronic Health Records28 Aug 2025
- 2025HiTeC: Hierarchical Contrastive Learning on Text-Attributed Hypergraph with Semantic-Aware Augmentation5 Aug 2025
- 2025Two-dimensional Taxonomy for N-ary Knowledge Representation Learning Methods5 Jun 2025
- 2025Academic Network Representation via Prediction-Sampling Incorporated Tensor Factorization11 Apr 2025
- 2025Hypergraph Diffusion for High-Order Recommender Systems28 Jan 2025
- 2025Handling Heterophily in Recommender Systems with Wavelet Hypergraph Diffusion24 Jan 2025
- 2024SiMilarity-Enhanced Homophily for Multi-View Heterophilous Graph Clustering4 Oct 2024
- 2024HyperSMOTE: A Hypergraph-based Oversampling Approach for Imbalanced Node Classifications9 Sep 2024
- 2024RevGNN: Negative Sampling Enhanced Contrastive Graph Learning for Academic Reviewer Recommendation30 Jul 2024
12 newest of 31 All 31 (JSON)