mlsanityData to 14 Oct 2026

HetCAN: A Heterogeneous Graph Cascade Attention Network with Dual-Level Awareness

arXiv 2311.03275 ↗First posted 6 Nov 2023cs.LG cs.SIcited by 0

Not on the map. Why?

Abstract (arXiv)

Heterogeneous graph neural networks(HGNNs) have recently shown impressive capability in modeling heterogeneous graphs that are ubiquitous in real-world applications. Most existing methods for heterogeneous graphs mainly learn node embeddings by stacking multiple convolutional or attentional layers, which can be considered as capturing the high-order information from node-level aspect. However, different types of nodes in heterogeneous graphs have diverse features, it is also necessary to capture interactions among node features, namely the high-order information from feature-level aspect. In addition, most methods first align node features by mapping them into one same low-dimensional space, while they may lose some type information of nodes in this way. To address these problems, in this paper, we propose a novel Heterogeneous graph Cascade Attention Network (HetCAN) composed of multiple cascade blocks. Each cascade block includes two components, the type-aware encoder and the dimension-aware encoder. Specifically, the type-aware encoder compensates for the loss of node type information and aims to make full use of graph heterogeneity. The dimension-aware encoder is able to learn the feature-level high-order information by capturing the interactions among node features. With the assistance of these components, HetCAN can comprehensively encode information of node features, graph heterogeneity and graph structure in node embeddings. Extensive experiments demonstrate the superiority of HetCAN over advanced competitors and also exhibit its efficiency and robustness.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 6 Nov 2023.

Builds on

23 of 31 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2017Graph Attention Networkscited by 8,923
  5. 2017Inductive Representation Learning on Large Graphscited by 6,320
  6. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  7. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  8. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,694
  9. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
  10. 2019Heterogeneous Graph Attention Networkcited by 734
  11. 2015LINE: Large-scale Information Network Embeddingcited by 582
  12. 2020Heterogeneous Graph Transformercited by 582
11 more
  1. 2020MAGNN: Metapath Aggregated Graph Neural Network for Heterogeneous Graph Embeddingcited by 304
  2. 2021Are we really making much progress? Revisiting, benchmarking, and refining heterogeneous graph neural networkscited by 176
  3. 2021Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learningcited by 130
  4. 2020A Survey on Heterogeneous Graph Embedding: Methods, Techniques, Applications and Sourcescited by 126
  5. 2015A Survey of Heterogeneous Information Network Analysiscited by 110
  6. 2015PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networkscited by 96
  7. 2022Simple and Efficient Heterogeneous Graph Neural Networkcited by 71
  8. 2020RealFormer: Transformer Likes Residual Attentioncited by 62
  9. 2019STAR-GCN: Stacked and Reconstructed Graph Convolutional Networks for Recommender Systemscited by 54
  10. 2023HINormer: Representation Learning On Heterogeneous Information Networks with Graph Transformercited by 35
  11. 2018Easing Embedding Learning by Comprehensive Transcription of Heterogeneous Information Networkscited by 14

Built on by

Not cited yet.