mlsanityData to 7 Oct 2026

Universal Graph Transformer Self-Attention Networks

arXiv 1909.11855 ↗First posted 26 Sep 2019cs.LG cs.CV stat.MLcited by 41

Not on the map. Why?

Abstract (arXiv)

We introduce a transformer-based GNN model, named UGformer, to learn graph representations. In particular, we present two UGformer variants, wherein the first variant (publicized in September 2019) is to leverage the transformer on a set of sampled neighbors for each input node, while the second (publicized in May 2021) is to leverage the transformer on all input nodes. Experimental results demonstrate that the first UGformer variant achieves state-of-the-art accuracies on benchmark datasets for graph classification in both inductive setting and unsupervised transductive setting; and the second UGformer variant obtains state-of-the-art accuracies for inductive text classification. The code is available at: urlhttps://github.com/daiquocnguyen/Graph-Transformer.

Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 7; 2022: 7; 2023: 7; 2024: 10; 2025: 6; 2026: 4.

41 papers.

Sort:

By area:

  1. 2022Pure Transformers are Powerful Graph Learnerscited by 188
  2. 2022Transformer for Graphs: An Overview from Architecture Perspectivecited by 107
  3. 2024Graph Mamba: Towards Learning on Graphs with State Space Modelscited by 84
  4. 2023Energy Transformercited by 69
  5. 2024FedGTA: Topology-aware Averaging for Federated Graph Learningcited by 44
  6. 2021ReGVD: Revisiting Graph Neural Networks for Vulnerability Detectioncited by 32
  7. 2024Graph Transformers: A Surveycited by 32
  8. 2021Node Co-occurrence based Graph Neural Networks for Knowledge Graph Link Predictioncited by 12
  9. 2021Joint Graph Learning and Matching for Semantic Feature Correspondencecited by 8
  10. 2022PatchGT: Transformer over Non-trainable Clusters for Learning Graph Representationscited by 8
  11. 2023A Survey on Graph Classification and Link Prediction based on GNNcited by 8
  12. 2024A Survey on Structure-Preserving Graph Transformerscited by 7
29 more
  1. 2023Union Subgraph Neural Networkscited by 6
  2. 2024An Interpretable Ensemble of Graph and Language Models for Improving Search Relevance in E-Commercecited by 6
  3. 2023AGFormer: Efficient Graph Representation with Anchor-Graph Transformercited by 5
  4. 2022Cross-Skeleton Interaction Graph Aggregation Network for Representation Learning of Mouse Social Behaviourcited by 4
  5. 2021EGC2: Enhanced Graph Classification with Easy Graph Compressioncited by 3
  6. 2021Two-view Graph Neural Networks for Knowledge Graph Completioncited by 3
  7. 2022A Class-Aware Representation Refinement Framework for Graph Classificationcited by 3
  8. 2024Tensor-Fused Multi-View Graph Contrastive Learningcited by 3
  9. 2025HGCN(O): A Self-Tuning GCN HyperModel Toolkit for Outcome Prediction in Event-Sequence Datacited by 3
  10. 2024Saliency-Aware Regularized Graph Neural Networkcited by 2
  11. 2025Graph Inverse Style Transfer for Counterfactual Explainabilitycited by 2
  12. 2021AutoHEnsGNN: Winning Solution to AutoGraph Challenge for KDD Cup 2020cited by 1
  13. 2022Inducing Gaussian Process Networkscited by 1
  14. 2023A Graph Transformer-Driven Approach for Network Robustness Learningcited by 1
  15. 2023Multiscale Hodge Scattering Networks for Data Analysiscited by 1
  16. 2024Accelerating Flood Warnings by 10 Hours: The Power of River Network Topology in AI-enhanced Flood Forecastingcited by 1
  17. 2025KAA: Kolmogorov-Arnold Attention for Enhancing Attentive Graph Neural Networkscited by 1
  18. 2025Divergent Paths: Separating Homophilic and Heterophilic Learning for Enhanced Graph-level Representationscited by 1
  19. 2025Pattern-Based Graph Classification: Comparison of Quality Measures and Importance of Preprocessingcited by 1
  20. 2026Attention-based graph neural networks: a surveycited by 1
  21. 2026Context-aware Modality-Topology Co-Alignment for Multimodal Attributed Graphscited by 1
  22. 2021Quadratic GCN for Graph Classificationcited by 0
  23. 2022Predicting Topological Maps for Visual Navigation in Unexplored Environmentscited by 0
  24. 2023Structure-Sensitive Graph Dictionary Embedding for Graph Classificationcited by 0
  25. 2024Identifying Influential nodes in Brain Networks via Self-Supervised Graph-Transformercited by 0
  26. 2024NACNet: A Histology Context-aware Transformer Graph Convolution Network for Predicting Treatment Response to Neoadjuvant Chemotherapy in Triple Negative Breast Cancercited by 0
  27. 2025Attention Beyond Neighborhoods: Reviving Transformer for Graph Clusteringcited by 0
  28. 2026CTQWformer: A CTQW-based Transformer for Graph Classificationcited by 0
  29. 2026Controlled Dynamics Attractor Transformercited by 0