GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs
Not on the map. Why?
Abstract (arXiv)
We propose a new network architecture, Gated Attention Networks (GaAN), for learning on graphs. Unlike the traditional multi-head attention mechanism, which equally consumes all attention heads, GaAN uses a convolutional sub-network to control each attention head's importance. We demonstrate the effectiveness of GaAN on the inductive node classification problem. Moreover, with GaAN as a building block, we construct the Graph Gated Recurrent Unit (GGRU) to address the traffic speed forecasting problem. Extensive experiments on three real-world datasets show that our GaAN framework achieves state-of-the-art results on both tasks.
Key facts. Cited by 164 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 50; 2022: 46; 2023: 28; 2024: 19; 2025: 11; 2026: 10.
164 papers.
Sort:
By area:
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 266
- 2021Graph Neural Network for Traffic Forecasting: A Surveycited by 260
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
- 2021Graph Learning: A Surveycited by 140
- 2021ETA Prediction with Graph Neural Networks in Google Mapscited by 130
- 2022Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic Forecastingcited by 122
- 2021SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networkscited by 108
- 2021PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equationscited by 106
- 2022How to Find Your Friendly Neighborhood: Graph Attention Design with Self-Supervisioncited by 102
- 2021Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural Networkscited by 93
38 more
- 2021BertGCN: Transductive Text Classification by Combining GCN and BERTcited by 74
- 2021Graph-MLP: Node Classification without Message Passing in Graphcited by 73
- 2021DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Predictioncited by 73
- 2022Learning to Reconstruct Missing Data from Spatiotemporal Graphs with Sparse Observationscited by 64
- 2022Video Transformers: A Surveycited by 63
- 2021A Review of Graph Neural Networks and Their Applications in Power Systemscited by 62
- 2023GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge Graphscited by 57
- 2021Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless Threadscited by 51
- 2022Gradient Gating for Deep Multi-Rate Learning on Graphscited by 49
- 2021How Framelets Enhance Graph Neural Networkscited by 46
- 20233Mformer: Multi-order Multi-mode Transformer for Skeletal Action Recognitioncited by 40
- 2023Taming Local Effects in Graph-based Spatiotemporal Forecastingcited by 37
- 2021Combining Graph Neural Networks with Expert Knowledge for Smart Contract Vulnerability Detectioncited by 34
- 2022HRCF: Enhancing Collaborative Filtering via Hyperbolic Geometric Regularizationcited by 34
- 2022Thermodynamics-informed graph neural networkscited by 31
- 2022Graph Lifelong Learning: A Surveycited by 30
- 2022Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysiscited by 29
- 2021SPAGAN: Shortest Path Graph Attention Networkcited by 28
- 2021Learning dynamic and hierarchical traffic spatiotemporal features with Transformercited by 26
- 2021Scalable deeper graph neural networks for high-performance materials property predictioncited by 26
- 2023Graph Deep Learning for Time Series Forecastingcited by 26
- 2021Graph Attention Recurrent Neural Networks for Correlated Time Series Forecasting -- Full versioncited by 24
- 2022Path-Aware Graph Attention for HD Maps in Motion Predictioncited by 23
- 2022Graph Neural Networks for Moleculescited by 21
- 2021Learning Connectivity with Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 20
- 2021FeatureNorm: L2 Feature Normalization for Dynamic Graph Embeddingcited by 19
- 2022Improving Graph Neural Networks with Learnable Propagation Operatorscited by 19
- 2022Affinity-Aware Graph Networkscited by 17
- 2021Graph Neural Networks: Methods, Applications, and Opportunitiescited by 16
- 2021TraverseNet: Unifying Space and Time in Message Passing for Traffic Forecastingcited by 16
- 2021Conditionally Parameterized, Discretization-Aware Neural Networks for Mesh-Based Modeling of Physical Systemscited by 16
- 2022pathGCN: Learning General Graph Spatial Operators from Pathscited by 15
- 2024Graph-based Forecasting with Missing Data through Spatiotemporal Downsamplingcited by 15
- 2022Deep Graph Learning for Anomalous Citation Detectioncited by 14
- 2022PGCN: Progressive Graph Convolutional Networks for Spatial-Temporal Traffic Forecastingcited by 13
- 2022Message Passing Neural Networks for Hypergraphscited by 13
- 2021Learning Graph Neural Networks with Positive and Unlabeled Nodescited by 11
- 2021GCA-Net : Utilizing Gated Context Attention for Improving Image Forgery Localization and Detectioncited by 11
50 most cited of 164 All 164 (JSON)
- 2026STAGformer: A Spatio-temporal Agent Graph Transformer for Micro Mobility Demand Forecasting7 Jul 2026
- 2026Graph Mamba Operator: A Latent Simulator for Interacting Particle Systems8 Jun 2026
- 2026Gated Graph Attention Networks with Learnable Temperature28 May 2026
- 2026GMENet: Generative Mixture of Experts Network for Multi-Center Glioma Diagnosis with Incomplete Imaging Sequences22 May 2026
- 2026A Global-Local Graph Attention Network for Traffic Forecasting16 May 2026
- 2026Attention-based graph neural networks: a survey9 May 2026
- 2026GIST: Gauge-Invariant Spectral Transformers for Scalable Graph Neural Operators17 Mar 2026
- 2026Detecting Fake Reviewer Groups in Dynamic Networks: An Adaptive Graph Learning Method9 Mar 2026
- 2026Generalizing GNNs with Tokenized Mixture of Experts9 Feb 2026
- 2026HT-GNN: Hyper-Temporal Graph Neural Network for Customer Lifetime Value Prediction in Baidu Ads19 Jan 2026
- 2025APC-GNN++: An Adaptive Patient-Centric GNN with Context-Aware Attention and Mini-Graph Explainability for Diabetes Classification20 Dec 2025
- 2025H-CNN-ViT: A Hierarchical Gated Attention Multi-Branch Model for Bladder Cancer Recurrence Prediction17 Nov 2025
38 more
- 2025GraphCliff: Short-Long Range Gating for Modeling Critical Activity Changes Caused by Subtle Molecular Differences5 Nov 2025
- 2025Error Adjustment Based on Spatiotemporal Correlation Fusion for Traffic Forecasting25 Oct 2025
- 2025Image augmentation with invertible networks in interactive satellite image change detection21 Oct 2025
- 2025Label-frugal satellite image change detection with generative virtual exemplar learning8 Oct 2025
- 2025INSPIRE-GNN: Intelligent Sensor Placement to Improve Sparse Bicycling Network Prediction via Reinforcement Learning Boosted Graph Neural Networks31 Jul 2025
- 2025Multi-Scale Harmonic Encoding for Feature-Wise Graph Message Passing21 May 2025
- 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free10 May 2025
- 2025Temporal Attention Evolutional Graph Convolutional Network for Multivariate Time Series Forecasting1 May 2025
- 2025Dynamic Trend Fusion Module for Traffic Flow Prediction18 Jan 2025
- 2024Introduction to Graph Neural Networks for Machine Learning Engineers27 Dec 2024
- 2024Graph Neural Networks in Supply Chain Analytics and Optimization: Concepts, Perspectives, Dataset and Benchmarks13 Nov 2024
- 2024Optimization of GNN Training Through Half-precision2 Nov 2024
- 2024A Systematic Literature Review of Spatio-Temporal Graph Neural Network Models for Time Series Forecasting and Classification29 Oct 2024
- 2024Deep Graph Attention Networks21 Oct 2024
- 2024Evaluating the effects of Data Sparsity on the Link-level Bicycling Volume Estimation: A Graph Convolutional Neural Network Approach11 Oct 2024
- 2024HydroVision: LiDAR-Guided Hydrometric Prediction with Vision Transformers and Hybrid Graph Learning23 Sep 2024
- 2024Heterogeneous Graph Sequence Neural Networks for Dynamic Traffic Assignment7 Aug 2024
- 2024Hierarchical Compression of Text-Rich Graphs via Large Language Models13 Jun 2024
- 2024Temporal Graph Learning Recurrent Neural Network for Traffic Forecasting4 Jun 2024
- 2024Equivariant Spatio-Temporal Attentive Graph Networks to Simulate Physical Dynamics21 May 2024
- 2024ENADPool: The Edge-Node Attention-based Differentiable Pooling for Graph Neural Networks16 May 2024
- 2024Boosting House Price Estimations with Multi-Head Gated Attention13 May 2024
- 2024GNNBENCH: Fair and Productive Benchmarking for Single-GPU GNN System5 Apr 2024
- 2024ChebMixer: Efficient Graph Representation Learning with MLP Mixer25 Mar 2024
- 2024GARNN: An Interpretable Graph Attentive Recurrent Neural Network for Predicting Blood Glucose Levels via Multivariate Time Series26 Feb 2024
- 2024Graph-based Forecasting with Missing Data through Spatiotemporal Downsampling16 Feb 2024
- 2024Single-GPU GNN Systems: Traps and Pitfalls5 Feb 2024
- 2024Overcoming Order in Autoregressive Graph Generation4 Feb 2024
- 2023Reinforcement-based Display-size Selection for Frugal Satellite Image Change Detection28 Dec 2023
- 2023LasTGL: An Industrial Framework for Large-Scale Temporal Graph Learning28 Nov 2023
- 2023Graph Deep Learning for Time Series Forecasting24 Oct 2023
- 2023Asynchronous Graph Generator29 Sep 2023
- 2023Frugal Satellite Image Change Detection with Deep-Net Inversion26 Sep 2023
- 2023From Cluster Assumption to Graph Convolution: Graph-based Semi-Supervised Learning Revisited24 Sep 2023
- 2023Recurrent Temporal Revision Graph Networks22 Sep 2023
- 2023Uncertainty-aware Traffic Prediction under Missing Data13 Sep 2023
- 2023DGC: Training Dynamic Graphs with Spatio-Temporal Non-Uniformity using Graph Partitioning by Chunks7 Sep 2023
- 2023A Comparative Study of Loss Functions: Traffic Predictions in Regular and Congestion Scenarios29 Aug 2023
50 newest of 164 All 164 (JSON)
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2021How Attentive are Graph Attention Networks?cited by 818
- 2021Graph Neural Network for Traffic Forecasting: A Surveycited by 260
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 258
- 2021Graph Learning: A Surveycited by 140
- 2021ETA Prediction with Graph Neural Networks in Google Mapscited by 130
- 2022Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic Forecastingcited by 122
- 2021SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networkscited by 108
- 2021PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equationscited by 106
- 2022How to Find Your Friendly Neighborhood: Graph Attention Design with Self-Supervisioncited by 102
- 2021Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural Networkscited by 93
- 2021BertGCN: Transductive Text Classification by Combining GCN and BERTcited by 74
12 most cited of 160 All 160 (JSON)
- 2026STAGformer: A Spatio-temporal Agent Graph Transformer for Micro Mobility Demand Forecasting7 Jul 2026
- 2026Gated Graph Attention Networks with Learnable Temperature28 May 2026
- 2026A Global-Local Graph Attention Network for Traffic Forecasting16 May 2026
- 2026Attention-based graph neural networks: a survey9 May 2026
- 2026GIST: Gauge-Invariant Spectral Transformers for Scalable Graph Neural Operators17 Mar 2026
- 2026Detecting Fake Reviewer Groups in Dynamic Networks: An Adaptive Graph Learning Method9 Mar 2026
- 2026HT-GNN: Hyper-Temporal Graph Neural Network for Customer Lifetime Value Prediction in Baidu Ads19 Jan 2026
- 2025APC-GNN++: An Adaptive Patient-Centric GNN with Context-Aware Attention and Mini-Graph Explainability for Diabetes Classification20 Dec 2025
- 2025H-CNN-ViT: A Hierarchical Gated Attention Multi-Branch Model for Bladder Cancer Recurrence Prediction17 Nov 2025
- 2025GraphCliff: Short-Long Range Gating for Modeling Critical Activity Changes Caused by Subtle Molecular Differences5 Nov 2025
- 2025Error Adjustment Based on Spatiotemporal Correlation Fusion for Traffic Forecasting25 Oct 2025
- 2025Image augmentation with invertible networks in interactive satellite image change detection21 Oct 2025
12 newest of 160 All 160 (JSON)