Transport-Hub-Aware Spatial-Temporal Adaptive Graph Transformer for Traffic Flow Prediction
Not on the map. Why?
Abstract (arXiv)
As a core technology of Intelligent Transportation System (ITS), traffic flow prediction has a wide range of applications. Traffic flow data are spatial-temporal, which are not only correlated to spatial locations in road networks, but also vary with temporal time indices. Existing methods have solved the challenges in traffic flow prediction partly, focusing on modeling spatial-temporal dependencies effectively, while not all intrinsic properties of traffic flow data are utilized fully. Besides, there are very few attempts at incremental learning of spatial-temporal data mining, and few previous works can be easily transferred to the traffic flow prediction task. Motivated by the challenge of incremental learning methods for traffic flow prediction and the underutilization of intrinsic properties of road networks, we propose a Transport-Hub-aware Spatial-Temporal adaptive graph transFormer (H-STFormer) for traffic flow prediction. Specifically, we first design a novel spatial self-attention module to capture the dynamic spatial dependencies. Three graph masking matrices are integrated into spatial self-attentions to highlight both short- and long-term dependences. Additionally, we employ a temporal self-attention module to detect dynamic temporal patterns in the traffic flow data. Finally, we design an extra spatial-temporal knowledge distillation module for incremental learning of traffic flow prediction tasks. Through extensive experiments, we show the effectiveness of H-STFormer in normal and incremental traffic flow prediction tasks. The code is available at https://github.com/Fantasy-Shaw/H-STFormer.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 66 references that are in the map. First posted on arXiv 12 Oct 2023.
Builds on
36 of 66 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Learning without Forgettingcited by 2,465
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
- 2018Experience Replay for Continual Learningcited by 1,074
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
- 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
24 more
- 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 594
- 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 433
- 2017Variational Continual Learningcited by 335
- 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
- 2020Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlookscited by 312
- 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 212
- 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 209
- 2020Modeling the Background for Incremental Learning in Semantic Segmentationcited by 189
- 2019Episodic Memory in Lifelong Language Learningcited by 188
- 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 179
- 2019Deep Learning for Spatio-Temporal Data Mining: A Surveycited by 171
- 2023FLatten Transformer: Vision Transformer using Focused Linear Attentioncited by 170
- 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
- 2023PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Predictioncited by 135
- 2021SeqFormer: Sequential Transformer for Video Instance Segmentationcited by 98
- 2022Spatio-Temporal Self-Supervised Learning for Traffic Flow Predictioncited by 77
- 2021Incremental Few-Shot Instance Segmentationcited by 49
- 2020Preserving Dynamic Attention for Long-Term Spatial-Temporal Predictioncited by 30
- 2018Deep Sequence Learning with Auxiliary Information for Traffic Predictioncited by 29
- 2020Neural Topic Modeling with Continual Lifelong Learningcited by 24
- 2022Mutual Distillation Learning Network for Trajectory-User Linkingcited by 15
- 2021A Simple Single-Scale Vision Transformer for Object Localization and Instance Segmentationcited by 12
- 2022A Correlation Information-based Spatiotemporal Network for Traffic Flow Forecastingcited by 3
- 2022MegaCRN: Meta-Graph Convolutional Recurrent Network for Spatio-Temporal Modelingcited by 3
Built on by
Not cited yet.