STAGformer: A Spatio-temporal Agent Graph Transformer for Micro Mobility Demand Forecasting
Not on the map. Why?
Abstract (arXiv)
Accurate station-level demand forecasting is essential for the efficient operation of bike-sharing systems, yet it remains challenging due to complex spatio-temporal dependencies and the large scale of urban networks. This paper presents STAGformer, a Spatio-Temporal Agent Graph Transformer that achieves efficient global modeling with linear computational complexity. The model introduces a two-step agent attention mechanism, where a small set of learnable spatial and temporal agent tokens first aggregate global information and then broadcast it back to individual stations and time steps, effectively capturing long-range interactions while reducing the quadratic cost of standard self-attention to O(NT). STAGformer integrates four core modules: a spatio-temporal encoder that fuses dynamic node features with external contextual factors (weather, time, points of interest), a graph propagation module for spatial neighbor aggregation, a temporal convolution module for local pattern extraction, and the agent attention module for global dependency modeling. Extensive experiments on two real-world datasets -- NYC Citi-Bike and Chicago Divvy-Bike -- demonstrate that STAGformer consistently outperforms state-of-the-art baselines across multiple prediction horizons, achieving significant improvements in both RMSE and MAE. Ablation studies validate the contribution of each component, with the agent attention mechanism proving critical for modeling global spatio-temporal dependencies.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 49 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
27 of 49 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2017Graph Attention Networkscited by 8,923
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
- 2020Rethinking Attention with Performerscited by 1,601
- 2019Generating Long Sequences with Sparse Transformerscited by 1,546
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
- 2021How Attentive are Graph Attention Networks?cited by 835
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
- 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 566
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
15 more
- 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 434
- 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 333
- 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 180
- 2018GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphscited by 165
- 2023Agent Attention: On the Integration of Softmax and Linear Attentioncited by 90
- 2024A Comprehensive Survey of Deep Learning for Time Series Forecasting: Architectural Diversity and Open Challengescited by 47
- 2021TrafficStream: A Streaming Traffic Flow Forecasting Framework Based on Graph Neural Networks and Continual Learningcited by 42
- 2024STGformer: Efficient Spatiotemporal Graph Transformer for Traffic Forecastingcited by 9
- 2024STGFormer: Spatio-Temporal GraphFormer for 3D Human Pose Estimation in Videocited by 3
- 2024Predicting travel demand of a bike sharing system using graph convolutional neural networkscited by 1
- 2024GeOT: A spatially explicit framework for evaluating spatio-temporal predictionscited by 1
- 2024Contextual Data Integration for Bike-sharing Demand Prediction with Graph Neural Networks in Degraded Weather Conditionscited by 1
- 2025Micromobility Flow Prediction: A Bike Sharing Station-level Study via Multi-level Spatial-Temporal Attention Neural Networkcited by 1
- 2026T-STAR: A Context-Aware Transformer Framework for Short-Term Probabilistic Demand Forecasting in Dock-Based Shared Micro-Mobilitycited by 1
- 2026MoDE-Boost: Boosting Shared Mobility Demand with Edge-Ready Prediction Modelscited by 1
Built on by
Not cited yet.