Rethinking Urban Mobility Prediction: A Super-Multivariate Time Series Forecasting Approach
Not on the map. Why?
Abstract (arXiv)
Long-term urban mobility predictions play a crucial role in the effective management of urban facilities and services. Conventionally, urban mobility data has been structured as spatiotemporal videos, treating longitude and latitude grids as fundamental pixels. Consequently, video prediction methods, relying on Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), have been instrumental in this domain. In our research, we introduce a fresh perspective on urban mobility prediction. Instead of oversimplifying urban mobility data as traditional video data, we regard it as a complex multivariate time series. This perspective involves treating the time-varying values of each grid in each channel as individual time series, necessitating a thorough examination of temporal dynamics, cross-variable correlations, and frequency-domain insights for precise and reliable predictions. To address this challenge, we present the Super-Multivariate Urban Mobility Transformer (SUMformer), which utilizes a specially designed attention mechanism to calculate temporal and cross-variable correlations and reduce computational costs stemming from a large number of time series. SUMformer also employs low-frequency filters to extract essential information for long-term predictions. Furthermore, SUMformer is structured with a temporal patch merge mechanism, forming a hierarchical framework that enables the capture of multi-scale correlations. Consequently, it excels in urban mobility pattern modeling and long-term prediction, outperforming current state-of-the-art methods across three real-world datasets.
Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Builds on 37 of its 57 references that are in the map. First posted on arXiv 4 Dec 2023.
Builds on
37 of 57 references.
References · 37
- 2017Attention Is All You Needcited by 60,106
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,111
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,857
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,157
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,016
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,665
- 2021ViViT: A Video Vision Transformercited by 1,615
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,469
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,460
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,442
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,413
25 more
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,206
- 2017Deep Image Priorcited by 1,097
- 2021Video Swin Transformercited by 1,090
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,043
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 766
- 2021ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biasescited by 484
- 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 333
- 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 194
- 2022SimVP: Simpler yet Better Video Predictioncited by 184
- 2019Deep Learning for Spatio-Temporal Data Mining: A Surveycited by 172
- 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 151
- 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 144
- 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
- 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
- 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 112
- 2023The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecastingcited by 100
- 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 92
- 2022Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learningcited by 86
- 2021Fastformer: Additive Attention Can Be All You Needcited by 61
- 2023SwinLSTM:Improving Spatiotemporal Prediction Accuracy using Swin Transformer and LSTMcited by 32
- 2020Preserving Dynamic Attention for Long-Term Spatial-Temporal Predictioncited by 30
- 2018Attentive Crowd Flow Machinescited by 22
- 2023MLPST: MLP is All You Need for Spatio-Temporal Predictioncited by 22
- 2019CrevNet: Conditionally Reversible Video Predictioncited by 15
- 2023Enhancing Representation Learning for Periodic Time Series with Floss: A Frequency Domain Regularization Approachcited by 5
Built on by
Citing papers per year: 2024: 3.
3 papers.