mlsanityData to 13 Oct 2026

Rethinking Urban Mobility Prediction: A Super-Multivariate Time Series Forecasting Approach

arXiv 2312.01699 ↗First posted 4 Dec 2023cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Long-term urban mobility predictions play a crucial role in the effective management of urban facilities and services. Conventionally, urban mobility data has been structured as spatiotemporal videos, treating longitude and latitude grids as fundamental pixels. Consequently, video prediction methods, relying on Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), have been instrumental in this domain. In our research, we introduce a fresh perspective on urban mobility prediction. Instead of oversimplifying urban mobility data as traditional video data, we regard it as a complex multivariate time series. This perspective involves treating the time-varying values of each grid in each channel as individual time series, necessitating a thorough examination of temporal dynamics, cross-variable correlations, and frequency-domain insights for precise and reliable predictions. To address this challenge, we present the Super-Multivariate Urban Mobility Transformer (SUMformer), which utilizes a specially designed attention mechanism to calculate temporal and cross-variable correlations and reduce computational costs stemming from a large number of time series. SUMformer also employs low-frequency filters to extract essential information for long-term predictions. Furthermore, SUMformer is structured with a temporal patch merge mechanism, forming a hierarchical framework that enables the capture of multi-scale correlations. Consequently, it excels in urban mobility pattern modeling and long-term prediction, outperforming current state-of-the-art methods across three real-world datasets.

Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Builds on 37 of its 57 references that are in the map. First posted on arXiv 4 Dec 2023.

Builds on

37 of 57 references.

References · 37

  1. 2017Attention Is All You Needcited by 60,106
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,111
  4. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,857
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,157
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,016
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,665
  8. 2021ViViT: A Video Vision Transformercited by 1,615
  9. 2020Linformer: Self-Attention with Linear Complexitycited by 1,469
  10. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,460
  11. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,442
  12. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,413
25 more
  1. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,206
  2. 2017Deep Image Priorcited by 1,097
  3. 2021Video Swin Transformercited by 1,090
  4. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,043
  5. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 766
  6. 2021ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biasescited by 484
  7. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 333
  8. 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 194
  9. 2022SimVP: Simpler yet Better Video Predictioncited by 184
  10. 2019Deep Learning for Spatio-Temporal Data Mining: A Surveycited by 172
  11. 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 151
  12. 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 144
  13. 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
  14. 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
  15. 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 112
  16. 2023The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecastingcited by 100
  17. 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 92
  18. 2022Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learningcited by 86
  19. 2021Fastformer: Additive Attention Can Be All You Needcited by 61
  20. 2023SwinLSTM:Improving Spatiotemporal Prediction Accuracy using Swin Transformer and LSTMcited by 32
  21. 2020Preserving Dynamic Attention for Long-Term Spatial-Temporal Predictioncited by 30
  22. 2018Attentive Crowd Flow Machinescited by 22
  23. 2023MLPST: MLP is All You Need for Spatio-Temporal Predictioncited by 22
  24. 2019CrevNet: Conditionally Reversible Video Predictioncited by 15
  25. 2023Enhancing Representation Learning for Periodic Time Series with Floss: A Frequency Domain Regularization Approachcited by 5

Built on by

Cited by year

Citing papers per year: 2024: 3.

3 papers.