mlsanityData to 7 Oct 2026

UniFlow: A Foundation Model for Unified Urban Spatio-Temporal Flow Prediction

arXiv 2411.12972 ↗First posted 20 Nov 2024cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Urban spatio-temporal flow prediction, encompassing traffic flows and crowd flows, is crucial for optimizing city infrastructure and managing traffic and emergency responses. Traditional approaches have relied on separate models tailored to either grid-based data, representing cities as uniform cells, or graph-based data, modeling cities as networks of nodes and edges. In this paper, we build UniFlow, a foundational model for general urban flow prediction that unifies both grid-based and graphbased data. We first design a multi-view spatio-temporal patching mechanism to standardize different data into a consistent sequential format and then introduce a spatio-temporal transformer architecture to capture complex correlations and dynamics. To leverage shared spatio-temporal patterns across different data types and facilitate effective cross-learning, we propose SpatioTemporal Memory Retrieval Augmentation (ST-MRA). By creating structured memory modules to store shared spatio-temporal patterns, ST-MRA enhances predictions through adaptive memory retrieval. Extensive experiments demonstrate that UniFlow outperforms existing models in both grid-based and graph-based flow prediction, excelling particularly in scenarios with limited data availability, showcasing its superior performance and broad applicability. The datasets and code implementation have been released on https://github.com/YuanYuan98/UniFlow.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 44 of its 67 references that are in the map. First posted on arXiv 20 Nov 2024.

Builds on

44 of 67 references.

References · 44

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  7. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  8. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  9. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  10. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  11. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  12. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
32 more
  1. 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 399
  2. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
  3. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  4. 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
  5. 2022SimVP: Simpler yet Better Video Predictioncited by 181
  6. 2019Deep Learning for Spatio-Temporal Data Mining: A Surveycited by 171
  7. 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 170
  8. 2021Discrete Graph Structure Learning for Forecasting Multiple Time Seriescited by 169
  9. 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 149
  10. 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
  11. 2023PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Predictioncited by 135
  12. 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
  13. 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
  14. 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 109
  15. 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
  16. 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 91
  17. 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 86
  18. 2022Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learningcited by 84
  19. 2024UrbanGPT: Spatio-Temporal Large Language Modelscited by 81
  20. 2022Spatio-Temporal Self-Supervised Learning for Traffic Flow Predictioncited by 77
  21. 2023ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendationcited by 76
  22. 2023Spatio-temporal Diffusion Point Processescited by 52
  23. 2023Urban Generative Intelligence (UGI): A Foundational Platform for Agents in Embodied City Environmentcited by 37
  24. 2019UrbanFM: Inferring Fine-Grained Urban Flowscited by 31
  25. 2024How Can Large Language Models Understand Spatial-Temporal Data?cited by 31
  26. 2024CityGPT: Empowering Urban Spatial Cognition of Large Language Modelscited by 29
  27. 2018Attentive Crowd Flow Machinescited by 22
  28. 2022S2TNet: Spatio-Temporal Transformer Networks for Trajectory Prediction in Autonomous Drivingcited by 22
  29. 2023PromptST: Prompt-Enhanced Spatio-Temporal Multi-Attribute Predictioncited by 20
  30. 2023Towards Generative Modeling of Urban Flow through Knowledge-enhanced Denoising Diffusioncited by 17
  31. 2024Spatio-Temporal Few-Shot Learning via Diffusive Neural Network Generationcited by 14
  32. 2024Diffusion Transformers as Open-World Spatiotemporal Foundation Modelscited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 2.

7 papers.