UniFlow: A Foundation Model for Unified Urban Spatio-Temporal Flow Prediction
Not on the map. Why?
Abstract (arXiv)
Urban spatio-temporal flow prediction, encompassing traffic flows and crowd flows, is crucial for optimizing city infrastructure and managing traffic and emergency responses. Traditional approaches have relied on separate models tailored to either grid-based data, representing cities as uniform cells, or graph-based data, modeling cities as networks of nodes and edges. In this paper, we build UniFlow, a foundational model for general urban flow prediction that unifies both grid-based and graphbased data. We first design a multi-view spatio-temporal patching mechanism to standardize different data into a consistent sequential format and then introduce a spatio-temporal transformer architecture to capture complex correlations and dynamics. To leverage shared spatio-temporal patterns across different data types and facilitate effective cross-learning, we propose SpatioTemporal Memory Retrieval Augmentation (ST-MRA). By creating structured memory modules to store shared spatio-temporal patterns, ST-MRA enhances predictions through adaptive memory retrieval. Extensive experiments demonstrate that UniFlow outperforms existing models in both grid-based and graph-based flow prediction, excelling particularly in scenarios with limited data availability, showcasing its superior performance and broad applicability. The datasets and code implementation have been released on https://github.com/YuanYuan98/UniFlow.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 44 of its 67 references that are in the map. First posted on arXiv 20 Nov 2024.
Builds on
44 of 67 references.
References · 44
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
32 more
- 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 399
- 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
- 2022SimVP: Simpler yet Better Video Predictioncited by 181
- 2019Deep Learning for Spatio-Temporal Data Mining: A Surveycited by 171
- 2023TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecastingcited by 170
- 2021Discrete Graph Structure Learning for Forecasting Multiple Time Seriescited by 169
- 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 149
- 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
- 2023PDFormer: Propagation Delay-Aware Dynamic Long-Range Transformer for Traffic Flow Predictioncited by 135
- 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
- 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
- 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 109
- 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
- 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 91
- 2024UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Predictioncited by 86
- 2022Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learningcited by 84
- 2024UrbanGPT: Spatio-Temporal Large Language Modelscited by 81
- 2022Spatio-Temporal Self-Supervised Learning for Traffic Flow Predictioncited by 77
- 2023ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendationcited by 76
- 2023Spatio-temporal Diffusion Point Processescited by 52
- 2023Urban Generative Intelligence (UGI): A Foundational Platform for Agents in Embodied City Environmentcited by 37
- 2019UrbanFM: Inferring Fine-Grained Urban Flowscited by 31
- 2024How Can Large Language Models Understand Spatial-Temporal Data?cited by 31
- 2024CityGPT: Empowering Urban Spatial Cognition of Large Language Modelscited by 29
- 2018Attentive Crowd Flow Machinescited by 22
- 2022S2TNet: Spatio-Temporal Transformer Networks for Trajectory Prediction in Autonomous Drivingcited by 22
- 2023PromptST: Prompt-Enhanced Spatio-Temporal Multi-Attribute Predictioncited by 20
- 2023Towards Generative Modeling of Urban Flow through Knowledge-enhanced Denoising Diffusioncited by 17
- 2024Spatio-Temporal Few-Shot Learning via Diffusive Neural Network Generationcited by 14
- 2024Diffusion Transformers as Open-World Spatiotemporal Foundation Modelscited by 10
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 2.
7 papers.
- 2024Noise Matters: Diffusion Model-based Urban Mobility Generation with Collaborative Noise Priorscited by 7
- 2025Unveiling the Power of Noise Priors: Enhancing Diffusion Models for Mobile Traffic Predictioncited by 4
- 2025UniMove: A Unified Model for Multi-city Human Mobility Predictioncited by 2
- 2025Breaking Data Silos: Towards Open and Scalable Mobility Foundation Models via Generative Continual Learningcited by 1
- 2025Predicting Large-scale Urban Network Dynamics with Energy-informed Graph Neural Diffusioncited by 1
- 2026UrbanFM: Scaling Urban Spatio-Temporal Foundation Modelscited by 1
- 2026A Multi-Resolution Multi-Domain Pre-Training Framework for Universal Traffic Forecastingcited by 0
- 2026A Multi-Resolution Multi-Domain Pre-Training Framework for Universal Traffic Forecasting12 Sep 2026
- 2026UrbanFM: Scaling Urban Spatio-Temporal Foundation Models24 Feb 2026
- 2025UniMove: A Unified Model for Multi-city Human Mobility Prediction9 Aug 2025
- 2025Predicting Large-scale Urban Network Dynamics with Energy-informed Graph Neural Diffusion31 Jul 2025
- 2025Breaking Data Silos: Towards Open and Scalable Mobility Foundation Models via Generative Continual Learning7 Jun 2025
- 2025Unveiling the Power of Noise Priors: Enhancing Diffusion Models for Mobile Traffic Prediction23 Jan 2025
- 2024Noise Matters: Diffusion Model-based Urban Mobility Generation with Collaborative Noise Priors6 Dec 2024