# Towards Generative Modeling of Urban Flow through Knowledge-enhanced Denoising Diffusion

arXiv: https://arxiv.org/abs/2309.10547 · HTML: https://mlsanity.com/paper/2309.10547/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models.
- Builds on 30 of its 52 references that are in the map.
- First posted on arXiv 19 Sep 2023.

## Placed in

- Diffusion models / [3D, point cloud and scene generation](https://mlsanity.com/diffusion/3d-point-cloud-and-scene-generation/)

## Builds on (most cited first, 30 of 30)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [High-Resolution Image Synthesis with Latent Diffusion Models](https://mlsanity.com/paper/2112.10752/) (2021)
- [Conditional Generative Adversarial Nets](https://mlsanity.com/paper/1411.1784/) (2014)
- [DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps](https://mlsanity.com/paper/2206.00927/) (2022)
- [WaveNet: A Generative Model for Raw Audio](https://mlsanity.com/paper/1609.03499/) (2016)
- [Modeling Relational Data with Graph Convolutional Networks](https://mlsanity.com/paper/1703.06103/) (2017)
- [DiffWave: A Versatile Diffusion Model for Audio Synthesis](https://mlsanity.com/paper/2009.09761/) (2020)
- [Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting](https://mlsanity.com/paper/1709.04875/) (2017)
- [CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation](https://mlsanity.com/paper/2107.03502/) (2021)
- [Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting](https://mlsanity.com/paper/2101.12072/) (2021)
- [Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction](https://mlsanity.com/paper/1610.00081/) (2016)
- [Real-valued (Medical) Time Series Generation with Recurrent Conditional GANs](https://mlsanity.com/paper/1706.02633/) (2017)
- [TuckER: Tensor Factorization for Knowledge Graph Completion](https://mlsanity.com/paper/1901.09590/) (2019)
- [Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Survey](https://mlsanity.com/paper/2303.14483/) (2023)
- [CARD: Classification and Regression Diffusion Models](https://mlsanity.com/paper/2206.07275/) (2022)
- [DiffSTG: Probabilistic Spatio-Temporal Graph Forecasting with Denoising Diffusion Models](https://mlsanity.com/paper/2301.13629/) (2023)
- [Spatio-Temporal Self-Supervised Learning for Traffic Flow Prediction](https://mlsanity.com/paper/2212.04475/) (2022)
- [Deep Gravity: enhancing mobility flows generation with deep neural networks and geographic information](https://mlsanity.com/paper/2012.00489/) (2020)
- [Coupled Layer-wise Graph Convolution for Transportation Demand Prediction](https://mlsanity.com/paper/2012.08080/) (2020)
- [Spatio-temporal Diffusion Point Processes](https://mlsanity.com/paper/2305.12403/) (2023)
- [Diffusion-based Conditional ECG Generation with Structured State Space Models](https://mlsanity.com/paper/2301.08227/) (2023)
- [A Data-driven Market Simulator for Small Data Environments](https://mlsanity.com/paper/2006.14498/) (2020)
- [Learning Geo-Contextual Embeddings for Commuting Flow Prediction](https://mlsanity.com/paper/2005.01690/) (2020)
- [Spatio-Temporal Urban Knowledge Graph Enabled Mobility Prediction](https://mlsanity.com/paper/2111.03465/) (2021)
- [MedDiff: Generating Electronic Health Records using Accelerated Denoising Diffusion Model](https://mlsanity.com/paper/2302.04355/) (2023)
- [EHRDiff: Exploring Realistic EHR Synthesis with Diffusion Models](https://mlsanity.com/paper/2303.05656/) (2023)
- [A Lightweight and Accurate Spatial-Temporal Transformer for Traffic Forecasting](https://mlsanity.com/paper/2201.00008/) (2021)
- [Knowledge-driven Site Selection via Urban Knowledge Graph](https://mlsanity.com/paper/2111.00787/) (2021)
- [Improving Location Recommendation with Urban Knowledge Graph](https://mlsanity.com/paper/2111.01013/) (2021)

## Built on by (most cited first, 17 of 17)

- [UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Prediction](https://mlsanity.com/paper/2402.11838/) (2024)
- [Spatio-Temporal Few-Shot Learning via Diffusive Neural Network Generation](https://mlsanity.com/paper/2402.11922/) (2024)
- [A Survey of Generative Techniques for Spatial-Temporal Data Mining](https://mlsanity.com/paper/2405.09592/) (2024)
- [Social Physics Informed Diffusion Model for Crowd Simulation](https://mlsanity.com/paper/2402.06680/) (2024)
- [A Universal Model for Human Mobility Prediction](https://mlsanity.com/paper/2412.15294/) (2024)
- [Leveraging Generative AI for Urban Digital Twins: A Scoping Review on the Autonomous Generation of Urban Data, Scenarios, Designs, and 3D City Models for Smart City Advancement](https://mlsanity.com/paper/2405.19464/) (2024)
- [UniFlow: A Foundation Model for Unified Urban Spatio-Temporal Flow Prediction](https://mlsanity.com/paper/2411.12972/) (2024)
- [A Survey of Generative AI for Intelligent Transportation Systems: Road Transportation Perspective](https://mlsanity.com/paper/2312.08248/) (2023)
- [A Gentle Introduction and Tutorial on Deep Generative Models in Transportation Research](https://mlsanity.com/paper/2410.07066/) (2024)
- [Towards Kriging-informed Conditional Diffusion for Regional Sea-Level Data Downscaling](https://mlsanity.com/paper/2410.15628/) (2024)
- [Unveiling the Power of Noise Priors: Enhancing Diffusion Models for Mobile Traffic Prediction](https://mlsanity.com/paper/2501.13794/) (2025)
- [A Survey of Physics-Informed AI for Complex Urban Systems](https://mlsanity.com/paper/2506.13777/) (2025)
- [LSDM: LLM-Enhanced Spatio-temporal Diffusion Model for Service-Level Mobile Traffic Prediction](https://mlsanity.com/paper/2507.17795/) (2025)
- [MobiGPT: A Foundation Model for Mobile Wireless Networks](https://mlsanity.com/paper/2509.18166/) (2025)
- [Net-Ev2: A Generative Simulator for Network Event Evolution](https://mlsanity.com/paper/2606.12494/) (2026)
- [Denoising Refinement Diffusion Models for Simultaneous Generation of Multi-scale Mobile Network Traffic](https://mlsanity.com/paper/2511.17532/) (2025)
- [UrbanDS: A Graph-Guided LLM Multi-Agent System for Data-Intensive Urban Tasks](https://mlsanity.com/paper/2607.26724/) (2026)

## Abstract (arXiv)

Although generative AI has been successful in many areas, its ability to model geospatial data is still underexplored. Urban flow, a typical kind of geospatial data, is critical for a wide range of urban applications. Existing studies mostly focus on predictive modeling of urban flow that predicts the future flow based on historical flow data, which may be unavailable in data-sparse areas or newly planned regions. Some other studies aim to predict OD flow among regions but they fail to model dynamic changes of urban flow over time. In this work, we study a new problem of urban flow generation that generates dynamic urban flow for regions without historical flow data. To capture the effect of multiple factors on urban flow, such as region features and urban environment, we employ diffusion model to generate urban flow for regions under different conditions. We first construct an urban knowledge graph (UKG) to model the urban environment and relationships between regions, based on which we design a knowledge-enhanced spatio-temporal diffusion model (KSTDiff) to generate urban flow for each region. Specifically, to accurately generate urban flow for regions with different flow volumes, we design a novel diffusion process guided by a volume estimator, which is learnable and customized for each region. Moreover, we propose a knowledge-enhanced denoising network to capture the spatio-temporal dependencies of urban flow as well as the impact of urban environment in the denoising process. Extensive experiments on four real-world datasets validate the superiority of our model over state-of-the-art baselines in urban flow generation. Further in-depth studies demonstrate the utility of generated urban flow data and the ability of our model for long-term flow generation and urban flow prediction. Our code is released at: https://github.com/tsinghua-fib-lab/KSTDiff-Urban-flow-generation.
