Generative AI for Urban Planning: Synthesizing Satellite Imagery via Diffusion Models
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Generative AI offers new opportunities for automating urban planning by creating site-specific urban layouts and enabling flexible design exploration. However, existing approaches often struggle to produce realistic and practical designs at scale. Therefore, we adapt a state-of-the-art Stable Diffusion model, extended with ControlNet, to generate high-fidelity satellite imagery conditioned on land use descriptions, infrastructure, and natural environments. To overcome data availability limitations, we spatially link satellite imagery with structured land use and constraint information from OpenStreetMap. Using data from three major U.S. cities, we demonstrate that the proposed diffusion model generates realistic and diverse urban landscapes by varying land-use configurations, road networks, and water bodies, facilitating cross-city learning and design diversity. We also systematically evaluate the impacts of varying language prompts and control imagery on the quality of satellite imagery generation. Our model achieves high FID and KID scores and demonstrates robustness across diverse urban contexts. Qualitative assessments from urban planners and the general public show that generated images align closely with design descriptions and constraints, and are often preferred over real images. This work establishes a benchmark for controlled urban imagery generation and highlights the potential of generative AI as a tool for enhancing planning workflows and public engagement.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 20 of its 45 references that are in the map. First posted on arXiv 13 May 2025.
Builds on
20 of 45 references.
Closest ancestors · 1
Same direction, newest first
- 2024UrbanGenAI: Reconstructing Urban Landscapes using Panoptic Segmentation and Diffusion Models25 Jan
Other references · 19
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2018Demystifying MMD GANscited by 1,293
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2024ControlNet++: Improving Conditional Controls with Efficient Consistency Feedbackcited by 154
- 2018Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizercited by 88
- 2020A Generalizable and Accessible Approach to Machine Learning with Global Satellite Imagerycited by 88
7 more
- 2017Using Deep Learning and Google Street View to Estimate the Demographic Makeup of the UScited by 66
- 2023Generate Your Own Scotland: Satellite Image Generation Conditioned on Mapscited by 30
- 2020Generating Interpretable Poverty Maps using Object Detection in Satellite Imagescited by 27
- 2022Human-instructed Deep Hierarchical Generative Learning for Automated Urban Planningcited by 15
- 2021Automated Urban Planning for Reimagining City Configuration via Adversarial Learning: Quantification, Generation, and Evaluationcited by 11
- 2023C3Net: Compound Conditioned ControlNet for Multimodal Content Generationcited by 8
- 2024SatDiffMoE: A Mixture of Estimation Method for Satellite Image Super-resolution with Latent Diffusion Modelscited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 6.
7 papers.
- 2025From Image Generation to Infrastructure Design: a Multi-agent Pipeline for Street Design Generationcited by 3
- 2026TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitivecited by 2
- 2026StreetDesignAI: Broadening Designer Perspectives Through Multi-Persona Evaluation of Cycling Infrastructurecited by 1
- 2026SENSE: Satellite-based ENergy Synthesis for Sustainable Environmentcited by 1
- 2026CoMa: Contextual Massing Generation with Vision-Language Modelscited by 0
- 2026The Latent Color Subspace: Emergent Order in High-Dimensional Chaoscited by 0
- 2026Geography According to ChatGPT -- How Generative AI Represents and Reasons about Geographycited by 0
- 2026TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitive30 Jun 2026
- 2026SENSE: Satellite-based ENergy Synthesis for Sustainable Environment18 May 2026
- 2026Geography According to ChatGPT -- How Generative AI Represents and Reasons about Geography19 Mar 2026
- 2026The Latent Color Subspace: Emergent Order in High-Dimensional Chaos12 Mar 2026
- 2026StreetDesignAI: Broadening Designer Perspectives Through Multi-Persona Evaluation of Cycling Infrastructure22 Jan 2026
- 2026CoMa: Contextual Massing Generation with Vision-Language Models13 Jan 2026
- 2025From Image Generation to Infrastructure Design: a Multi-agent Pipeline for Street Design Generation5 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Generative AI for Urban Design: A Stepwise Approach Integrating Human Expertise with Multimodal Diffusion Models
- 2025Towards Urban Planing AI Agent in the Age of Agentic AI
- 2025Generative AI in Map-Making: A Technical Exploration and Its Implications for Cartographers
- 2026Designing streetscapes from street-view imagery using diffusion models
- 2023Diffusion Models for Earth Observation Use-cases: from cloud removal to urban change detection
- 2024From Geometric Mimicry to Comprehensive Generation: A Context-Informed Multimodal Diffusion Model for Urban Morphology Synthesis
- 2023Towards Generative Modeling of Urban Flow through Knowledge-enhanced Denoising Diffusion
- 2023A Framework of Full-Process Generation Design for Park Green Spaces Based on Remote Sensing Segmentation-GAN-Diffusion