Sat2RealCity: Geometry-Aware and Appearance-Controllable 3D Urban Generation from Satellite Imagery
Not on the map. Why?
Abstract (arXiv)
3D urban generation from satellite imagery is an important task for scalable digital twins and real-world simulation environments. Existing approaches primarily rely on scene-level generation paradigms, which often require large-scale 3D city assets and struggle with controllability, geographic alignment, and realistic appearance grounding in real-world urban environments. To address these limitations, we present Sat2RealCity, a grounded urban generation framework that leverages object-level 3D generative priors for scalable city synthesis from satellite imagery. Our framework decomposes cities into geographically grounded building entities, enabling the reuse of pretrained object-level 3D generative priors while preserving real-world spatial structures. Supported by our constructed BuildVerse3D dataset, (1) we introduce an OpenStreetMap (OSM)-guided spatial grounding strategy to inject geospatial constraints into the 3D generation process; (2) we design an appearance-guided controllable generation mechanism for realistic architectural appearance and regional style consistency; and (3) we construct an MLLM-powered semantic pipeline for regional appearance understanding and semantic-aware appearance synthesis. Extensive experiments demonstrate that Sat2RealCity achieves strong geographic alignment, regional stylistic consistency, and plausible urban asset synthesis compared with existing urban generation and 3D asset generation approaches.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 43 of its 56 references that are in the map. First posted on arXiv 14 Nov 2025.
Builds on
43 of 56 references.
References · 43
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2025DINOv3cited by 1,414
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
31 more
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
- 2021Capturing, Reconstructing, and Simulating: the UrbanScene3D Datasetcited by 118
- 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 87
- 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generationcited by 82
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 79
- 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 76
- 2024ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense Predictionscited by 66
- 2021Geometry-Guided Street-View Panorama Synthesis from Satellite Imagerycited by 41
- 2021BuildingNet: Learning to Label 3D Buildingscited by 33
- 2023A General Protocol to Probe Large Vision Models for 3D Physical Understandingcited by 32
- 2024RT-DETRv3: Real-time End-to-End Object Detection with Hierarchical Dense Positive Supervisioncited by 32
- 2023Sat2Density: Faithful Density Learning from Satellite-Ground Image Pairscited by 29
- 2024CityCraft: A Real Crafter for 3D City Generationcited by 26
- 2020Sat2Vid: Street-view Panoramic Video Synthesis from a Single Satellite Imagecited by 25
- 2025Seed3D 1.0: From Images to High-Fidelity Simulation-Ready 3D Assetscited by 20
- 2023MonoLSS: Learnable Sample Selection For Monocular 3D Detectioncited by 19
- 2023DUSA: Decoupled Unsupervised Sim2Real Adaptation for Vehicle-to-Everything Collaborative Perceptioncited by 17
- 2025Sat2City: 3D City Generation from A Single Satellite Image with Cascaded Latent Diffusioncited by 16
- 2023Open-TransMind: A New Baseline and Benchmark for 1st Foundation Model Challenge of Intelligent Transportationcited by 14
- 2024Geospecific View Generation -- Geometry-Context Aware High-resolution Ground View Inference from Satellite Viewscited by 13
- 2025CRUISE: Cooperative Reconstruction and Editing in V2X Scenarios using Gaussian Splattingcited by 11
- 2025EarthCrafter: Scalable 3D Earth Generation via Dual-Sparse Latent Diffusioncited by 6
- 2024RopeBEV: A Multi-Camera Roadside Perception Network in Bird's-Eye-Viewcited by 5
- 2025SAT-SKYLINES: 3D Building Generation from Satellite Imagery and Coarse Geometric Priorscited by 3
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026ArtifactWorld: Scaling 3D Gaussian Splatting Artifact Restoration via Video Generation Modelscited by 5
- 2026You Only Gaussian Once: Controllable 3D Gaussian Splatting for Ultra-Densely Sampled Scenescited by 4
- 2026Sat2City v2: Native 3D City Asset Generation from a Single Satellite Imagecited by 3
- 2026STAR: A Spatial-Topology Aware Routing Framework for Generalizable 3D Scene Understandingcited by 0
- 2026GridFlow: Structured Latent Flow for Seamless City-Scale 3D Point Cloud Generationcited by 0
- 2026KODAMA: Multimodal Digital Twin Reconstruction for Urban RF Propagation Modellingcited by 0
- 2026CityCode: Building Agent-Operable 3D Cities from Sparse Aerial Observationscited by 0
- 2026CityCode: Building Agent-Operable 3D Cities from Sparse Aerial Observations13 Oct 2026
- 2026KODAMA: Multimodal Digital Twin Reconstruction for Urban RF Propagation Modelling7 Sep 2026
- 2026GridFlow: Structured Latent Flow for Seamless City-Scale 3D Point Cloud Generation30 Aug 2026
- 2026STAR: A Spatial-Topology Aware Routing Framework for Generalizable 3D Scene Understanding12 Aug 2026
- 2026Sat2City v2: Native 3D City Asset Generation from a Single Satellite Image23 Jun 2026
- 2026You Only Gaussian Once: Controllable 3D Gaussian Splatting for Ultra-Densely Sampled Scenes23 Apr 2026
- 2026ArtifactWorld: Scaling 3D Gaussian Splatting Artifact Restoration via Video Generation Models14 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2024UrbanWorld: An Urban World Model for 3D City Generation
- 2024Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusion
- 2026Imagine a City: CityGenAgent for Procedural 3D City Generation
- 2025MajutsuCity: Language-driven Aesthetic-adaptive City Generation with Controllable 3D Assets and Layouts
- 2025Generative AI for Urban Planning: Synthesizing Satellite Imagery via Diffusion Models
- 2025CymbaDiff: Structured Spatial Diffusion for Sketch-based 3D Semantic Urban Scene Generation
- 2025Yo'City: Personalized and Boundless 3D Realistic City Scene Generation via Self-Critic Expansion
- 2025UrbanWorld2.0: A Multimodal Agentic Framework for Reality-Aligned 3D World Generation at City-Scale