Yo'City: Personalized and Boundless 3D Realistic City Scene Generation via Self-Critic Expansion
Not on the map. Why?
Abstract (arXiv)
Realistic 3D city generation is fundamental to a wide range of applications, including virtual reality and digital twins. However, most existing methods rely on training a single diffusion model, which limits their ability to generate personalized and boundless city-scale scenes. In this paper, we present Yo'City, a novel agentic framework that enables user-customized and infinitely expandable 3D city generation by leveraging the reasoning and compositional capabilities of off-the-shelf large models. Specifically, Yo'City first conceptualizes the city through a top-down planning strategy that defines a hierarchical "City-District-Grid" structure. The Global Planner determines the overall layout and potential functional districts, while the Local Designer further refines each district with detailed grid-level descriptions. Subsequently, the grid-level 3D generation is achieved through a "produce-refine-evaluate" isometric image synthesis loop, followed by image-to-3D generation. To simulate continuous city evolution, Yo'City further introduces a user-interactive, relationship-guided expansion mechanism, which performs scene graph-based distance- and semantics-aware layout optimization, ensuring spatially coherent city growth. To comprehensively evaluate our method, we construct a diverse benchmark dataset and design six multi-dimensional metrics that assess generation quality from the perspectives of semantics, geometry, texture, and layout. Extensive experiments demonstrate that Yo'City consistently outperforms existing state-of-the-art methods across all evaluation aspects.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 55 of its 85 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
55 of 85 references.
References · 55
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Visual Instruction Tuningcited by 7,869
- 2023Qwen Technical Reportcited by 3,344
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2023PaLM 2 Technical Reportcited by 1,162
- 2025Qwen-Image Technical Reportcited by 1,044
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
38 more
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 200
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
- 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learningcited by 163
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
- 2024An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLMcited by 97
- 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 96
- 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
- 2025VTool-R1: VLMs Learn to Think with Images via Reinforcement Learning on Multimodal Tool Usecited by 90
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2024BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolationcited by 83
- 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 76
- 2023SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collectionscited by 72
- 2025Paper2Code: Automating Code Generation from Scientific Papers in Machine Learningcited by 70
- 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 67
- 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaversecited by 51
- 2023Persistent Nature: A Generative Model of Unbounded 3D Worldscited by 44
- 2025VisualToolAgent (VisTA): A Reinforcement Learning Framework for Visual Tool Selectioncited by 34
- 2023DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Modelscited by 33
- 2025SynCity: Training-Free Generation of 3D Worldscited by 31
- 2025ArtiScene: Language-Driven Artistic 3D Scene Generation Through Image Intermediarycited by 28
- 2024CityCraft: A Real Crafter for 3D City Generationcited by 26
- 2023CityGen: Infinite and Controllable City Layout Generationcited by 22
- 2025MMGDreamer: Mixed-Modality Graph for Geometry-Controllable 3D Indoor Scene Generationcited by 19
- 2025NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenescited by 19
- 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagerycited by 17
- 2025Sat2City: 3D City Generation from A Single Satellite Image with Cascaded Latent Diffusioncited by 16
- 2025HOLODECK 2.0: Vision-Language-Guided 3D World Generation with Editingcited by 15
- 2025Mano Technical Reportcited by 13
- 2025VidText: Towards Comprehensive Evaluation for Video Text Understandingcited by 11
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026VisNec: Measuring and Leveraging Visual Necessity for Multimodal Instruction Tuningcited by 8
- 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 8
- 2026FocusTrack: One-Stage Focus-and-Suppress Framework for 3D Point Cloud Object Trackingcited by 7
- 2026Imagine a City: CityGenAgent for Procedural 3D City Generationcited by 5
- 2026FlowScene: Style-Consistent Indoor Scene Generation with Multimodal Graph Rectified Flowcited by 5
- 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generationcited by 1
- 2026CADForge: Agentic Single-View CAD Reconstruction with Explicit Geometry Reasoningcited by 1
- 2026To See a World in a Living Context: Unified Indoor-Outdoor Urban World Generationcited by 0
- 2026ProxyBuild: Text-Guided Structured 3D Building Generation with Mesh-Anchored Procedural Proxiescited by 0
- 2026CADForge: Agentic Single-View CAD Reconstruction with Explicit Geometry Reasoning3 Oct 2026
- 2026ProxyBuild: Text-Guided Structured 3D Building Generation with Mesh-Anchored Procedural Proxies20 Sep 2026
- 2026To See a World in a Living Context: Unified Indoor-Outdoor Urban World Generation6 Aug 2026
- 2026WorldClaw: Agentic 3D Open-World Generation at Scale5 Aug 2026
- 2026FlowScene: Style-Consistent Indoor Scene Generation with Multimodal Graph Rectified Flow20 Mar 2026
- 2026VisNec: Measuring and Leveraging Visual Necessity for Multimodal Instruction Tuning1 Mar 2026
- 2026FocusTrack: One-Stage Focus-and-Suppress Framework for 3D Point Cloud Object Tracking27 Feb 2026
- 2026Imagine a City: CityGenAgent for Procedural 3D City Generation5 Feb 2026
- 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generation27 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024UrbanWorld: An Urban World Model for 3D City Generation
- 2025MajutsuCity: Language-driven Aesthetic-adaptive City Generation with Controllable 3D Assets and Layouts
- 2025UrbanWorld2.0: A Multimodal Agentic Framework for Reality-Aligned 3D World Generation at City-Scale
- 2024Urban Architect: Steerable 3D Urban Scene Generation with Layout Prior
- 2025Sat2RealCity: Geometry-Aware and Appearance-Controllable 3D Urban Generation from Satellite Imagery
- 20253D Scene Generation: A Survey
- 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes
- 2026SceneOrchestra: Efficient Agentic 3D Scene Synthesis via Full Tool-Call Trajectory Generation