MajutsuCity: Language-driven Aesthetic-adaptive City Generation with Controllable 3D Assets and Layouts
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Generating realistic 3D cities is fundamental to world models, virtual reality, and game development, where an ideal urban scene must satisfy both stylistic diversity, fine-grained, and controllability. However, existing methods struggle to balance the creative flexibility offered by text-based generation with the object-level editability enabled by explicit structural representations. We introduce MajutsuCity, a natural language-driven and aesthetically adaptive framework for synthesizing structurally consistent and stylistically diverse 3D urban scenes. MajutsuCity represents a city as a composition of controllable layouts, assets, and materials, and operates through a four-stage pipeline. To extend controllability beyond initial generation, we further integrate MajutsuAgent, an interactive language-grounded editing agent} that supports five object-level operations. To support photorealistic and customizable scene synthesis, we also construct MajutsuDataset, a high-quality multimodal dataset} containing 2D semantic layouts and height maps, diverse 3D building assets, and curated PBR materials and skyboxes, each accompanied by detailed annotations. Meanwhile, we develop a practical set of evaluation metrics, covering key dimensions such as structural consistency, scene complexity, material fidelity, and lighting atmosphere. Extensive experiments demonstrate MajutsuCity reduces layout FID by 83.7% compared with CityDreamer and by 20.1% over CityCraft. Our method ranks first across all AQS and RDR scores, outperforming existing methods by a clear margin. These results confirm MajutsuCity as a new state-of-the-art in geometric fidelity, stylistic adaptability, and semantic controllability for 3D city generation. We expect our framework can inspire new avenues of research in 3D city generation. Our project page: https://longhz140516.github.io/MajutsuCity/.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 56 of its 68 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
56 of 68 references.
Closest ancestors · 6
Same direction, newest first
- 2025LatticeWorld: A Multimodal Large Language Model-Empowered Framework for Interactive Complex World Generation5 Sep
- 2024UrbanWorld: An Urban World Model for 3D City Generation16 Jul
- 2023Persistent Nature: A Generative Model of Unbounded 3D Worlds23 Mar
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
- 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale22 Oct
Other references · 50
- 2023GPT-4 Technical Reportcited by 18,396
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2025Qwen-Image Technical Reportcited by 1,044
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 300
- 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
38 more
- 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 134
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
- 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 123
- 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 101
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
- 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 95
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
- 2024Automated Creation of Digital Cousins for Robust Policy Learningcited by 91
- 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 87
- 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 76
- 2023SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collectionscited by 72
- 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
- 2016Deep Learning the City : Quantifying Urban Perception At A Global Scalecited by 65
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Modelscited by 64
- 2024GRUtopia: Dream General Robots in a City at Scalecited by 59
- 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 58
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
- 2024Generative Gaussian Splatting for Unbounded 3D City Generationcited by 44
- 2024VistaDream: Sampling multiview consistent images for single-view scene reconstructioncited by 38
- 2024UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarioscited by 28
- 2024CityCraft: A Real Crafter for 3D City Generationcited by 26
- 20253D Scene Generation: A Surveycited by 24
- 2024CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesiscited by 23
- 2023CityGen: Infinite and Controllable City Layout Generationcited by 22
- 2024CityX: Controllable Procedural Content Generation for Unbounded 3D Citiescited by 22
- 2025Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assetscited by 22
- 2022OmniCity: Omnipotent City Understanding with Multi-level and Multi-view Imagescited by 21
- 2024Sketch2Scene: Automatic Generation of Interactive 3D Game Scenes from User's Casual Sketchescited by 21
- 2025WorldGen: From Text to Traversable and Interactive 3D Worldscited by 19
- 2024Make-it-Real: Unleashing Large Multimodal Model for Painting 3D Objects with Realistic Materialscited by 17
- 2023GlobalMapper: Arbitrary-Shaped Urban Layout Generationcited by 15
- 2024Leveraging BEV Paradigm for Ground-to-Aerial Image Synthesiscited by 11
- 2025Scene4U: Hierarchical Layered 3D Scene Reconstruction from Single Panoramic Image for Your Immerse Explorationcited by 11
- 2025BLINK-Twice: You see, but do you observe? A Reasoning Benchmark on Visual Perceptioncited by 9
- 2025UrbanFeel: A Comprehensive Benchmark for Temporal and Perceptual Understanding of City Scenes through Human Perspectivecited by 7
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 8
- 2026Imagine a City: CityGenAgent for Procedural 3D City Generationcited by 5
- 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generationcited by 1
- 2026To See a World in a Living Context: Unified Indoor-Outdoor Urban World Generationcited by 0
- 2026ProxyBuild: Text-Guided Structured 3D Building Generation with Mesh-Anchored Procedural Proxiescited by 0
- 2026CityCode: Building Agent-Operable 3D Cities from Sparse Aerial Observationscited by 0
- 2026CityCode: Building Agent-Operable 3D Cities from Sparse Aerial Observations13 Oct 2026
- 2026ProxyBuild: Text-Guided Structured 3D Building Generation with Mesh-Anchored Procedural Proxies20 Sep 2026
- 2026To See a World in a Living Context: Unified Indoor-Outdoor Urban World Generation6 Aug 2026
- 2026WorldClaw: Agentic 3D Open-World Generation at Scale5 Aug 2026
- 2026Imagine a City: CityGenAgent for Procedural 3D City Generation5 Feb 2026
- 2026NuiWorld: Exploring a Scalable Framework for End-to-End Controllable World Generation27 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025UrbanWorld2.0: A Multimodal Agentic Framework for Reality-Aligned 3D World Generation at City-Scale
- 2025Sat2RealCity: Geometry-Aware and Appearance-Controllable 3D Urban Generation from Satellite Imagery
- 2025Yo'City: Personalized and Boundless 3D Realistic City Scene Generation via Self-Critic Expansion
- 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes
- 2025Decorum: A Language-Based Approach For Style-Conditioned Synthesis of Indoor 3D Scenes
- 2024Urban Architect: Steerable 3D Urban Scene Generation with Layout Prior
- 2026HDSL: A Hierarchical Domain-Specific Language for Structured 3D Indoor Scene Generation and Localized Editing with LLM Agents
- 2024StyleCity: Large-Scale 3D Urban Scenes Stylization