mlsanityData to 14 Oct 2026

MajutsuCity: Language-driven Aesthetic-adaptive City Generation with Controllable 3D Assets and Layouts

arXiv 2511.20415 ↗First posted 25 Nov 2025cs.CVcited by 6

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Generating realistic 3D cities is fundamental to world models, virtual reality, and game development, where an ideal urban scene must satisfy both stylistic diversity, fine-grained, and controllability. However, existing methods struggle to balance the creative flexibility offered by text-based generation with the object-level editability enabled by explicit structural representations. We introduce MajutsuCity, a natural language-driven and aesthetically adaptive framework for synthesizing structurally consistent and stylistically diverse 3D urban scenes. MajutsuCity represents a city as a composition of controllable layouts, assets, and materials, and operates through a four-stage pipeline. To extend controllability beyond initial generation, we further integrate MajutsuAgent, an interactive language-grounded editing agent} that supports five object-level operations. To support photorealistic and customizable scene synthesis, we also construct MajutsuDataset, a high-quality multimodal dataset} containing 2D semantic layouts and height maps, diverse 3D building assets, and curated PBR materials and skyboxes, each accompanied by detailed annotations. Meanwhile, we develop a practical set of evaluation metrics, covering key dimensions such as structural consistency, scene complexity, material fidelity, and lighting atmosphere. Extensive experiments demonstrate MajutsuCity reduces layout FID by 83.7% compared with CityDreamer and by 20.1% over CityCraft. Our method ranks first across all AQS and RDR scores, outperforming existing methods by a clear margin. These results confirm MajutsuCity as a new state-of-the-art in geometric fidelity, stylistic adaptability, and semantic controllability for 3D city generation. We expect our framework can inspire new avenues of research in 3D city generation. Our project page: https://longhz140516.github.io/MajutsuCity/.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 56 of its 68 references that are in the map. First posted on arXiv 25 Nov 2025.

Builds on

56 of 68 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025LatticeWorld: A Multimodal Large Language Model-Empowered Framework for Interactive Complex World Generation5 Sep
  2. 2024UrbanWorld: An Urban World Model for 3D City Generation16 Jul
  3. 2023Persistent Nature: A Generative Model of Unbounded 3D Worlds23 Mar
  4. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
  5. 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb
  6. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale22 Oct

Other references · 50

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  4. 2025Qwen-Image Technical Reportcited by 1,044
  5. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  6. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  7. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  8. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
  9. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
  10. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  11. 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 300
  12. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
38 more
  1. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 134
  2. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 125
  3. 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 123
  4. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
  5. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
  6. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
  7. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 101
  8. 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
  9. 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 95
  10. 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
  11. 2024Automated Creation of Digital Cousins for Robust Policy Learningcited by 91
  12. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 87
  13. 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 76
  14. 2023SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collectionscited by 72
  15. 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
  16. 2016Deep Learning the City : Quantifying Urban Perception At A Global Scalecited by 65
  17. 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Modelscited by 64
  18. 2024GRUtopia: Dream General Robots in a City at Scalecited by 59
  19. 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 58
  20. 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
  21. 2024Generative Gaussian Splatting for Unbounded 3D City Generationcited by 44
  22. 2024VistaDream: Sampling multiview consistent images for single-view scene reconstructioncited by 38
  23. 2024UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarioscited by 28
  24. 2024CityCraft: A Real Crafter for 3D City Generationcited by 26
  25. 20253D Scene Generation: A Surveycited by 24
  26. 2024CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesiscited by 23
  27. 2023CityGen: Infinite and Controllable City Layout Generationcited by 22
  28. 2024CityX: Controllable Procedural Content Generation for Unbounded 3D Citiescited by 22
  29. 2025Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assetscited by 22
  30. 2022OmniCity: Omnipotent City Understanding with Multi-level and Multi-view Imagescited by 21
  31. 2024Sketch2Scene: Automatic Generation of Interactive 3D Game Scenes from User's Casual Sketchescited by 21
  32. 2025WorldGen: From Text to Traversable and Interactive 3D Worldscited by 19
  33. 2024Make-it-Real: Unleashing Large Multimodal Model for Painting 3D Objects with Realistic Materialscited by 17
  34. 2023GlobalMapper: Arbitrary-Shaped Urban Layout Generationcited by 15
  35. 2024Leveraging BEV Paradigm for Ground-to-Aerial Image Synthesiscited by 11
  36. 2025Scene4U: Hierarchical Layered 3D Scene Reconstruction from Single Panoramic Image for Your Immerse Explorationcited by 11
  37. 2025BLINK-Twice: You see, but do you observe? A Reasoning Benchmark on Visual Perceptioncited by 9
  38. 2025UrbanFeel: A Comprehensive Benchmark for Temporal and Perceptual Understanding of City Scenes through Human Perspectivecited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025UrbanWorld2.0: A Multimodal Agentic Framework for Reality-Aligned 3D World Generation at City-Scale
  2. 2025Sat2RealCity: Geometry-Aware and Appearance-Controllable 3D Urban Generation from Satellite Imagery
  3. 2025Yo'City: Personalized and Boundless 3D Realistic City Scene Generation via Self-Critic Expansion
  4. 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes
  5. 2025Decorum: A Language-Based Approach For Style-Conditioned Synthesis of Indoor 3D Scenes
  6. 2024Urban Architect: Steerable 3D Urban Scene Generation with Layout Prior
  7. 2026HDSL: A Hierarchical Domain-Specific Language for Structured 3D Indoor Scene Generation and Localized Editing with LLM Agents
  8. 2024StyleCity: Large-Scale 3D Urban Scenes Stylization