Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesis
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Designing realistic and functional 3D indoor rooms is essential for a wide range of applications, including interior design, virtual reality, gaming, and embodied AI. While recent MLLM-based approaches have shown great potential for 3D room synthesis from textual descriptions or reference images, text-based methods struggle to capture precise spatial information, and existing image-conditioned agents suffer from instability and infinite looping when tasked with holistic room generation from top-down views. To address these limitations, we propose Code-as-Room, an MLLM-based agentic framework equipped with a structured execution harness, which represents 3D rooms with Blender codes. Given a top-down room image, the framework parses the reference image to extract scene elements and their spatial relationships, and synthesizes executable Blender code for geometry, materials, and lighting in a principled, multi-stage pipeline. A cross-stage memory module is maintained throughout to mitigate context forgetting inherent to existing agent-based frameworks. We further introduce a dedicated benchmark for code-based 3D room synthesis, encompassing various evaluation protocols. Based on our benchmark, comprehensive comparisons against existing agent-based methods are conducted to validate the effectiveness of our proposed execution harness.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 32 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
18 of 32 references.
Closest ancestors · 4
Same direction, newest first
- 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AI10 Feb
- 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes9 Feb
- 2026Vision-as-Inverse-Graphics Agent via Interleaved Multimodal Reasoning16 Jan
- 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agent24 Sep
Other references · 14
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
- 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 96
- 2018InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Datasetcited by 87
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 82
- 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
- 2025LL3M: Large Language 3D Modelerscited by 20
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoningcited by 14
- 2026BVB: Benchmarking Agentic Video Understanding via Programmatic Reconstruction in Blendercited by 6
- 2026Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interactioncited by 2
- 2026FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generationcited by 1
- 2026Remote-Sensing City Layout Extraction with MLLMcited by 0
- 2026BVB: Benchmarking Agentic Video Understanding via Programmatic Reconstruction in Blender14 Sep 2026
- 2026FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generation30 Aug 2026
- 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning27 Aug 2026
- 2026Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction19 Aug 2026
- 2026Remote-Sensing City Layout Extraction with MLLM17 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objects
- 2026ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generation
- 2025ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editing
- 2025DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesis
- 2026LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction
- 2026SceneOrchestra: Efficient Agentic 3D Scene Synthesis via Full Tool-Call Trajectory Generation
- 2025RoomCraft: Controllable and Complete 3D Indoor Scene Generation