Function2Scene: 3D Indoor Scene Layout from Functional Specifications
Not on the map. Why?
Abstract (arXiv)
Most text-driven 3D indoor scene synthesis methods generate rooms from object-centric prompts, asking what furniture should be placed rather than how the space is used. Yet in real interior design, a layout is judged by how well it supports its occupants, e.g., their activities and physical needs. We introduce Function2Scene, a framework for generating 3D indoor layouts from functional specifications, i.e., natural-language design briefs describing who will use a room and what they need to do there. Given such a specification, our system parses occupant personas and activities, derives a customized set of functional design constraints from a taxonomy of 17 criteria spanning spatial, ergonomic, activity, and environmental considerations, and uses these constraints to guide layout generation. Rather than relying on an LLM to directly produce a final scene, Function2Scene performs iterative evaluation and refinement through a tool-augmented check-and-repair loop, combining geometric measurements, LLM-based contextual reasoning, and VLM-based visual assessment. Experiments on 30 professionally written interior-design cases show that Function2Scene produces layouts that better satisfy functional requirements than recent LLM-based scene synthesis baselines, with our results preferred in 94.3% of pairwise comparisons. Our work reframes text-driven indoor scene synthesis from placing plausible objects to designing spaces that support human use.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 43 of its 135 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
43 of 135 references.
References · 43
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 200
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
- 2018Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Modelscited by 106
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2018Human-centric Indoor Scene Synthesis Using Stochastic Grammarcited by 74
- 2018Deep Generative Modeling for Scene Synthesis via Hybrid Representationscited by 63
31 more
- 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 56
- 2019SceneGraphNet: Neural Message Passing for 3D Indoor Scene Augmentationcited by 55
- 2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusioncited by 54
- 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaversecited by 51
- 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AIcited by 50
- 2024SceneTeller: Language-to-3D Scene Generationcited by 43
- 2015Text to 3D Scene Generation with Rich Lexical Groundingcited by 36
- 2024The Scene Language: Representing Scenes with Programs, Words, and Embeddingscited by 36
- 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
- 2025Global-Local Tree Search in VLMs for 3D Indoor Scene Generationcited by 29
- 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoningcited by 28
- 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
- 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 24
- 2022LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Datacited by 20
- 2024SceneMotifCoder: Example-driven Visual Program Learning for Generating 3D Object Arrangementscited by 17
- 2025HOLODECK 2.0: Vision-Language-Guided 3D World Generation with Editingcited by 15
- 2025CasaGPT: Cuboid Arrangement and Scene Assembly for Interior Designcited by 14
- 2025Agentic 3D Scene Generation with Spatially Contextualized VLMscited by 14
- 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimizationcited by 14
- 2024Diorama: Unleashing Zero-shot Single-view 3D Indoor Scene Modelingcited by 11
- 2025RoomCraft: Controllable and Complete 3D Indoor Scene Generationcited by 9
- 2025FreeScene: Mixed Graph Diffusion for 3D Scene Synthesis from Free Promptscited by 8
- 2025Text-to-Scene with Large Reasoning Modelscited by 7
- 2025DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesiscited by 6
- 2026SceneReVis: A Self-Reflective Vision-Grounded Framework for 3D Indoor Scene Synthesis via Multi-Turn RLcited by 6
- 2026SceneAssistant: A Visual Feedback Agent for Open-Vocabulary 3D Scene Generationcited by 6
- 2025HLG: Comprehensive 3D Room Construction via Hierarchical Layout Generationcited by 4
- 2025From Geometry to Culture: An Iterative VLM Layout Framework for Placing Objects in Complex 3D Scene Contextscited by 3
- 2026Repurposing 3D Generative Model for Autoregressive Layout Generationcited by 3
- 2026SceneOrchestra: Efficient Agentic 3D Scene Synthesis via Full Tool-Call Trajectory Generationcited by 2
- 2026HOG-Layout: Hierarchical 3D Scene Generation, Optimization and Editing via Vision-Language Modelscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026CasLayout: Cascaded 3D Layout Diffusion for Indoor Scene Synthesis with Implicit Relation Modeling
- 2026Learning an Interior Layout Policy in a Domain Specific Language Action Space
- 2025M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generation
- 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesis
- 2026SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptions
- 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesis
- 2026PolyLayout: Hierarchical VLM-Guided Layout Generation Beyond Rectangular Rooms
- 2026FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generation