Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction
Not on the map. Why?
Abstract (arXiv)
Indoor scene synthesis provides essential environments for embodied AI, robotic manipulation, and simulation-based policy learning. Recent code-based scene generation methods produce editable and extensible environments, yet they remain focused on visual construction and object-level articulation, leaving the functional usage of scenes largely unmodeled. To address this problem, we present RoomWright, an agentic usage-driven framework for generating 3D scenes represented entirely as code for embodied interaction. RoomWright performs usage-driven object reasoning, which treats each anchor as a task centre and admits task-required objects and their affordances. A code agent further enables multi-part interaction by compiling each interaction into a trigger, condition, effect rule that updates structured object states, capturing causal dependencies across objects. Moreover, since manipuland orientation is ambiguous and hard to recover from pixels, RoomWright alleviates this via annotation-informed usage-guided orientation. Extensive experiments demonstrate the effectiveness of our method. The resulting scenes are executable, editable, and simulation-ready, providing interactive environments for embodied AI and policy learning.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 19 Aug 2026.
Builds on
16 of 27 references.
References · 16
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
- 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenescited by 39
- 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 25
- 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
- 2025MesaTask: Towards Task-Driven Tabletop Scene Generation via 3D Spatial Reasoningcited by 15
4 more
- 2025Imaginarium: Vision-guided High-Quality 3D Scene Layout Generationcited by 11
- 2026SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objectscited by 7
- 2026Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesiscited by 5
- 2026STABLE: Simulation-Ready Tabletop Layout Generation via a Semantics-Physics Dual Systemcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agent
- 2026CodeActionBench: Evaluating Agentic Code-as-Policy for Embodied Manipulation
- 2026SceneFoundry: Generating Interactive Infinite 3D Worlds
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generation
- 2026SceneTeract: Probing and Improving Agent-Aware Activity Reasoning in 3D Indoor Scenes
- 2026FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generation
- 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AI
- 2025MomaGraph: State-Aware Unified Scene Graphs with Vision-Language Model for Embodied Task Planning