mlsanityData to 7 Oct 2026

Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction

arXiv 2608.18840 ↗First posted 19 Aug 2026cs.RO cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Indoor scene synthesis provides essential environments for embodied AI, robotic manipulation, and simulation-based policy learning. Recent code-based scene generation methods produce editable and extensible environments, yet they remain focused on visual construction and object-level articulation, leaving the functional usage of scenes largely unmodeled. To address this problem, we present RoomWright, an agentic usage-driven framework for generating 3D scenes represented entirely as code for embodied interaction. RoomWright performs usage-driven object reasoning, which treats each anchor as a task centre and admits task-required objects and their affordances. A code agent further enables multi-part interaction by compiling each interaction into a trigger, condition, effect rule that updates structured object states, capturing causal dependencies across objects. Moreover, since manipuland orientation is ambiguous and hard to recover from pixels, RoomWright alleviates this via annotation-informed usage-guided orientation. Extensive experiments demonstrate the effectiveness of our method. The resulting scenes are executable, editable, and simulation-ready, providing interactive environments for embodied AI and policy learning.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 19 Aug 2026.

Builds on

16 of 27 references.

References · 16

  1. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  2. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  3. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
  4. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
  5. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
  6. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
  7. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
  8. 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenescited by 39
  9. 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
  10. 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 25
  11. 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
  12. 2025MesaTask: Towards Task-Driven Tabletop Scene Generation via 3D Spatial Reasoningcited by 15
4 more
  1. 2025Imaginarium: Vision-guided High-Quality 3D Scene Layout Generationcited by 11
  2. 2026SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objectscited by 7
  3. 2026Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesiscited by 5
  4. 2026STABLE: Simulation-Ready Tabletop Layout Generation via a Semantics-Physics Dual Systemcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agent
  2. 2026CodeActionBench: Evaluating Agentic Code-as-Policy for Embodied Manipulation
  3. 2026SceneFoundry: Generating Interactive Infinite 3D Worlds
  4. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generation
  5. 2026SceneTeract: Probing and Improving Agent-Aware Activity Reasoning in 3D Indoor Scenes
  6. 2026FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generation
  7. 2026SAGE: Scalable Agentic 3D Scene Generation for Embodied AI
  8. 2025MomaGraph: State-Aware Unified Scene Graphs with Vision-Language Model for Embodied Task Planning