mlsanityData to 7 Oct 2026

SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objects

arXiv 2605.19587 ↗First posted 19 May 2026cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Indoor scene synthesis underpins embodied AI, robotic manipulation, and simulation-based policy evaluation, where a useful scene must specify not only what the environment looks like, but also how its objects are structured. Existing pipelines, however, typically represent generated content as static meshes and inherit articulation only from curated asset libraries, which limits object-level controllability and prevents new interactable assets from being produced on demand. We address this gap by formulating physically interactable indoor scene synthesis as programmatic world generation, and present SceneCode, a framework that compiles a natural language prompt into an executable, code-driven indoor world rather than a collection of opaque meshes. A room-level agentic backbone first turns the prompt into a structured house layout and emits per-object AssetRequests through a planner--designer--critic loop. Each request is then routed to one of five code-generation strategies and converted into a synthesized part-wise Blender Python programs that are validated through an execution-guided repair-and-refine loop. The resulting programs are compiled into simulation-ready assets, and exported as SDF for physics simulation. A persistent scene-state registry links object requests, executable programs, rendered geometry, and simulation assets, turning scene assembly into a traceable and locally editable world-building process. We evaluate SceneCode across scene-level synthesis, object-level asset quality, human judgment, and downstream robot interaction. Results show that executable world programs improve prompt-faithful indoor scene generation and produce assets with cleaner mesh structure, and simulator-loadable articulation metadata. Project page: https://scene-code.github.io/.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 32 of its 38 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

32 of 38 references.

References · 32

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  4. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  5. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
  6. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  7. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  8. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
  9. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  10. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
  11. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
  12. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
20 more
  1. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
  2. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
  3. 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
  4. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
  5. 2020SceneFormer: Indoor Scene Generation with Transformerscited by 154
  6. 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
  7. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 125
  8. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
  9. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
  10. 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 94
  11. 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
  12. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
  13. 2021AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-shot Interactionscited by 56
  14. 2023CAGE: Controllable Articulation GEnerationcited by 50
  15. 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenescited by 39
  16. 2024Architect: Generating Vivid and Interactive 3D Scenes with Hierarchical 2D Inpaintingcited by 37
  17. 2024BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvementcited by 26
  18. 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
  19. 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
  20. 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Cloudscited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agent
  2. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generation
  3. 2026Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesis
  4. 2026SceneFoundry: Generating Interactive Infinite 3D Worlds
  5. 2024Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databases
  6. 2025ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editing
  7. 2026MANSION: Multi-floor lANguage-to-3D Scene generatIOn for loNg-horizon tasks
  8. 2026SceneMosaic: Efficient and Diverse Simulation-Ready Scene Generation via Hybrid Agentic Layout Evolution