Roomer: Reflective Object-Grounded Model Editing and Repair for 3D Indoor Layout Synthesis
Not on the map. Why?
Abstract (arXiv)
Existing indoor layout generators produce globally plausible layouts yet may retain local violations such as collisions, out-of-bounds placements, obstructed openings, and blocked circulation. Most prior work focuses on full-scene synthesis or scene-level optimization, with limited support for identifying responsible objects and locally repairing affected regions. We present Roomer, a reflective repair framework that casts these violations as sparse, object-grounded repair problems. Roomer encodes layouts as ``RoState'' and uses ``RoReview'' to bind measured violations to implicated objects. A geometry-conditioned vision-language model planner proposes a structured local edit, while a deterministic solver validates it and generates a finite set of candidate edits when needed. Each candidate is committed only if full-scene verification confirms that it resolves the target violation without new hard violations or broken protected constraints. We train the planner on Roomer-CC, a controlled-corruption dataset that pairs faulty layouts with object-grounded violation evidence and known-feasible inverse StatePatches. Since existing benchmarks rarely assess whether physically valid layouts are usable, we introduce Roomer-Eval to assess distributional quality, physical validity, and practical usability. Experiments show that Roomer repairs residual violations while preserving valid regions, improves physical validity and usability, and transfers across external generators.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 38 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
26 of 38 references.
References · 26
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2018Demystifying MMD GANscited by 1,268
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 159
- 2020SceneFormer: Indoor Scene Generation with Transformerscited by 154
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
14 more
- 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 83
- 2018Human-centric Indoor Scene Synthesis Using Stochastic Grammarcited by 73
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 65
- 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 38
- 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
- 2024EditRoom: LLM-parameterized Graph Diffusion for Composable 3D Room Layout Editingcited by 14
- 2025CasaGPT: Cuboid Arrangement and Scene Assembly for Interior Designcited by 14
- 2025SViMo: Synchronized Diffusion for Video and Motion Generation in Hand-object Interaction Scenarioscited by 11
- 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesiscited by 6
- 2026SceneReVis: A Self-Reflective Vision-Grounded Framework for 3D Indoor Scene Synthesis via Multi-turn RLcited by 6
- 2025ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editingcited by 5
- 2026Edit-As-Act: Goal-Regressive Planning for Open-Vocabulary 3D Indoor Scene Editingcited by 3
- 2026HarmoHOI: Harmonizing Appearance and 3D Motion for Multi-view Hand-Object Interaction Synthesiscited by 3
- 2025Co-Layout: LLM-driven Co-optimization for Interior Layoutcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ScenePilot: Grow-and-Repair Policy for Text-Driven 3D Indoor Scene Generation
- 2025DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesis
- 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoning
- 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimization
- 2026FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generation
- 2026Function2Scene: 3D Indoor Scene Layout from Functional Specifications
- 2025RoomCraft: Controllable and Complete 3D Indoor Scene Generation
- 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesis