mlsanityData to 7 Oct 2026

SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesis

arXiv 2604.13035 ↗First posted 14 Apr 2026cs.CV cs.CLcited by 2

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Large Language Models (LLMs) and Vision-Language Models (VLMs) increasingly generate indoor scenes through intermediate structures such as layouts and scene graphs, yet evaluation still relies on LLM or VLM judges that score rendered views, making judgments sensitive to viewpoint, prompt phrasing, and hallucination. When the evaluator is unstable, it becomes difficult to determine whether a model has produced a spatially plausible scene or whether the output score reflects the choice of viewpoint, rendering, or prompt. We introduce SceneCritic, a symbolic evaluator for floor-plan-level layouts. SceneCritic's constraints are grounded in SceneOnto, a structured spatial ontology we construct by aggregating indoor scene priors from 3D-FRONT, ScanNet, and Visual Genome. SceneOnto traverses this ontology to jointly verify semantic, orientation, and geometric coherence across object relationships, providing object-level and relationship-level assessments that identify specific violations and successful placements. Furthermore, we pair SceneCritic with an iterative refinement test bed that probes how models build and revise spatial structure under different critic modalities: a rule-based critic using collision constraints as feedback, an LLM critic operating on the layout as text, and a VLM critic operating on rendered observations. Through extensive experiments, we show that (a) SceneCritic aligns substantially better with human judgments than VLM-based evaluators, (b) text-only LLMs can outperform VLMs on semantic layout quality, and (c) image-based VLM refinement is the most effective critic modality for semantic and orientation correction.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 43 of its 45 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

43 of 45 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025IR3D-Bench: Evaluating Vision-Language Model Scene Understanding as Agentic Inverse Rendering29 Jun
  2. 2025Agentic 3D Scene Generation with Spatially Contextualized VLMs26 May
  3. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  4. 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Models3 Dec
  5. 2024TopViewRS: Vision-Language Models as Top-View Spatial Reasoners4 Jun
  6. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan

Other references · 37

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  5. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  6. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  7. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  8. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  9. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  10. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
  11. 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 671
  12. 2024Hallucination of Multimodal Large Language Models: A Surveycited by 380
25 more
  1. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  2. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
  3. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  4. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
  5. 2024A Survey on Hallucination in Large Vision-Language Modelscited by 352
  6. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
  7. 2024RLHF Workflow: From Reward Modeling to Online RLHFcited by 265
  8. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
  9. 2025Learning to Reason without External Rewardscited by 199
  10. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Codecited by 125
  11. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
  12. 2025UI-Venus Technical Report: Building High-performance UI Agents with RFTcited by 90
  13. 2024I-Design: Personalized LLM Interior Designercited by 87
  14. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 65
  15. 2019SceneGraphNet: Neural Message Passing for 3D Indoor Scene Augmentationcited by 55
  16. 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
  17. 2025EmbodiedGen: Towards a Generative 3D World Engine for Embodied Intelligencecited by 32
  18. 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoningcited by 27
  19. 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
  20. 2025FlairGPT: Repurposing LLMs for Interior Designscited by 22
  21. 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimizationcited by 14
  22. 2025HOLODECK 2.0: Vision-Language-Guided 3D World Generation with Editingcited by 14
  23. 2026SceneFoundry: Generating Interactive Infinite 3D Worldscited by 4
  24. 2025Constructing a 3D Scene from a Single Imagecited by 2
  25. 2025AutoLayout: Closed-Loop Layout Synthesis via Slow-Fast Collaborative Reasoningcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editing
  2. 2026IDEAL-Bench: Indoor Dataset and Evaluation suite for Analyzing 3D Layout reasoning
  3. 2025FloorplanQA: A Benchmark for Spatial Reasoning in LLMs using Structured Representations
  4. 2026SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptions
  5. 2026ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning
  6. 2026CasLayout: Cascaded 3D Layout Diffusion for Indoor Scene Synthesis with Implicit Relation Modeling
  7. 2026Global Graph-Validated Optimization for VLM-based 3D Indoor Scene Generation
  8. 2025SemLayoutDiff: Semantic Layout Generation with Diffusion Model for Indoor Scene Synthesis