ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
While traditional graphics methods often synthesize 3D indoor scenes autoregressively or hierarchically, recent vision-language model (VLM)-based generators predominantly adopt a one-shot paradigm where the full layout is planned at once. This one-shot approach often requires global re-optimization or complete reconstruction during interactive editing (e.g., inserting or moving objects) and can lead to physically or semantically poorly organized arrangements. To address these challenges, we propose ThinkBLOX, a VLM-based progressive reasoning framework that iteratively designs and refines 3D scenes. ThinkBLOX treats layout generation as a state-conditioned, step-by-step reasoningand-action process. To power this, we construct the ThinkBLOX-Data-200K dataset, containing 224,757 procedural placement pairs annotated with multi-view scene context, explicit Chain-of-Thought (CoT) rationales, and structured JSON layouts. Through supervised fine-tuning (SFT) on this dataset, the VLM learns to bridge the reasoning-action gap under incremental updates. Furthermore, recognizing that scene synthesis is inherently a multisolution task where SFT suffers from reward conflict, we introduce Tier-Decoupled GDPO. This reinforcement learning scheme organizes heterogeneous rewards into distinct tiers, stabilizing policy optimization across physical validity, semantic plausibility, and reasoning-action consistency. Extensive experiments show that ThinkBLOX significantly outperforms recent one-shot and iterative baselines in physical plausibility, semantic alignment, and interactive editability. Additionally, we show that it supports diverse applications, including both global and local generation and rearrangement of 3D scenes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 46 references that are in the map. First posted on arXiv 15 Jul 2026.
Builds on
33 of 46 references.
Closest ancestors · 5
Same direction, newest first
- 2025Direct Numerical Layout Generation for 3D Indoor Scene Synthesis via Spatial Reasoning5 Jun
- 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaverse24 Mar
- 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Models3 Dec
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
Other references · 28
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
- 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 357
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
16 more
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 175
- 2020SceneFormer: Indoor Scene Generation with Transformerscited by 154
- 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 151
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 110
- 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 104
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2024SceneTeller: Language-to-3D Scene Generationcited by 43
- 2015Text to 3D Scene Generation with Rich Lexical Groundingcited by 36
- 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
- 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 22
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 20
- 2025CasaGPT: Cuboid Arrangement and Scene Assembly for Interior Designcited by 14
- 2024Forest2Seq: Revitalizing Order Prior for Sequential Indoor Scene Synthesiscited by 12
- 2025HLG: Comprehensive 3D Room Construction via Hierarchical Layout Generationcited by 4
- 2025IL3D: A Large-Scale Indoor Layout Dataset for LLM-Driven 3D Scene Generationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editing
- 2026SDesc3D: Towards Layout-Aware 3D Indoor Scene Generation from Short Descriptions
- 2026Global Graph-Validated Optimization for VLM-based 3D Indoor Scene Generation
- 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesis
- 2026IDEAL-Bench: Indoor Dataset and Evaluation suite for Analyzing 3D Layout reasoning
- 2025M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generation
- 2025MVRoom: Controllable 3D Indoor Scene Generation with Multi-View Diffusion Models
- 2025SPATIALGEN: Layout-guided 3D Indoor Scene Generation