IL3D: A Large-Scale Indoor Layout Dataset for LLM-Driven 3D Scene Generation
Not on the map. Why?
Abstract (arXiv)
In this study, we present IL3D, a large-scale dataset meticulously designed for large language model (LLM)-driven 3D scene generation, addressing the pressing demand for diverse, high-quality training data in indoor layout design. Comprising 27,816 indoor layouts across 18 prevalent room types and a library of 29,215 high-fidelity 3D object assets, IL3D is enriched with instance-level natural language annotations to support robust multimodal learning for vision-language tasks. We establish rigorous benchmarks to evaluate LLM-driven scene generation. Experimental results show that supervised fine-tuning (SFT) of LLMs on IL3D significantly improves generalization and surpasses the performance of SFT on other datasets. IL3D offers flexible multimodal data export capabilities, including point clouds, 3D bounding boxes, multiview images, depth maps, normal maps, and semantic masks, enabling seamless adaptation to various visual tasks. As a versatile and robust resource, IL3D significantly advances research in 3D scene generation and embodied intelligence, by providing high-fidelity scene data to support environment perception tasks of embodied agents.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 32 references that are in the map. First posted on arXiv 14 Oct 2025.
Builds on
32 of 32 references.
References · 32
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2015VQA: Visual Question Answeringcited by 2,506
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 452
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
- 2022SQA3D: Situated Question Answering in 3D Scenescited by 314
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
20 more
- 2020Scan2Cap: Context-aware Dense Captioning in RGB-D Scanscited by 218
- 2020RoboTHOR: An Open Simulation-to-Real Embodied AI Platformcited by 193
- 2021Shape As Points: A Differentiable Poisson Solvercited by 187
- 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
- 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 96
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 61
- 2025SceneGen: Single-Image 3D Scene Generation in One Feedforward Passcited by 54
- 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
- 2025MetaScenes: Towards Automated Replica Creation for Real-world 3D Scanscited by 31
- 2023Selective Visual Representations Improve Convergence and Generalization for Embodied AIcited by 19
- 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimizationcited by 14
- 2025CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layoutscited by 10
- 2025RoomCraft: Controllable and Complete 3D Indoor Scene Generationcited by 9
- 2025ExCap3D: Expressive 3D Scene Understanding via Object Captioning with Varying Detailcited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.