mlsanityData to 14 Oct 2026

IL3D: A Large-Scale Indoor Layout Dataset for LLM-Driven 3D Scene Generation

arXiv 2510.12095 ↗First posted 14 Oct 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

In this study, we present IL3D, a large-scale dataset meticulously designed for large language model (LLM)-driven 3D scene generation, addressing the pressing demand for diverse, high-quality training data in indoor layout design. Comprising 27,816 indoor layouts across 18 prevalent room types and a library of 29,215 high-fidelity 3D object assets, IL3D is enriched with instance-level natural language annotations to support robust multimodal learning for vision-language tasks. We establish rigorous benchmarks to evaluate LLM-driven scene generation. Experimental results show that supervised fine-tuning (SFT) of LLMs on IL3D significantly improves generalization and surpasses the performance of SFT on other datasets. IL3D offers flexible multimodal data export capabilities, including point clouds, 3D bounding boxes, multiview images, depth maps, normal maps, and semantic masks, enabling seamless adaptation to various visual tasks. As a versatile and robust resource, IL3D significantly advances research in 3D scene generation and embodied intelligence, by providing high-fidelity scene data to support environment perception tasks of embodied agents.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 32 references that are in the map. First posted on arXiv 14 Oct 2025.

Builds on

32 of 32 references.

References · 32

  1. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  2. 2015VQA: Visual Question Answeringcited by 2,506
  3. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
  4. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  5. 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 452
  6. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  7. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  8. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
  9. 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
  10. 2022SQA3D: Situated Question Answering in 3D Scenescited by 314
  11. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
  12. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
20 more
  1. 2020Scan2Cap: Context-aware Dense Captioning in RGB-D Scanscited by 218
  2. 2020RoboTHOR: An Open Simulation-to-Real Embodied AI Platformcited by 193
  3. 2021Shape As Points: A Differentiable Poisson Solvercited by 187
  4. 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
  5. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
  6. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
  7. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
  8. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
  9. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
  10. 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 96
  11. 2024I-Design: Personalized LLM Interior Designercited by 87
  12. 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 61
  13. 2025SceneGen: Single-Image 3D Scene Generation in One Feedforward Passcited by 54
  14. 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
  15. 2025MetaScenes: Towards Automated Replica Creation for Real-world 3D Scanscited by 31
  16. 2023Selective Visual Representations Improve Convergence and Generalization for Embodied AIcited by 19
  17. 2025OptiScene: LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimizationcited by 14
  18. 2025CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layoutscited by 10
  19. 2025RoomCraft: Controllable and Complete 3D Indoor Scene Generationcited by 9
  20. 2025ExCap3D: Expressive 3D Scene Understanding via Object Captioning with Varying Detailcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.