InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Dataset
Not on the map. Why?
Abstract (arXiv)
Datasets have gained an enormous amount of popularity in the computer vision community, from training and evaluation of Deep Learning-based methods to benchmarking Simultaneous Localization and Mapping (SLAM). Without a doubt, synthetic imagery bears a vast potential due to scalability in terms of amounts of data obtainable without tedious manual ground truth annotations or measurements. Here, we present a dataset with the aim of providing a higher degree of photo-realism, larger scale, more variability as well as serving a wider range of purposes compared to existing datasets. Our dataset leverages the availability of millions of professional interior designs and millions of production-level furniture and object assets -- all coming with fine geometric details and high-resolution texture. We render high-resolution and high frame-rate video sequences following realistic trajectories while supporting various camera types as well as providing inertial measurements. Together with the release of the dataset, we will make executable program of our interactive simulator software as well as our renderer available at https://interiornetdataset.github.io. To showcase the usability and uniqueness of our dataset, we show benchmarking results of both sparse and dense SLAM algorithms.
Key facts. Cited by 87 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 11; 2023: 13; 2024: 18; 2025: 16; 2026: 9.
87 papers.
Sort:
By area:
- 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2021Learning Indoor Inverse Rendering with 3D Spatially-Varying Lightingcited by 82
- 2022Learning-based Inverse Rendering of Complex Indoor Scenes with Differentiable Monte Carlo Raytracingcited by 78
- 2022ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformerscited by 70
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learningcited by 49
- 2021Extreme Rotation Estimation using Dense Correlation Volumescited by 42
- 2022The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTscited by 38
- 2021StructDepth: Leveraging the structural regularities for self-supervised indoor depth estimationcited by 36
38 more
- 2022ViViD++: Vision for Visibility Datasetcited by 34
- 2021BuildingNet: Learning to Label 3D Buildingscited by 33
- 2022EVIMO2: An Event Camera Dataset for Motion Segmentation, Optical Flow, Structure from Motion, and Visual Inertial Odometry in Indoor Scenes with Monocular or Stereo Algorithmscited by 31
- 2021ChangeSim: Towards End-to-End Online Scene Change Detection in Industrial Indoor Environmentscited by 28
- 2024EFM3D: A Benchmark for Measuring Progress Towards 3D Egocentric Foundation Modelscited by 25
- 2021M2DGR: A Multi-sensor and Multi-scenario SLAM Dataset for Ground Robotscited by 23
- 2023Deep Learning for Camera Calibration and Beyond: A Surveycited by 20
- 2023360BEV: Panoramic Semantic Mapping for Indoor Bird's-Eye Viewcited by 18
- 2024Objects With Lighting: A Real-World Dataset for Evaluating Reconstruction and Rendering for Object Relightingcited by 18
- 2025InternScenes: A Large-scale Simulatable Indoor Scene Dataset with Realistic Layoutscited by 18
- 2022Consistent Direct Time-of-Flight Video Depth Super-Resolutioncited by 16
- 2023Measured Albedo in the Wild: Filling the Gap in Intrinsics Evaluationcited by 16
- 2023Implicit Event-RGBD Neural SLAMcited by 16
- 2025Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Renderingcited by 16
- 2023CAD-Estate: Large-scale CAD Model Annotation in RGB Videoscited by 14
- 2024BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulationcited by 13
- 2025FloorplanQA: A Benchmark for Spatial Reasoning in LLMs using Structured Representationscited by 13
- 2023MAIR: Multi-view Attention Inverse Rendering with 3D Spatially-Varying Lighting Estimationcited by 12
- 2023Spatiotemporally Consistent HDR Indoor Lighting Estimationcited by 12
- 2024FAR: Flexible, Accurate and Robust 6DoF Relative Camera Pose Estimationcited by 12
- 2022A Survey on RGB-D Datasetscited by 11
- 2025TC-Light: Temporally Coherent Generative Rendering for Realistic World Transfercited by 11
- 2021SSLayout360: Semi-Supervised Indoor Layout Estimation from 360-Degree Panoramacited by 9
- 2025CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layoutscited by 9
- 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimationcited by 9
- 2021Probabilistic Spatial Distribution Prior Based Attentional Keypoints Matching Networkcited by 8
- 2025FreeScene: Mixed Graph Diffusion for 3D Scene Synthesis from Free Promptscited by 8
- 2026Generative World Renderercited by 8
- 2021Synthetic 3D Data Generation Pipeline for Geometric Deep Learning in Architecturecited by 7
- 2021NVS-MonoDepth: Improving Monocular Depth Prediction with Novel View Synthesiscited by 7
- 2022Real-time event simulation with frame-based camerascited by 7
- 2023SSR-2D: Semantic 3D Scene Reconstruction from 2D Imagescited by 7
- 2024FIReStereo: Forest InfraRed Stereo Dataset for UAS Depth Perception in Visually Degraded Environmentscited by 7
- 2024ADV2E: Bridging the Gap Between Analogue Circuit and Discrete Frames in the Video-to-Events Simulatorcited by 7
- 2021Event Camera Simulator Design for Modeling Attention-based Inference Architecturescited by 6
- 2021EVReflex: Dense Time-to-Impact Prediction for Event-based Obstacle Avoidancecited by 6
- 2023Estimating Generic 3D Room Structures from 2D Annotationscited by 6
- 2025Event Camera Meets Mobile Embodied Perception: Abstraction, Algorithm, Acceleration, Applicationcited by 6
50 most cited of 87 All 87 (JSON)
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States3 Sep 2026
- 2026Unified Video Dense Prediction from Disjoint Data23 Jul 2026
- 2026Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation23 Jul 2026
- 2026IDEAL-Bench: Indoor Dataset and Evaluation suite for Analyzing 3D Layout reasoning3 Jul 2026
- 2026Diagnosing Aerial-View Object Detectors with Foundational Image Generative Models2 Jul 2026
- 2026Code-as-Room: Generating 3D Rooms from Top-Down View Images via Agentic Code Synthesis18 May 2026
- 2026Synthetic Dataset Generation for Partially Observed Indoor Objects8 Apr 2026
- 2026Generative World Renderer2 Apr 2026
- 2026ICTPolarReal: A Polarized Reflection and Material Dataset of Real World Objects26 Mar 2026
- 2025RoomEditor++: A Parameter-Sharing Diffusion Architecture for High-Fidelity Furniture Synthesis19 Dec 2025
- 2025Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Video13 Dec 2025
- 2025CtrlVDiff: Controllable Video Generation via Unified Multimodal Video Diffusion26 Nov 2025
38 more
- 2025OmniX: From Unified Panoramic Generation and Perception to Graphics-Ready 3D Scenes30 Oct 2025
- 2025ChangingGrounding: 3D Visual Grounding in Changing Scenes16 Oct 2025
- 2025X2Video: Adapting Diffusion Models for Multimodal Controllable Neural Video Rendering9 Oct 2025
- 2025User-Centric Communication Service Provision for Edge-Assisted Mobile Augmented Reality30 Sep 2025
- 2025InternScenes: A Large-scale Simulatable Indoor Scene Dataset with Realistic Layouts13 Sep 2025
- 2025Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Rendering20 Aug 2025
- 2025Spatiotemporally Consistent Indoor Lighting Estimation with Diffusion Priors11 Aug 2025
- 2025FloorplanQA: A Benchmark for Spatial Reasoning in LLMs using Structured Representations10 Jul 2025
- 2025TC-Light: Temporally Coherent Generative Rendering for Realistic World Transfer23 Jun 2025
- 2025FreeScene: Mixed Graph Diffusion for 3D Scene Synthesis from Free Prompts3 Jun 2025
- 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation30 May 2025
- 2025Event Camera Meets Mobile Embodied Perception: Abstraction, Algorithm, Acceleration, Application29 Mar 2025
- 2025CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layouts15 Mar 2025
- 2024GERD: Geometric event response data generation4 Dec 2024
- 2024BelHouse3D: A Benchmark Dataset for Assessing Occlusion Robustness in 3D Point Cloud Semantic Segmentation20 Nov 2024
- 2024ADV2E: Bridging the Gap Between Analogue Circuit and Discrete Frames in the Video-to-Events Simulator19 Nov 2024
- 2024FIReStereo: Forest InfraRed Stereo Dataset for UAS Depth Perception in Visually Degraded Environments12 Sep 2024
- 2024Interactive Occlusion Boundary Estimation through Exploitation of Synthetic Data27 Aug 2024
- 2024Riemann-based Multi-scale Attention Reasoning Network for Text-3D Retrieval25 Aug 2024
- 2024MAIR++: Improving Multi-view Attention Inverse Rendering with Implicit Lighting Representation13 Aug 2024
- 2024360 in the Wild: Dataset for Depth Prediction and View Synthesis27 Jun 2024
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generation17 Jun 2024
- 2024EFM3D: A Benchmark for Measuring Progress Towards 3D Egocentric Foundation Models14 Jun 2024
- 2024SelfReDepth: Self-Supervised Real-Time Depth Restoration for Consumer-Grade Sensors5 Jun 2024
- 2024BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation15 May 2024
- 2024I-Design: Personalized LLM Interior Designer3 Apr 2024
- 2024FAR: Flexible, Accurate and Robust 6DoF Relative Camera Pose Estimation5 Mar 2024
- 2024Leveraging Self-Supervised Learning for Scene Classification in Child Sexual Abuse Imagery2 Mar 2024
- 2024GAM-Depth: Self-Supervised Indoor Depth Estimation Leveraging a Gradient-Aware Mask and Semantic Constraints22 Feb 2024
- 2024DIO: Dataset of 3D Mesh Models of Indoor Objects for Robotics and Computer Vision Applications19 Feb 2024
- 2024Objects With Lighting: A Real-World Dataset for Evaluating Reconstruction and Rendering for Object Relighting17 Jan 2024
- 2023View-Dependent Octree-based Mesh Extraction in Unbounded Scenes for Procedural Synthetic Data13 Dec 2023
- 2023DeepDR: Deep Structure-Aware RGB-D Inpainting for Diminished Reality1 Dec 2023
- 2023Implicit Event-RGBD Neural SLAM18 Nov 2023
- 2023Measured Albedo in the Wild: Filling the Gap in Intrinsics Evaluation27 Jun 2023
- 2023Infinite Photorealistic Worlds using Procedural Generation15 Jun 2023
- 2023Estimating Generic 3D Room Structures from 2D Annotations15 Jun 2023
- 2023CAD-Estate: Large-scale CAD Model Annotation in RGB Videos15 Jun 2023
50 newest of 87 All 87 (JSON)
- 2025Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Renderingcited by 16
- 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimationcited by 9
- 2025Spatiotemporally Consistent Indoor Lighting Estimation with Diffusion Priorscited by 5
- 2025CtrlVDiff: Controllable Video Generation via Unified Multimodal Video Diffusioncited by 5
- 2025X2Video: Adapting Diffusion Models for Multimodal Controllable Neural Video Renderingcited by 3
- 2025CtrlVDiff: Controllable Video Generation via Unified Multimodal Video Diffusion26 Nov 2025
- 2025X2Video: Adapting Diffusion Models for Multimodal Controllable Neural Video Rendering9 Oct 2025
- 2025Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Rendering20 Aug 2025
- 2025Spatiotemporally Consistent Indoor Lighting Estimation with Diffusion Priors11 Aug 2025
- 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation30 May 2025
- 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2021Learning Indoor Inverse Rendering with 3D Spatially-Varying Lightingcited by 82
- 2022Learning-based Inverse Rendering of Complex Indoor Scenes with Differentiable Monte Carlo Raytracingcited by 78
- 2022ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformerscited by 70
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learningcited by 49
- 2021Extreme Rotation Estimation using Dense Correlation Volumescited by 42
- 2022The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTscited by 38
- 2021StructDepth: Leveraging the structural regularities for self-supervised indoor depth estimationcited by 36
12 most cited of 78 All 78 (JSON)
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States3 Sep 2026
- 2026Unified Video Dense Prediction from Disjoint Data23 Jul 2026
- 2026Diagnosing Aerial-View Object Detectors with Foundational Image Generative Models2 Jul 2026
- 2026Synthetic Dataset Generation for Partially Observed Indoor Objects8 Apr 2026
- 2026Generative World Renderer2 Apr 2026
- 2026ICTPolarReal: A Polarized Reflection and Material Dataset of Real World Objects26 Mar 2026
- 2025RoomEditor++: A Parameter-Sharing Diffusion Architecture for High-Fidelity Furniture Synthesis19 Dec 2025
- 2025Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Video13 Dec 2025
- 2025OmniX: From Unified Panoramic Generation and Perception to Graphics-Ready 3D Scenes30 Oct 2025
- 2025ChangingGrounding: 3D Visual Grounding in Changing Scenes16 Oct 2025
- 2025User-Centric Communication Service Provision for Edge-Assisted Mobile Augmented Reality30 Sep 2025
- 2025InternScenes: A Large-scale Simulatable Indoor Scene Dataset with Realistic Layouts13 Sep 2025
12 newest of 78 All 78 (JSON)