Structured3D: A Large Photo-realistic Dataset for Structured 3D Modeling
Not on the map. Why?
Abstract (arXiv)
Recently, there has been growing interest in developing learning-based methods to detect and utilize salient semi-global or global structures, such as junctions, lines, planes, cuboids, smooth surfaces, and all types of symmetries, for 3D scene modeling and understanding. However, the ground truth annotations are often obtained via human labor, which is particularly challenging and inefficient for such tasks due to the large number of 3D structure instances (e.g., line segments) and other factors such as viewpoints and occlusions. In this paper, we present a new synthetic dataset, Structured3D, with the aim of providing large-scale photo-realistic images with rich 3D structure annotations for a wide spectrum of structured 3D modeling tasks. We take advantage of the availability of professional interior designs and automatically extract 3D structures from them. We generate high-quality images with an industry-leading rendering engine. We use our synthetic dataset in combination with real images to train deep networks for room layout estimation and demonstrate improved performance on benchmark datasets.
Key facts. Cited by 285 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 21; 2023: 28; 2024: 53; 2025: 77; 2026: 78.
285 papers.
Sort:
By area:
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 326
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
- 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 130
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
- 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understandingcited by 111
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
- 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 108
- 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 106
38 more
- 2023OneFormer3D: One Transformer for Unified Point Cloud Segmentationcited by 95
- 2023Improving Multimodal Datasets with Image Captioningcited by 93
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Trainingcited by 85
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspectivecited by 73
- 2025SpatialLM: Training Large Language Models for Structured Indoor Modelingcited by 63
- 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 59
- 2023PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigmcited by 56
- 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretrainingcited by 51
- 2023PanoDiffusion: 360-degree Panorama Outpainting via Diffusioncited by 50
- 2022Connecting the Dots: Floorplan Reconstruction Using Two-Level Queriescited by 48
- 2022Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentationcited by 46
- 2024Lexicon3D: Probing Visual Foundation Models for Complex 3D Scene Understandingcited by 46
- 2024Colorful Diffuse Intrinsic Image Decomposition in the Wildcited by 44
- 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 44
- 2021LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Renderingcited by 42
- 2023EGformer: Equirectangular Geometry-biased Transformer for 360 Depth Estimationcited by 42
- 2025Concerto: Joint 2D-3D Self-Supervised Learning Emerges Spatial Representationscited by 42
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentationcited by 41
- 2021ACDNet: Adaptively Combined Dilated Convolution for Monocular Panorama Depth Estimationcited by 39
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 38
- 2024Depth Anywhere: Enhancing 360 Monocular Depth Estimation via Perspective Distillation and Unlabeled Data Augmentationcited by 38
- 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusioncited by 38
- 2021Pano3D: A Holistic Benchmark and a Solid Baseline for 360o Depth Estimationcited by 37
- 2023PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Modelscited by 36
- 20243D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucinationcited by 36
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 36
- 2022CASA: Category-agnostic Skeletal Animal Reconstructioncited by 35
- 2025CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generationcited by 35
- 2021DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimizationcited by 33
- 2021BuildingNet: Learning to Label 3D Buildingscited by 33
- 2024Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusioncited by 31
- 2025DINO in the Room: Leveraging 2D Foundation Models for 3D Segmentationcited by 31
- 2021HEAT: Holistic Edge Attention Transformer for Structured Reconstructioncited by 29
- 2021LaLaLoc: Latent Layout Localisation in Dynamic, Unvisited Environmentscited by 28
- 2022LGT-Net: Indoor Panoramic Room Layout Estimation with Geometry-Aware Transformer Networkcited by 28
- 2024SPA: 3D Spatial-Awareness Enables Effective Embodied Representationcited by 28
50 most cited of 285 All 285 (JSON)
- 2026GeoLatent: Geometry-Guided Latent Structuring with Routed Optimization for 3D Reasoning1 Oct 2026
- 2026ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild1 Oct 2026
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026Decoupling Spherical Reasoning from Dense Prediction for 360 Depth Estimation30 Sep 2026
- 2026S4VY: Segment Anything in Feed-Forward 4D Visual Geometry29 Sep 2026
- 2026Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Cameras28 Sep 2026
- 2026Gauge-Equivariant Attention for Rotation-Stable 360^circ Scene Understanding23 Sep 2026
- 2026SlugTrails: An Egocentric Benchmark for Floor Plan Localization in Large Buildings17 Sep 2026
- 2026Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations11 Sep 2026
- 2026OmniPoint: Universal Monocular Metric Pointcloud from Any Camera8 Sep 2026
- 2026GALoc: Gravity Aligned Wireframes for Depth-Free Monocular Floorplan Localization8 Sep 2026
- 2026OptiGeo: Efficient Monocular Geometry for Embodied Perception in Optically Challenging Scenes30 Aug 2026
38 more
- 2026When Should a Network Emit Geometry, and When Should It Detect It? Readout, Reconciliation, and Representation in Floorplan Vectorization26 Aug 2026
- 2026BIMScript: Material-Aware Structured Scene Programs for BIM Ingestion19 Aug 2026
- 2026PXDepth: Pixel-Space Modeling for Structure Preserving Monocular Depth Estimation17 Aug 2026
- 2026STAR: A Spatial-Topology Aware Routing Framework for Generalizable 3D Scene Understanding12 Aug 2026
- 2026Rethinking 3D Segmentation from Individual LiDAR Scans: Incidence-Aware Sampling on the SIP Benchmark7 Aug 2026
- 2026Scenix: Sparse-View 3D Scene Reconstruction via Executable Scene Programs7 Aug 2026
- 2026ArchEGraph: A Large-Scale Graph Dataset for Geometry-Topology-Physics Aligned Building Energy Modeling7 Aug 2026
- 2026Dense Metric Depth Completion from Sparse Direct Time-of-Flight Sensors5 Aug 2026
- 2026PolyLayout: Multi-room Manhattan Layout Estimation4 Aug 2026
- 2026From Uncertainty to Determinism: Coarse-to-Fine Visual Floorplan Localization without Ray Matching29 Jul 2026
- 2026Genie Sim PanoWorld: An Infinite Indoor 3D World Generation Pipeline via Panoramic Scene Modeling and Simulation29 Jul 2026
- 2026Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation23 Jul 2026
- 2026MoGe-3: Fine-Detail Monocular Geometry Estimation with Self-Guided Sparse Volumetric Refinement20 Jul 2026
- 2026GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understanding15 Jul 2026
- 2026FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry13 Jul 2026
- 2026Mitigating Domain Shift in Conditioned Floor Plan Generation: Synthetic Pre-training for Data-Efficient Adaptation7 Jul 2026
- 2026Image2Sim: Scaling Embodied Navigation via Generative Neural Simulator7 Jul 2026
- 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Image4 Jul 2026
- 2026IDEAL-Bench: Indoor Dataset and Evaluation suite for Analyzing 3D Layout reasoning3 Jul 2026
- 2026Holo-Captioning: Toward the Text Equivalent of 3D Scenes3 Jul 2026
- 2026Text-Driven 3D Indoor Scene Synthesis in Non-Manhattan Environments2 Jul 2026
- 2026InvSplat: Inverse Feed-Forward Scene Splatting2 Jul 2026
- 2026FastPano3D: Feed-Forward Indoor Panoramic 3D Reconstruction from a Single Image29 Jun 2026
- 2026Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes29 Jun 2026
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modeling26 Jun 2026
- 2026Scaling Diverse Language Generation for 3D Visual Grounding18 Jun 2026
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Images10 Jun 2026
- 2026Architect-Ant: Editable Automatic Furnishing of Architectural Floor Plans9 Jun 2026
- 2026HomeWorld: A Unified Floorplan-to-Furnished Framework for Generating Controllable, Densely Interactive Whole-Home Scenes4 Jun 2026
- 2026A Cookbook of 3D Vision: Data, Learning Paradigms, and Application2 Jun 2026
- 2026SurGe: Improved Surface Geometry in Point Maps29 May 2026
- 2026Why Far Looks Up: Probing Spatial Representation in Vision-Language Models28 May 2026
- 2026Unified Panoramic Geometry Estimation via Multi-View Foundation Models25 May 2026
- 2026SceneAligner: 3D-Grounded Floorplan Localization in the Wild21 May 2026
- 2026Coarse Semantic Injection for LLM-Conditioned Structured Indoor Prediction16 May 2026
- 2026CM-EVS: Sparse Panoramic RGB-D-Pose Data for Complete Scene Coverage15 May 2026
- 2026H-OmniStereo: Zero-Shot Omnidirectional Stereo Matching with Heading-Aligned Normal Priors14 May 2026
- 2026Towards Accurate Single Panoramic 3D Detection: A Semantic Gaussian Centric Approach14 May 2026
50 newest of 285 All 285 (JSON)
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 326
- 2023PanoDiffusion: 360-degree Panorama Outpainting via Diffusioncited by 50
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentationcited by 41
- 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusioncited by 38
- 2023PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Modelscited by 36
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 36
- 2025CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generationcited by 35
- 20253D Scene Generation: A Surveycited by 24
- 2023Generating Images with 3D Annotations Using Diffusion Modelscited by 18
- 2024SphereDiffusion: Spherical Geometry-Aware Distortion Resilient Diffusion Modelcited by 13
- 2024CamFreeDiff: Camera-free Image to Panorama Generation with Diffusion Modelcited by 5
- 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Modelscited by 3
12 most cited of 16 All 16 (JSON)
- 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Models12 Apr 2026
- 2026Gimbal360: Canonicalizing Planar Diffusion for Spherical Panorama Completion24 Mar 2026
- 2026Scene Generation at Absolute Scale: Utilizing Semantic and Geometric Guidance From Text for Accurate and Interpretable 3D Indoor Scene Generation14 Mar 2026
- 2025HDR Environment Map Estimation with Latent Diffusion Models28 Jul 2025
- 20253D Scene Generation: A Survey8 May 2025
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priors1 Apr 2025
- 2025BADGR: Bundle Adjustment Diffusion Conditioned by GRadients for Wide-Baseline Floor Plan Reconstruction25 Mar 2025
- 2025CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generation28 Jan 2025
- 2024DiffPano: Scalable and Consistent Text to Panorama Generation with Spherical Epipolar-Aware Diffusion31 Oct 2024
- 2024CamFreeDiff: Camera-free Image to Panorama Generation with Diffusion Model9 Jul 2024
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation25 Mar 2024
- 2024SphereDiffusion: Spherical Geometry-Aware Distortion Resilient Diffusion Model15 Mar 2024
12 newest of 16 All 16 (JSON)
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
- 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 106
- 2023Improving Multimodal Datasets with Image Captioningcited by 93
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspectivecited by 73
- 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretrainingcited by 51
- 2024Synth2: Boosting Visual-Language Models with Synthetic Captions and Image Embeddingscited by 18
- 2025LEO-VL: Efficient Scene Representation for Scalable 3D Vision-Language Learningcited by 4
- 2026SoPE: Spherical Coordinate-Based Positional Embedding for Enhancing Spatial Perception of 3D LVLMscited by 2
- 2025Disc3D: Automatic Curation of High-Quality 3D Dialog Data via Discriminative Object Referringcited by 0
- 2026SoPE: Spherical Coordinate-Based Positional Embedding for Enhancing Spatial Perception of 3D LVLMs26 Feb 2026
- 2025Disc3D: Automatic Curation of High-Quality 3D Dialog Data via Discriminative Object Referring24 Nov 2025
- 2025LEO-VL: Efficient Scene Representation for Scalable 3D Vision-Language Learning11 Jun 2025
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priors30 May 2025
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3D29 Mar 2025
- 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretraining23 Mar 2025
- 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Models2 Jan 2025
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspective26 May 2024
- 2024Synth2: Boosting Visual-Language Models with Synthetic Captions and Image Embeddings12 Mar 2024
- 2023Improving Multimodal Datasets with Image Captioning19 Jul 2023
- 2025FloorplanQA: A Benchmark for Spatial Reasoning in LLMs using Structured Representationscited by 13
- 2026HiSpatial: Taming Hierarchical 3D Spatial Understanding in Vision-Language Modelscited by 1
- 2026Why Far Looks Up: Probing Spatial Representation in Vision-Language Modelscited by 1
- 2026GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understandingcited by 1
- 2026IDEAL-Bench: Indoor Dataset and Evaluation suite for Analyzing 3D Layout reasoningcited by 0
- 2026GeoLatent: Geometry-Guided Latent Structuring with Routed Optimization for 3D Reasoningcited by 0
- 2026GeoLatent: Geometry-Guided Latent Structuring with Routed Optimization for 3D Reasoning1 Oct 2026
- 2026GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understanding15 Jul 2026
- 2026IDEAL-Bench: Indoor Dataset and Evaluation suite for Analyzing 3D Layout reasoning3 Jul 2026
- 2026Why Far Looks Up: Probing Spatial Representation in Vision-Language Models28 May 2026
- 2026HiSpatial: Taming Hierarchical 3D Spatial Understanding in Vision-Language Models26 Mar 2026
- 2025FloorplanQA: A Benchmark for Spatial Reasoning in LLMs using Structured Representations10 Jul 2025
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
- 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 130
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understandingcited by 111
- 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 108
- 2023OneFormer3D: One Transformer for Unified Point Cloud Segmentationcited by 95
- 2024I-Design: Personalized LLM Interior Designercited by 87
- 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Trainingcited by 85
- 2025SpatialLM: Training Large Language Models for Structured Indoor Modelingcited by 63
12 most cited of 250 All 250 (JSON)
- 2026ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild1 Oct 2026
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026Decoupling Spherical Reasoning from Dense Prediction for 360 Depth Estimation30 Sep 2026
- 2026S4VY: Segment Anything in Feed-Forward 4D Visual Geometry29 Sep 2026
- 2026Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Cameras28 Sep 2026
- 2026Gauge-Equivariant Attention for Rotation-Stable 360^circ Scene Understanding23 Sep 2026
- 2026SlugTrails: An Egocentric Benchmark for Floor Plan Localization in Large Buildings17 Sep 2026
- 2026Multimodal Floorplan Encoding: Learning Dense Modality-Invariant Representations11 Sep 2026
- 2026OmniPoint: Universal Monocular Metric Pointcloud from Any Camera8 Sep 2026
- 2026GALoc: Gravity Aligned Wireframes for Depth-Free Monocular Floorplan Localization8 Sep 2026
- 2026OptiGeo: Efficient Monocular Geometry for Embodied Perception in Optically Challenging Scenes30 Aug 2026
- 2026When Should a Network Emit Geometry, and When Should It Detect It? Readout, Reconciliation, and Representation in Floorplan Vectorization26 Aug 2026
12 newest of 250 All 250 (JSON)