mlsanityData to 7 Oct 2026

OpenIllumination: A Multi-Illumination Dataset for Inverse Rendering Evaluation on Real Objects

arXiv 2309.07921 ↗First posted 14 Sep 2023cs.CVcited by 31

Not on the map. Why?

Abstract (arXiv)

We introduce OpenIllumination, a real-world dataset containing over 108K images of 64 objects with diverse materials, captured under 72 camera views and a large number of different illuminations. For each image in the dataset, we provide accurate camera parameters, illumination ground truth, and foreground segmentation masks. Our dataset enables the quantitative evaluation of most inverse rendering and material decomposition methods for real objects. We examine several state-of-the-art inverse rendering methods on our dataset and compare their performances. The dataset and code can be found on the project page: https://oppo-us-research.github.io/OpenIllumination.

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 22 of its 55 references that are in the map. First posted on arXiv 14 Sep 2023.

Builds on

22 of 55 references.

References · 22

  1. 2023Segment Anythingcited by 8,158
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  4. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  5. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  6. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 446
  7. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
  8. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 332
  9. 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 204
  10. 2020Neural Reflectance Fields for Appearance Acquisitioncited by 196
  11. 2020Real-Time High-Resolution Background Mattingcited by 172
  12. 2022Modeling Indirect Illumination for Inverse Renderingcited by 167
10 more
  1. 2023TensoIR: Tensorial Inverse Renderingcited by 166
  2. 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
  3. 2021NeRF for Outdoor Scene Relightingcited by 114
  4. 2022IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric Imagescited by 110
  5. 2020Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Imagescited by 65
  6. 2020Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset for Spatially Varying Isotropic Materialscited by 56
  7. 2019A Dataset of Multi-Illumination Images in the Wildcited by 45
  8. 2023ReLight My NeRF: A Dataset for Novel View Synthesis and Relighting of Real World Objectscited by 42
  9. 2022NeROIC: Neural Rendering of Objects from Online Image Collectionscited by 36
  10. 2021Reusable Templates and Guides For Documenting Datasets and Models for Natural Language Processing and Generation: A Case Study of the HuggingFace and GEM Data and Model Cardscited by 24

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 13; 2025: 7; 2026: 7.

31 papers.

Sort:

By area:

  1. 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
  2. 2023Stanford-ORB: A Real-World 3D Object Inverse Rendering Benchmarkcited by 51
  3. 2024LRM-Zero: Training Large Reconstruction Models with Synthesized Datacited by 35
  4. 2024Baking Gaussian Splatting into Diffusion Denoiser for Fast and Scalable Single-stage Image-to-3D Generation and Reconstructioncited by 32
  5. 2025Digital Twin Catalog: A Large-Scale Photorealistic 3D Object Digital Twin Datasetcited by 29
  6. 2023ZeroRF: Fast Sparse View 360deg Reconstruction with Zero Pretrainingcited by 24
  7. 2024Objects With Lighting: A Real-World Dataset for Evaluating Reconstruction and Rendering for Object Relightingcited by 18
  8. 2024Flash Cache: Reducing Bias in Radiance Cache Based Inverse Renderingcited by 12
  9. 2023Robo360: A 3D Omnispective Multi-Material Robotic Manipulation Datasetcited by 8
  10. 2025HumanOLAT: A Large-Scale Dataset for Full-Body Human Relighting and Novel-View Synthesiscited by 7
  11. 2023RENI++ A Rotation-Equivariant, Scale-Invariant, Natural Illumination Priorcited by 6
  12. 2024AugGS: Self-augmented Gaussians with Structural Masks for Sparse-view 3D Reconstructioncited by 5
19 more
  1. 2025OLATverse: A Large-scale Real-world Object Dataset with Precise Lighting Controlcited by 5
  2. 2026LightCity: An Urban Dataset for Outdoor Inverse Rendering and Reconstruction under Multi-illumination Conditionscited by 4
  3. 2024LumiSculpt: Enabling Consistent Portrait Lighting in Video Generationcited by 3
  4. 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challengescited by 3
  5. 2024PIR: Photometric Inverse Rendering with Shading Cues Modeling and Surface Reflectance Regularizationcited by 2
  6. 2024Baking Relightable NeRF for Real-time Direct/Indirect Illumination Renderingcited by 1
  7. 2024MLI-NeRF: Multi-Light Intrinsic-Aware Neural Radiance Fieldscited by 1
  8. 2025DualMat: PBR Material Estimation via Coherent Dual-Path Diffusioncited by 1
  9. 2025UAVLight: A Benchmark for Illumination-Robust 3D Reconstruction in Unmanned Aerial Vehicle (UAV) Scenescited by 1
  10. 2025POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modelingcited by 1
  11. 2026Learning Latent Proxies for Controllable Single-Image Relightingcited by 1
  12. 2026LumiMotion: Improving Gaussian Relighting with Scene Dynamicscited by 1
  13. 2024OpenMaterial: A Large-scale Dataset of Complex Materials for 3D Reconstructioncited by 0
  14. 2024Incorporating dense metric depth into neural 3D representations for view synthesis and relightingcited by 0
  15. 2024An Illumination-Robust Feature Extractor Augmented by Relightable 3D Reconstructioncited by 0
  16. 2026EvalMVX: A Unified Benchmarking for Neural 3D Reconstruction under Diverse Multiview Setupscited by 0
  17. 2026WildRelight: A Real-World Benchmark and Physics-Guided Adaptation for Single-Image Relightingcited by 0
  18. 2026Wild3R: Feed-Forward 3D Gaussian Splatting from Unconstrained Sparse Photo Collectioncited by 0
  19. 2026Consistent Feature Transport for Image Relightingcited by 0