Full 3D Reconstruction of Transparent Objects
Not on the map. Why?
Abstract (arXiv)
Numerous techniques have been proposed for reconstructing 3D models for opaque objects in past decades. However, none of them can be directly applied to transparent objects. This paper presents a fully automatic approach for reconstructing complete 3D shapes of transparent objects. Through positioning an object on a turntable, its silhouettes and light refraction paths under different viewing directions are captured. Then, starting from an initial rough model generated from space carving, our algorithm progressively optimizes the model under three constraints: surface and refraction normal consistency, surface projection and silhouette consistency, and surface smoothness. Experimental results on both synthetic and real objects demonstrate that our method can successfully recover the complex shapes of transparent objects and faithfully reproduce their light refraction properties.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 10; 2024: 2; 2025: 4; 2026: 1.
24 papers.
Sort:
By area:
- 2023BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objectscited by 70
- 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
- 2024BOP Challenge 2023 on Detection, Segmentation and Pose Estimation of Seen and Unseen Rigid Objectscited by 60
- 2022Eikonal Fields for Refractive Novel-View Synthesiscited by 30
- 2022Transparent Shape from a Single View Polarization Imagecited by 16
- 2023NeRRF: 3D Reconstruction and View Synthesis for Transparent and Specular Objects with Neural Refractive-Reflective Fieldscited by 16
- 2025TransparentGS: Fast Inverse Rendering of Transparent Objects with Gaussianscited by 16
- 2022Hybrid Mesh-neural Representation for 3D Transparent Object Reconstructioncited by 15
- 2023NEMTO: Neural Environment Matting for Novel View and Relighting Synthesis of Transparent Objectscited by 14
- 2022TODE-Trans: Transparent Object Depth Estimation with Transformercited by 13
- 2023Seeing Through the Glass: Neural 3D Reconstruction of Object Inside a Transparent Containercited by 10
- 2023NeTO:Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracingcited by 9
12 more
- 2022Polarimetric Inverse Rendering for Transparent Shapes Reconstructioncited by 8
- 2023RFTrans: Leveraging Refractive Flow of Transparent Objects for Surface Normal Estimation and Manipulationcited by 6
- 2023Towards Monocular Shape from Refractioncited by 3
- 2025Glossy Object Reconstruction with Cost-effective Polarized Acquisitioncited by 3
- 2023REF2-NeRF: Reflection and Refraction aware Neural Radiance Fieldcited by 2
- 2024From Transparent to Opaque: Rethinking Neural Implicit Surfaces with α-NeuScited by 2
- 2021Shape and Reflectance Reconstruction in Uncontrolled Environments by Differentiable Renderingcited by 1
- 2025RefRef: A Dataset and Benchmark for Reconstructing Refractive and Reflective Objectscited by 1
- 2023NERFBK: A High-Quality Benchmark for NERF-Based 3D Reconstructioncited by 0
- 2023Tabletop Transparent Scene Reconstruction via Epipolar-Guided Optical Flow with Monocular Depth Completion Priorcited by 0
- 2025HTMNet: A Hybrid Network with Transformer-Mamba Bottleneck Multimodal Fusion for Transparent and Reflective Objects Depth Completioncited by 0
- 2026DiffTrans: Differentiable Geometry-Materials Decomposition for Reconstructing Transparent Objectscited by 0
- 2026DiffTrans: Differentiable Geometry-Materials Decomposition for Reconstructing Transparent Objects28 Feb 2026
- 2025HTMNet: A Hybrid Network with Transformer-Mamba Bottleneck Multimodal Fusion for Transparent and Reflective Objects Depth Completion27 May 2025
- 2025RefRef: A Dataset and Benchmark for Reconstructing Refractive and Reflective Objects9 May 2025
- 2025TransparentGS: Fast Inverse Rendering of Transparent Objects with Gaussians26 Apr 2025
- 2025Glossy Object Reconstruction with Cost-effective Polarized Acquisition9 Apr 2025
- 2024From Transparent to Opaque: Rethinking Neural Implicit Surfaces with α-NeuS8 Nov 2024
- 2024BOP Challenge 2023 on Detection, Segmentation and Pose Estimation of Seen and Unseen Rigid Objects14 Mar 2024
- 2023REF2-NeRF: Reflection and Refraction aware Neural Radiance Field28 Nov 2023
- 2023RFTrans: Leveraging Refractive Flow of Transparent Objects for Surface Normal Estimation and Manipulation21 Nov 2023
- 2023Tabletop Transparent Scene Reconstruction via Epipolar-Guided Optical Flow with Monocular Depth Completion Prior15 Oct 2023
- 2023NeRRF: 3D Reconstruction and View Synthesis for Transparent and Specular Objects with Neural Refractive-Reflective Fields22 Sep 2023
- 2023NERFBK: A High-Quality Benchmark for NERF-Based 3D Reconstruction9 Jun 2023
12 more
- 2023Towards Monocular Shape from Refraction31 May 2023
- 2023Seeing Through the Glass: Neural 3D Reconstruction of Object Inside a Transparent Container24 Mar 2023
- 2023NEMTO: Neural Environment Matting for Novel View and Relighting Synthesis of Transparent Objects21 Mar 2023
- 2023NeTO:Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracing20 Mar 2023
- 2023BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objects25 Feb 2023
- 2022TODE-Trans: Transparent Object Depth Estimation with Transformer18 Sep 2022
- 2022Polarimetric Inverse Rendering for Transparent Shapes Reconstruction25 Aug 2022
- 2022Transparent Shape from a Single View Polarization Image13 Apr 2022
- 2022Hybrid Mesh-neural Representation for 3D Transparent Object Reconstruction23 Mar 2022
- 2022Eikonal Fields for Refractive Novel-View Synthesis2 Feb 2022
- 2021Shape and Reflectance Reconstruction in Uncontrolled Environments by Differentiable Rendering25 Oct 2021
- 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objects1 Apr 2021
- 2023BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objectscited by 70
- 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
- 2024BOP Challenge 2023 on Detection, Segmentation and Pose Estimation of Seen and Unseen Rigid Objectscited by 60
- 2022Eikonal Fields for Refractive Novel-View Synthesiscited by 30
- 2022Transparent Shape from a Single View Polarization Imagecited by 16
- 2023NeRRF: 3D Reconstruction and View Synthesis for Transparent and Specular Objects with Neural Refractive-Reflective Fieldscited by 16
- 2025TransparentGS: Fast Inverse Rendering of Transparent Objects with Gaussianscited by 16
- 2022Hybrid Mesh-neural Representation for 3D Transparent Object Reconstructioncited by 15
- 2023NEMTO: Neural Environment Matting for Novel View and Relighting Synthesis of Transparent Objectscited by 14
- 2022TODE-Trans: Transparent Object Depth Estimation with Transformercited by 13
- 2023Seeing Through the Glass: Neural 3D Reconstruction of Object Inside a Transparent Containercited by 10
- 2023NeTO:Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracingcited by 9
12 most cited of 23 All 23 (JSON)
- 2026DiffTrans: Differentiable Geometry-Materials Decomposition for Reconstructing Transparent Objects28 Feb 2026
- 2025RefRef: A Dataset and Benchmark for Reconstructing Refractive and Reflective Objects9 May 2025
- 2025TransparentGS: Fast Inverse Rendering of Transparent Objects with Gaussians26 Apr 2025
- 2025Glossy Object Reconstruction with Cost-effective Polarized Acquisition9 Apr 2025
- 2024From Transparent to Opaque: Rethinking Neural Implicit Surfaces with α-NeuS8 Nov 2024
- 2024BOP Challenge 2023 on Detection, Segmentation and Pose Estimation of Seen and Unseen Rigid Objects14 Mar 2024
- 2023REF2-NeRF: Reflection and Refraction aware Neural Radiance Field28 Nov 2023
- 2023RFTrans: Leveraging Refractive Flow of Transparent Objects for Surface Normal Estimation and Manipulation21 Nov 2023
- 2023Tabletop Transparent Scene Reconstruction via Epipolar-Guided Optical Flow with Monocular Depth Completion Prior15 Oct 2023
- 2023NeRRF: 3D Reconstruction and View Synthesis for Transparent and Specular Objects with Neural Refractive-Reflective Fields22 Sep 2023
- 2023NERFBK: A High-Quality Benchmark for NERF-Based 3D Reconstruction9 Jun 2023
- 2023Towards Monocular Shape from Refraction31 May 2023
12 newest of 23 All 23 (JSON)