Diffusion-Based Depth Inpainting for Transparent and Reflective Objects
Not on the map. Why?
Abstract (arXiv)
Transparent and reflective objects, which are common in our everyday lives, present a significant challenge to 3D imaging techniques due to their unique visual and optical properties. Faced with these types of objects, RGB-D cameras fail to capture the real depth value with their accurate spatial information. To address this issue, we propose DITR, a diffusion-based Depth Inpainting framework specifically designed for Transparent and Reflective objects. This network consists of two stages, including a Region Proposal stage and a Depth Inpainting stage. DITR dynamically analyzes the optical and geometric depth loss and inpaints them automatically. Furthermore, comprehensive experimental results demonstrate that DITR is highly effective in depth inpainting tasks of transparent and reflective objects with robust adaptability.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 33 of its 46 references that are in the map. First posted on arXiv 11 Oct 2024.
Builds on
33 of 46 references.
References · 33
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Segment Anythingcited by 8,234
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
- 2018High Quality Monocular Depth Estimation via Transfer Learningcited by 133
- 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
- 2018Deep Depth Completion of a Single RGB-D Imagecited by 110
21 more
- 2023Monocular Depth Estimation using Diffusion Modelscited by 87
- 2023DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimationcited by 82
- 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 73
- 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
- 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Priorcited by 60
- 2024Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstructioncited by 56
- 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
- 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objectscited by 50
- 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
- 2023Learning Depth Estimation for Transparent and Mirror Surfacescited by 34
- 2023Robotic Perception of Transparent Objects: A Reviewcited by 28
- 2023Looking Through the Glass: Neural Surface Reconstruction Against High Specular Reflectionscited by 19
- 2021Mirror3D: Depth Refinement for Mirror Surfacescited by 13
- 2023FDCT: Fast Depth Completion for Transparent Objectscited by 12
- 2023Self-Supervised Monocular Depth Estimation with Self-Reference Distillation and Disparity Offset Refinementcited by 10
- 2023Decomposed Guided Dynamic Filters for Efficient RGB-Guided Depth Completioncited by 10
- 2024Part-Guided 3D RL for Sim2Real Articulated Object Manipulationcited by 9
- 2022Large-Field Contextual Feature Learning for Glass Detectioncited by 8
- 2024Segment, Lift and Fit: Automatic 3D Shape Labeling from 2D Promptscited by 6
- 2022A Structure-Guided Diffusion Model for Large-Hole Image Completioncited by 1
- 2022ObjCAViT: Improving Monocular Depth Estimation Using Natural Language Models And Image-Object Cross-Attentioncited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 5; 2026: 3.
9 papers.
- 2025Angle Domain Guidance: Latent Diffusion Requires Rotation Rather Than Extrapolationcited by 9
- 2025GeoRemover: Removing Objects and Their Causal Visual Artifactscited by 9
- 2024Efficient 3D Perception on Multi-Sweep Point Cloud with Gumbel Spatial Pruningcited by 1
- 2026MVAnimate: Enhancing Character Animation with Multi-View Optimizationcited by 1
- 2025GAA-TSO: Geometry-Aware Assisted Depth Completion for Transparent and Specular Objectscited by 0
- 2025HTMNet: A Hybrid Network with Transformer-Mamba Bottleneck Multimodal Fusion for Transparent and Reflective Objects Depth Completioncited by 0
- 2025DCIRNet: Depth Completion with Iterative Refinement for Dexterous Grasping of Transparent and Reflective Objectscited by 0
- 2026SeeGroup: Multi-Layer Depth Estimation of Transparent Surfaces via Self-Determined Groupingcited by 0
- 2026RGB-D Video Generation for Improving Human-to-Robot Object Handover Predictioncited by 0
- 2026RGB-D Video Generation for Improving Human-to-Robot Object Handover Prediction13 Aug 2026
- 2026SeeGroup: Multi-Layer Depth Estimation of Transparent Surfaces via Self-Determined Grouping27 May 2026
- 2026MVAnimate: Enhancing Character Animation with Multi-View Optimization9 Feb 2026
- 2025GeoRemover: Removing Objects and Their Causal Visual Artifacts23 Sep 2025
- 2025DCIRNet: Depth Completion with Iterative Refinement for Dexterous Grasping of Transparent and Reflective Objects11 Jun 2025
- 2025HTMNet: A Hybrid Network with Transformer-Mamba Bottleneck Multimodal Fusion for Transparent and Reflective Objects Depth Completion27 May 2025
- 2025Angle Domain Guidance: Latent Diffusion Requires Rotation Rather Than Extrapolation21 May 2025
- 2025GAA-TSO: Geometry-Aware Assisted Depth Completion for Transparent and Specular Objects21 Mar 2025
- 2024Efficient 3D Perception on Multi-Sweep Point Cloud with Gumbel Spatial Pruning12 Nov 2024