mlsanityData to 14 Oct 2026

Diffusion-Based Depth Inpainting for Transparent and Reflective Objects

arXiv 2410.08567 ↗First posted 11 Oct 2024cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Transparent and reflective objects, which are common in our everyday lives, present a significant challenge to 3D imaging techniques due to their unique visual and optical properties. Faced with these types of objects, RGB-D cameras fail to capture the real depth value with their accurate spatial information. To address this issue, we propose DITR, a diffusion-based Depth Inpainting framework specifically designed for Transparent and Reflective objects. This network consists of two stages, including a Region Proposal stage and a Depth Inpainting stage. DITR dynamically analyzes the optical and geometric depth loss and inpaints them automatically. Furthermore, comprehensive experimental results demonstrate that DITR is highly effective in depth inpainting tasks of transparent and reflective objects with robust adaptability.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 33 of its 46 references that are in the map. First posted on arXiv 11 Oct 2024.

Builds on

33 of 46 references.

References · 33

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023Segment Anythingcited by 8,234
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  6. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  7. 2021Vision Transformers for Dense Predictioncited by 1,803
  8. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
  9. 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
  10. 2018High Quality Monocular Depth Estimation via Transfer Learningcited by 133
  11. 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
  12. 2018Deep Depth Completion of a Single RGB-D Imagecited by 110
21 more
  1. 2023Monocular Depth Estimation using Diffusion Modelscited by 87
  2. 2023DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimationcited by 82
  3. 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 73
  4. 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
  5. 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Priorcited by 60
  6. 2024Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstructioncited by 56
  7. 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
  8. 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objectscited by 50
  9. 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
  10. 2023Learning Depth Estimation for Transparent and Mirror Surfacescited by 34
  11. 2023Robotic Perception of Transparent Objects: A Reviewcited by 28
  12. 2023Looking Through the Glass: Neural Surface Reconstruction Against High Specular Reflectionscited by 19
  13. 2021Mirror3D: Depth Refinement for Mirror Surfacescited by 13
  14. 2023FDCT: Fast Depth Completion for Transparent Objectscited by 12
  15. 2023Self-Supervised Monocular Depth Estimation with Self-Reference Distillation and Disparity Offset Refinementcited by 10
  16. 2023Decomposed Guided Dynamic Filters for Efficient RGB-Guided Depth Completioncited by 10
  17. 2024Part-Guided 3D RL for Sim2Real Articulated Object Manipulationcited by 9
  18. 2022Large-Field Contextual Feature Learning for Glass Detectioncited by 8
  19. 2024Segment, Lift and Fit: Automatic 3D Shape Labeling from 2D Promptscited by 6
  20. 2022A Structure-Guided Diffusion Model for Large-Hole Image Completioncited by 1
  21. 2022ObjCAViT: Improving Monocular Depth Estimation Using Natural Language Models And Image-Object Cross-Attentioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 3.

9 papers.