mlsanityData to 14 Oct 2026

Rethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Mask

arXiv 2508.02507 ↗First posted 4 Aug 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Due to the optical properties, transparent objects often lead depth cameras to generate incomplete or invalid depth data, which in turn reduces the accuracy and reliability of robotic grasping. Existing approaches typically input the RGB-D image directly into the network to output the complete depth, expecting the model to implicitly infer the reliability of depth values. However, while effective in training datasets, such methods often fail to generalize to real-world scenarios, where complex light interactions lead to highly variable distributions of valid and invalid depth data. To address this, we propose ReMake, a novel depth completion framework guided by an instance mask and monocular depth estimation. By explicitly distinguishing transparent regions from non-transparent ones, the mask enables the model to concentrate on learning accurate depth estimation in these areas from RGB-D input during training. This targeted supervision reduces reliance on implicit reasoning and improves generalization to real-world scenarios. Additionally, monocular depth estimation provides depth context between the transparent object and its surroundings, enhancing depth prediction accuracy. Extensive experiments show that our method outperforms existing approaches on both benchmark datasets and real-world scenarios, demonstrating superior accuracy and generalization capability. Code and videos are available at https://chengyaofeng.github.io/ReMake.github.io/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 49 references that are in the map. First posted on arXiv 4 Aug 2025.

Builds on

29 of 49 references.

References · 29

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2023Segment Anythingcited by 8,234
  5. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  6. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  7. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  8. 2024Depth Anything V2cited by 1,422
  9. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  10. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
  11. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
  12. 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 242
17 more
  1. 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
  2. 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
  3. 2013Deep Learning for Detecting Robotic Graspscited by 116
  4. 2018PointNetGPD: Detecting Grasp Configurations from Point Setscited by 80
  5. 2022GraspNeRF: Multiview-based 6-DoF Grasp Detection for Transparent and Specular Objects Using Generalizable NeRFcited by 67
  6. 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
  7. 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
  8. 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objectscited by 50
  9. 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 48
  10. 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
  11. 2022A4T: Hierarchical Affordance Detection for Transparent Objects Depth Reconstruction and Manipulationcited by 23
  12. 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillationcited by 21
  13. 2022TODE-Trans: Transparent Object Depth Estimation with Transformercited by 13
  14. 2023FDCT: Fast Depth Completion for Transparent Objectscited by 12
  15. 2019GlassLoc: Plenoptic Grasp Pose Detection in Transparent Cluttercited by 11
  16. 2024TDCNet: Transparent Objects Depth Completion with CNN-Transformer Dual-Branch Parallel Networkcited by 5
  17. 2025PCF-Grasp: Converting Point Completion to Geometry Feature to Enhance 6-DoF Graspcited by 1

Built on by

Not cited yet.