GHOST: Geometry-Guided Hallucination of Opaque Surface Textures
Not on the map. Why?
Abstract (arXiv)
Transparent objects pose a fundamental challenge for depth estimation and 3D reconstruction due to their violation of Lambertian assumptions, leading to severe geometry degradation in downstream tasks. To address this, we propose a novel geometry-guided preprocessing framework GHOST that leverages visual foundation models to transform transparent regions into opaque, structurally consistent representations without requiring downstream model retraining. Specifically, our pipeline utilizes (1) TransDINO and (2) TransDecomp to disentangle masks and transparency physical properties, while (3) DAF-Net recovers surface normal priors to encode geometric curvature. Subsequently, (4) GeoSemTransNet integrates these multi-modal cues to synthesize a texture-rich opaque RGB image that preserves the transparent object's 3D structure. Extensive experiments demonstrate that our method significantly enhances the accuracy of state-of-the-art depth estimation and reconstruction models on transparent objects by restoring essential photometric cues.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 37 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
28 of 37 references.
References · 28
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,070
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
- 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
16 more
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 2018Deep Depth Completion of a Single RGB-D Imagecited by 110
- 2023Foundational Models Defining a New Era in Vision: A Survey and Outlookcited by 110
- 2020Segmenting Transparent Objects in the Wildcited by 98
- 2023CompletionFormer: Depth Completion with Convolutions and Vision Transformerscited by 93
- 2022GraspNeRF: Multiview-based 6-DoF Grasp Detection for Transparent and Specular Objects Using Generalizable NeRFcited by 67
- 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
- 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objectscited by 50
- 2021Enhanced Boundary Learning for Glass-like Object Segmentationcited by 48
- 2022ClearPose: Large-scale Transparent Object Dataset and Benchmarkcited by 46
- 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
- 2021Trans4Trans: Efficient Transformer for Transparent Object and Semantic Scene Segmentation in Real-World Navigation Assistancecited by 22
- 2025Diffusion Knows Transparency: Repurposing Video Diffusion for Transparent Object Depth and Normal Estimationcited by 10
- 2025Monocular Depth Estimation and Segmentation for Transparent Object with Iterative Semantic and Geometric Fusioncited by 8
- 2025HDCNet: A Hybrid Depth Completion Network for Grasping Transparent and Reflective Objectscited by 1
- 2025EGSA-PT:Edge-Guided Spatial Attention with Progressive Training for Monocular Depth Estimation and Segmentation of Transparent Objectscited by 1
Built on by
Not cited yet.