mlsanityData to 14 Oct 2026

GHOST: Geometry-Guided Hallucination of Opaque Surface Textures

arXiv 2607.11118 ↗First posted 13 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Transparent objects pose a fundamental challenge for depth estimation and 3D reconstruction due to their violation of Lambertian assumptions, leading to severe geometry degradation in downstream tasks. To address this, we propose a novel geometry-guided preprocessing framework GHOST that leverages visual foundation models to transform transparent regions into opaque, structurally consistent representations without requiring downstream model retraining. Specifically, our pipeline utilizes (1) TransDINO and (2) TransDecomp to disentangle masks and transparency physical properties, while (3) DAF-Net recovers surface normal priors to encode geometric curvature. Subsequently, (4) GeoSemTransNet integrates these multi-modal cues to synthesize a texture-rich opaque RGB image that preserves the transparent object's 3D structure. Extensive experiments demonstrate that our method significantly enhances the accuracy of state-of-the-art depth estimation and reconstruction models on transparent objects by restoring essential photometric cues.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 37 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

28 of 37 references.

References · 28

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  6. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  7. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
  8. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,070
  9. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  10. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  11. 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
  12. 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
16 more
  1. 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
  2. 2018Deep Depth Completion of a Single RGB-D Imagecited by 110
  3. 2023Foundational Models Defining a New Era in Vision: A Survey and Outlookcited by 110
  4. 2020Segmenting Transparent Objects in the Wildcited by 98
  5. 2023CompletionFormer: Depth Completion with Convolutions and Vision Transformerscited by 93
  6. 2022GraspNeRF: Multiview-based 6-DoF Grasp Detection for Transparent and Specular Objects Using Generalizable NeRFcited by 67
  7. 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
  8. 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objectscited by 50
  9. 2021Enhanced Boundary Learning for Glass-like Object Segmentationcited by 48
  10. 2022ClearPose: Large-scale Transparent Object Dataset and Benchmarkcited by 46
  11. 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
  12. 2021Trans4Trans: Efficient Transformer for Transparent Object and Semantic Scene Segmentation in Real-World Navigation Assistancecited by 22
  13. 2025Diffusion Knows Transparency: Repurposing Video Diffusion for Transparent Object Depth and Normal Estimationcited by 10
  14. 2025Monocular Depth Estimation and Segmentation for Transparent Object with Iterative Semantic and Geometric Fusioncited by 8
  15. 2025HDCNet: A Hybrid Depth Completion Network for Grasping Transparent and Reflective Objectscited by 1
  16. 2025EGSA-PT:Edge-Guided Spatial Attention with Progressive Training for Monocular Depth Estimation and Segmentation of Transparent Objectscited by 1

Built on by

Not cited yet.