mlsanityData to 14 Oct 2026

EGSA-PT:Edge-Guided Spatial Attention with Progressive Training for Monocular Depth Estimation and Segmentation of Transparent Objects

arXiv 2511.14970 ↗First posted 18 Nov 2025cs.CV cs.AI cs.ROcited by 1

Not on the map. Why?

Abstract (arXiv)

Transparent object perception remains a major challenge in computer vision research, as transparency confounds both depth estimation and semantic segmentation. Recent work has explored multi-task learning frameworks to improve robustness, yet negative cross-task interactions often hinder performance. In this work, we introduce Edge-Guided Spatial Attention (EGSA), a fusion mechanism designed to mitigate destructive interactions by incorporating boundary information into the fusion between semantic and geometric features. On both Syn-TODD and ClearPose benchmarks, EGSA consistently improved depth accuracy over the current state of the art method (MODEST), while preserving competitive segmentation performance, with the largest improvements appearing in transparent regions. Besides our fusion design, our second contribution is a multi-modal progressive training strategy, where learning transitions from edges derived from RGB images to edges derived from predicted depth images. This approach allows the system to bootstrap learning from the rich textures contained in RGB images, and then switch to more relevant geometric content in depth maps, while it eliminates the need for ground-truth depth at training time. Together, these contributions highlight edge-guided fusion as a robust approach capable of improving transparent object perception.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 25 references that are in the map. First posted on arXiv 18 Nov 2025.

Builds on

22 of 25 references.

References · 22

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021Vision Transformers for Dense Predictioncited by 1,803
  3. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  4. 2024Depth Anything V2cited by 1,422
  5. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  6. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  7. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
  8. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
  9. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  10. 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
  11. 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
  12. 2020Segmenting Transparent Objects in the Wildcited by 98
10 more
  1. 2023Robust Monocular Depth Estimation under Challenging Conditionscited by 58
  2. 2022Open Challenges in Deep Stereo: the Booster Datasetcited by 48
  3. 2022ClearPose: Large-scale Transparent Object Dataset and Benchmarkcited by 46
  4. 2023Learning Depth Estimation for Transparent and Mirror Surfacescited by 34
  5. 2023Booster: a Benchmark for Depth from Images of Specular and Transparent Surfacescited by 33
  6. 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditionscited by 29
  7. 2023Robotic Perception of Transparent Objects: A Reviewcited by 28
  8. 2022A4T: Hierarchical Affordance Detection for Transparent Objects Depth Reconstruction and Manipulationcited by 23
  9. 2021SimNet: Enabling Robust Unknown Object Manipulation from Pure Synthetic Data via Stereocited by 18
  10. 2023MVTrans: Multi-View Perception of Transparent Objectscited by 14

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.