mlsanityData to 7 Oct 2026

AISPO: Enhancing Depth Reliability for Robotic Manipulation of Non-Lambertian Objects via Affine-Invariant Shape Prior

arXiv 2606.25503 ↗First posted 24 Jun 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reliable depth perception is critical for robotic manipulation, especially for non-Lambertian objects such as transparent or highly specular surfaces, where raw depth measurements are often corrupted or missing. These failures frequently propagate to motion planning, resulting in invalid grasp poses and execution errors. We propose AISPO, a depth completion framework that improves depth reliability for manipulation in challenging sensing conditions. AISPO combines multi-scale RGB-D feature fusion with an affine-invariant shape prior to enforce geometric consistency and mitigate catastrophic depth failures. Unlike methods that focus primarily on average depth accuracy, our approach emphasizes physical plausibility and structural integrity of the predicted depth maps. Extensive benchmark evaluations demonstrate competitive performance and strong generalization to unseen objects and novel scenes. Real-world grasping experiments further show that enhanced depth reliability significantly improves manipulation success rates, particularly for transparent objects where many existing methods fail to produce physically usable depth estimates.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 47 references that are in the map. First posted on arXiv 24 Jun 2026.

Builds on

35 of 47 references.

References · 35

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  6. 2021Vision Transformers for Dense Predictioncited by 1,789
  7. 2024Depth Anything V2cited by 1,385
  8. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  9. 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 463
  10. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
  11. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  12. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
23 more
  1. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
  2. 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
  3. 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 173
  4. 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
  5. 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
  6. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  7. 2021Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representationscited by 107
  8. 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 73
  9. 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
  10. 2022GraspNeRF: Multiview-based 6-DoF Grasp Detection for Transparent and Specular Objects Using Generalizable NeRFcited by 64
  11. 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
  12. 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objectscited by 49
  13. 2022ClearPose: Large-scale Transparent Object Dataset and Benchmarkcited by 46
  14. 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
  15. 2022Iterative Vision-and-Language Navigationcited by 34
  16. 2024ZeST: Zero-Shot Material Transfer from a Single Imagecited by 24
  17. 2021SimNet: Enabling Robust Unknown Object Manipulation from Pure Synthetic Data via Stereocited by 18
  18. 2023MVTrans: Multi-View Perception of Transparent Objectscited by 14
  19. 2022TODE-Trans: Transparent Object Depth Estimation with Transformercited by 13
  20. 2024D3RoMa: Disparity Diffusion-based Depth Sensing for Material-Agnostic Robotic Manipulationcited by 11
  21. 2025Monocular Depth Estimation and Segmentation for Transparent Object with Iterative Semantic and Geometric Fusioncited by 8
  22. 2024SAID-NeRF: Segmentation-AIDed NeRF for Depth Completion of Transparent Objectscited by 5
  23. 2024Residual-NeRF: Learning Residual NeRFs for Transparent Object Manipulationcited by 5

Built on by

Not cited yet.