AISPO: Enhancing Depth Reliability for Robotic Manipulation of Non-Lambertian Objects via Affine-Invariant Shape Prior
Not on the map. Why?
Abstract (arXiv)
Reliable depth perception is critical for robotic manipulation, especially for non-Lambertian objects such as transparent or highly specular surfaces, where raw depth measurements are often corrupted or missing. These failures frequently propagate to motion planning, resulting in invalid grasp poses and execution errors. We propose AISPO, a depth completion framework that improves depth reliability for manipulation in challenging sensing conditions. AISPO combines multi-scale RGB-D feature fusion with an affine-invariant shape prior to enforce geometric consistency and mitigate catastrophic depth failures. Unlike methods that focus primarily on average depth accuracy, our approach emphasizes physical plausibility and structural integrity of the predicted depth maps. Extensive benchmark evaluations demonstrate competitive performance and strong generalization to unseen objects and novel scenes. Real-world grasping experiments further show that enhanced depth reliability significantly improves manipulation success rates, particularly for transparent objects where many existing methods fail to produce physically usable depth estimates.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 47 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
35 of 47 references.
References · 35
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2024Depth Anything V2cited by 1,385
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 463
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
23 more
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 173
- 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
- 2021Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representationscited by 107
- 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 73
- 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
- 2022GraspNeRF: Multiview-based 6-DoF Grasp Detection for Transparent and Specular Objects Using Generalizable NeRFcited by 64
- 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
- 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objectscited by 49
- 2022ClearPose: Large-scale Transparent Object Dataset and Benchmarkcited by 46
- 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
- 2022Iterative Vision-and-Language Navigationcited by 34
- 2024ZeST: Zero-Shot Material Transfer from a Single Imagecited by 24
- 2021SimNet: Enabling Robust Unknown Object Manipulation from Pure Synthetic Data via Stereocited by 18
- 2023MVTrans: Multi-View Perception of Transparent Objectscited by 14
- 2022TODE-Trans: Transparent Object Depth Estimation with Transformercited by 13
- 2024D3RoMa: Disparity Diffusion-based Depth Sensing for Material-Agnostic Robotic Manipulationcited by 11
- 2025Monocular Depth Estimation and Segmentation for Transparent Object with Iterative Semantic and Geometric Fusioncited by 8
- 2024SAID-NeRF: Segmentation-AIDed NeRF for Depth Completion of Transparent Objectscited by 5
- 2024Residual-NeRF: Learning Residual NeRFs for Transparent Object Manipulationcited by 5
Built on by
Not cited yet.