OptiGeo: Efficient Monocular Geometry for Embodied Perception in Optically Challenging Scenes
Not on the map. Why?
Abstract (arXiv)
Monocular depth estimation has achieved strong open-domain generalization, yet reliable robotic deployment remains difficult in transparent, reflective, and specular environments, where depth sensors often produce missing or biased depth. Existing methods often handle such optical failures with scene-specific preprocessing, auxiliary modules, or post-hoc fine-tuning. While effective in constrained settings, these designs increase architectural redundancy and can over-specialize general geometry models to narrow optical scenarios. We revisit this problem as a localized failure mode within base-model training and identify sensor-induced supervision bias as a key bottleneck: models inherit sensor failure patterns from biased real-depth supervision in optically challenging regions. We then introduce OptiGeo, a bias-aware training framework that rehabilitates biased real supervision using a clean-geometry teacher and residual-trimmed alignment. We redefine transparency-targeted rendering as a compact source of clean optical geometry, rather than a large domain-specific fine-tuning set. With only a small targeted rendering set, OptiGeo learns the geometric structure of transparent objects and regions, correcting local geometry distortions that real sensors cannot reliably supervise. Despite only 30M parameters, OptiGeo outperforms substantially larger 300M-scale monocular models and billion-scale multi-view baselines on transparent-scene benchmarks, while remaining competitive on general zero-shot depth and boundary sharpness. Real-world navigation cases further validate its practicality as an efficient perception module in optically challenging scenes.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 58 of its 64 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
58 of 64 references.
References · 58
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Depth Anything V2cited by 1,422
- 2025DINOv3cited by 1,414
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
38 more
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 276
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 240
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
- 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 148
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 147
- 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 138
- 20193D Ken Burns Effect from a Single Imagecited by 128
- 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
- 2020HR-Depth: High Resolution Self-Supervised Monocular Depth Estimationcited by 115
- 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
- 2020The Marathon 2: A Navigation Systemcited by 70
- 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
- 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformerscited by 51
- 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objectscited by 50
- 2023All for One, and One for All: UrbanSyn Dataset, the third Musketeer of Synthetic Driving Scenescited by 41
- 2023Learning Depth Estimation for Transparent and Mirror Surfacescited by 34
- 2023On the Importance of Accurate Geometry Data for Dense 3D Vision Taskscited by 26
- 2024XTrack: Multimodal Training Boosts RGB-X Video Object Trackerscited by 21
- 2025MoRE: 3D Visual Geometry Reconstruction Meets Mixture-of-Expertscited by 21
- 2024Digging into contrastive learning for robust depth estimation with diffusion modelscited by 19
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.