Large-FOV RGBD Imaging via Structured PSF Coding in a Bio-inspired Monocentric System
Not on the map. Why?
Abstract (arXiv)
High-fidelity large-field-of-view (LFOV) 3D sensing, essential for autonomous platforms, is hindered by the coupling of anisotropic off-axis aberrations and the ill-posed nature of monocular depth estimation. To address this fundamental physical bottleneck, we propose the Bio-inspired Monocentric Imaging (BMI) framework, a holistic co-design integrating a monocentric optical topology with a physics-aware reconstruction network. By pairing a concentric spherical lens with a hemispherical sensor, our system structurally eliminates coma, astigmatism, and field curvature. Instead of relying on external modulators or hardware redundancy, we exploit the intrinsic aberration as a deterministic, radially symmetric carrier for depth encoding. Theoretical analysis via the Cram'er-Rao Lower Bound confirms that this topology maintains superior depth sensitivity across the entire FOV. To decode these optical cues, our framework utilizes a dual-head network to jointly recover high-fidelity All-in-Focus images and dense metric depth maps from single-shot captures. The efficacy of this co-design is evaluated through physically-based simulations of field-dependent PSFs across the full optical FOV. On NYU Depth V2, our system achieves a superior balance of image fidelity (31.15dB PSNR) and depth precision (0.161m RMSE). It further maintains consistent reconstruction under spatially varying PSFs sampled across a 120deg optical FOV, mitigating the peripheral degradation observed in conventional wide-field designs. The source code is publicly available at https://github.com/ZongxiYu-ZJU/BMI.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 57 references that are in the map. First posted on arXiv 29 Oct 2025.
Builds on
27 of 57 references.
References · 27
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2024Depth Anything V2cited by 1,422
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2018Pyramid Stereo Matching Networkcited by 489
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2021Rethinking Coarse-to-Fine Approach in Single Image Deblurringcited by 326
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
- 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
15 more
- 2019Deep Optics for Monocular Depth Estimation and 3D Object Detectioncited by 65
- 2020Single Image Depth Estimation Trained via Depth from Defocus Cuescited by 45
- 2024ECoDepth: Effective Conditioning of Diffusion Models for Monocular Depth Estimationcited by 45
- 2020Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Opticscited by 39
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2021Deep Recurrent Neural Network with Multi-scale Bi-directional Propagation for Video Deblurringcited by 25
- 2023Robotic Vision for Human-Robot Interaction and Collaboration: A Survey and Systematic Reviewcited by 25
- 2018Deep Depth from Defocus: how can defocus blur improve 3D estimation using dense neural networks?cited by 16
- 2023Depth Estimation and Image Restoration by Deep Learning from Defocused Imagescited by 7
- 2024Exploring Quasi-Global Solutions to Compound Lens Based Computational Imaging Systemscited by 7
- 2022End-to-end Learning for Joint Depth and Image Reconstruction from Diffracted Rotationcited by 4
- 2024DAVIDE: Depth-Aware Video Deblurringcited by 3
- 2017Highly curved image sensors: a practical approach for improved optical performancecited by 2
- 2024Self-Supervised Spatially Variant PSF Estimation for Aberration-Aware Depth-from-Defocuscited by 2
- 2025Learned Off-aperture Encoding for Wide Field-of-view RGBD Imagingcited by 1
Built on by
Not cited yet.