PhysDepth: Plug-and-Play Physical Refinement for Monocular Depth Estimation in Challenging Environments
Not on the map. Why?
Abstract (arXiv)
State-of-the-art monocular depth estimation (MDE) models often struggle in challenging environments, primarily because they overlook robust physical information. To demonstrate this, we first conduct an empirical study by computing the covariance between a model's prediction error and atmospheric attenuation. We find that the error of existing SOTAs increases with atmospheric attenuation. Based on this finding, we propose PhysDepth, a plug-and-play framework that solves this fragility by infusing physical priors into modern SOTA backbones. PhysDepth incorporates two key components: a Physical Prior Module (PPM) that leverages Rayleigh Scattering theory to extract robust features from the high-SNR red channel, and a physics-derived Red Channel Attenuation Loss (RCA) that enforces model to learn the Beer-Lambert law. Extensive evaluations demonstrate that PhysDepth achieves SOTA accuracy in challenging conditions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 59 references that are in the map. First posted on arXiv 5 Dec 2024.
Builds on
39 of 59 references.
References · 39
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Layer Normalizationcited by 5,669
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022A ConvNet for the 2020scited by 3,579
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 457
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
27 more
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 249
- 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 201
- 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
- 2022DepthFormer: Exploiting Long-Range Correlation and Local Information for Accurate Monocular Depth Estimationcited by 118
- 2021Learning Indoor Inverse Rendering with 3D Spatially-Varying Lightingcited by 83
- 2019Does computer vision matter for action?cited by 64
- 2021Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimationcited by 63
- 2022Physically-Based Editing of Indoor Scene Lighting from a Single Imagecited by 62
- 2020DeFeat-Net: General Monocular Depth via Simultaneous Unsupervised Representation Learningcited by 60
- 2021Regularizing Nighttime Weirdness: Efficient Self-supervised Monocular Depth Estimation in the Darkcited by 58
- 2023Robust Monocular Depth Estimation under Challenging Conditionscited by 58
- 2021Towards Real-Time Monocular Depth Estimation for Robotics: A Surveycited by 57
- 2021Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimationcited by 48
- 2022Disentangling Object Motion and Occlusion for Unsupervised Multi-frame Monocular Depthcited by 48
- 2021Self-supervised Monocular Depth Estimation for All Day Images using Domain Separationcited by 44
- 2023STEPS: Joint Self-supervised Nighttime Image Enhancement and Depth Estimationcited by 37
- 2021R4Dyn: Exploring Radar for Self-Supervised Monocular Depth Estimation of Dynamic Scenescited by 36
- 2020Unsupervised Monocular Depth Estimation for Night-time Images using Adversarial Domain Feature Adaptationcited by 35
- 2023Self-supervised Monocular Depth Estimation: Let's Talk About The Weathercited by 34
- 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planescited by 32
- 2021Unsupervised Monocular Depth Estimation in Highly Complex Environmentscited by 28
- 2022When the Sun Goes Down: Repairing Photometric Losses for All-Day Depth Estimationcited by 24
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Surveycited by 15
- 2023From-Ground-To-Objects: Coarse-to-Fine Self-supervised Monocular Depth Estimation of Dynamic Objects with Ground Contact Priorcited by 13
- 2021DIFFnet: Diffusion parameter mapping network generalized for input diffusion gradient schemes and bvaluescited by 12
- 2024You Only Look Around: Learning Illumination Invariant Feature for Low-light Object Detectioncited by 9
- 2024Dusk Till Dawn: Self-supervised Nighttime Stereo Depth Estimation using Visual Foundation Modelscited by 6
Built on by
Not cited yet.