M3Depth: Wavelet-Enhanced Depth Estimation on Mars via Mutual Boosting of Dual-Modal Data
Not on the map. Why?
Abstract (arXiv)
Depth estimation plays a great potential role in obstacle avoidance and navigation for further Mars exploration missions. Compared to traditional stereo matching, learning-based stereo depth estimation provides a data-driven approach to infer dense and precise depth maps from stereo image pairs. However, these methods always suffer performance degradation in environments with sparse textures and lacking geometric constraints, such as the unstructured terrain of Mars. To address these challenges, we propose M3Depth, a depth estimation model tailored for Mars rovers. Considering the sparse and smooth texture of Martian terrain, which is primarily composed of low-frequency features, our model incorporates a convolutional kernel based on wavelet transform that effectively captures low-frequency response and expands the receptive field. Additionally, we introduce a consistency loss that explicitly models the complementary relationship between depth map and surface normal map, utilizing the surface normal as a geometric constraint to enhance the accuracy of depth estimation. Besides, a pixel-wise refinement module with mutual boosting mechanism is designed to iteratively refine both depth and surface normal predictions. Experimental results on synthetic Mars datasets with depth annotations show that M3Depth achieves a 16% improvement in depth estimation accuracy compared to other state-of-the-art methods in depth estimation. Furthermore, the model demonstrates strong applicability in real-world Martian scenarios, offering a promising solution for future Mars exploration missions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 79 references that are in the map. First posted on arXiv 20 May 2025.
Builds on
31 of 79 references.
References · 31
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
- 2022Unifying Flow, Stereo and Depth Estimationcited by 275
- 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 244
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 234
- 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 154
- 2015Stereo Matching by Training a Convolutional Neural Network to Compare Image Patchescited by 151
- 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
19 more
- 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 124
- 2020HITNet: Hierarchical Iterative Tile Refinement Network for Real-time Stereo Matchingcited by 120
- 2019DPSNet: End-to-end Deep Plane Sweep Stereocited by 115
- 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 99
- 2020A Survey on Deep Learning Techniques for Stereo-based Depth Estimationcited by 90
- 2022Rethinking Depth Estimation for Multi-View Stereo: A Unified Representationcited by 82
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
- 2024Wavelet Convolutions for Large Receptive Fieldscited by 74
- 2019Normal Assisted Stereo Depth Estimationcited by 49
- 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimationcited by 45
- 2022IronDepth: Iterative Refinement of Single-View Depth using Surface Normal and its Uncertaintycited by 30
- 2019Deep Surface Normal Estimation with Hierarchical RGB-D Fusioncited by 20
- 2024Can Biases in ImageNet Models Explain Generalization?cited by 20
- 2016Improved Stereo Matching with Constant Highway Networks and Reflective Confidence Learningcited by 18
- 2021H-Net: Unsupervised Attention-based Stereo Depth Estimation Leveraging Epipolar Geometrycited by 12
- 2023SwinDepth: Unsupervised Depth Estimation using Monocular Sequences via Swin Transformer and Densely Cascaded Networkcited by 10
- 2022S5Mars: Semi-Supervised Learning for Mars Semantic Segmentationcited by 6
- 2022Self-Supervised Learning to Guide Scientifically Relevant Categorization of Martian Terrain Imagescited by 5
- 2019Perception-aware Autonomous Mast Motion Planning for Planetary Exploration Roverscited by 3
Built on by
Not cited yet.