M2Depth: Unifying Monocular Depth Foundation Priors with Multi-View Stereo
Not on the map. Why?
Abstract (arXiv)
Deep learning-based Multi-View Stereo (MVS) has advanced significantly but often generalizes poorly to unseen scenes, particularly in occluded areas or regions with limited view overlap. To mitigate this, recent approaches integrate Depth Foundation Models (DFMs) into MVS pipelines to provide monocular depth priors. However, existing methods typically rely on a static, one-way fusion scheme, which fails to fully exploit the complementary strengths of both modalities. We propose a novel framework that overcomes this limitation by tightly coupling a DFM with a cascade MVS pipeline through a bidirectional mutual refinement strategy. Our method leverages MVS depth to resolve the scale ambiguity in monocular predictions, while the monocular depth, in turn, enhances the structural completeness and fine-grained detail of the MVS estimate. Furthermore, we introduce a prior-guided cost volume refinement mechanism that effectively integrates multi-view and monocular information via attention-based fusion and discretized depth bins, thereby promoting local geometric consistency. Extensive experiments demonstrate that our method outperforms state-of-the-art MVS approaches on standard benchmarks, producing more complete and generalizable depth maps with sharp boundaries. Furthermore, although not explicitly designed for sparse-view settings, our framework generalizes remarkably well, competing favorably with even dedicated sparse-view methods while maintaining a superior accuracy-efficiency trade-off.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 45 references that are in the map. First posted on arXiv 21 Aug 2026.
Builds on
32 of 45 references.
References · 32
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2024Depth Anything V2cited by 1,422
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 417
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 210
20 more
- 2016Single-Image Depth Perception in the Wildcited by 180
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
- 2020Dense Hybrid Recurrent Multi-view Stereo Net with Dynamic Consistency Checkingcited by 81
- 2022VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstructioncited by 62
- 2021IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereocited by 56
- 2022MVSFormer: Multi-View Stereo by Learning Robust Image Features and Temperature-based Depthcited by 53
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 52
- 2024MVSFormer++: Revealing the Devil in Transformer's Details for Multi-View Stereocited by 50
- 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusioncited by 50
- 2022A Benchmark and a Baseline for Robust Multi-view Depth Estimationcited by 39
- 2025MVSAnywhere: Zero-Shot Multi-View Stereocited by 26
- 2024UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and UnFavOrable Setscited by 23
- 2022WT-MVSNet: Window-based Transformers for Multi-view Stereocited by 20
- 2025Multi-view Reconstruction via SfM-guided Monocular Depth Estimationcited by 20
- 2021Curvature-guided dynamic scale networks for Multi-view Stereocited by 17
- 2024GoMVS: Geometrically Consistent Cost Aggregation for Multi-View Stereocited by 16
- 2024All-in-One: Transferring Vision Foundation Models into Stereo Matchingcited by 16
- 2025SparseRecon: Neural Implicit Surface Reconstruction from Sparse Views with Feature and Depth Consistenciescited by 9
- 2025MonoMVSNet: Monocular Priors Guided Multi-View Stereo Networkcited by 3
- 2023Multi-View Stereo Representation Revisit: Region-Aware MVSNetcited by 2
Built on by
Not cited yet.