MonSter++: Unified Stereo Matching, Multi-view Stereo, and Real-time Stereo with Monodepth Priors
Not on the map. Why?
Abstract (arXiv)
We introduce MonSter++, a geometric foundation model for multi-view depth estimation, unifying rectified stereo matching and unrectified multi-view stereo. Both tasks fundamentally recover metric depth from correspondence search and consequently face the same dilemma: struggling to handle ill-posed regions with limited matching cues. To address this, we propose MonSter++, a novel method that integrates monocular depth priors into multi-view depth estimation, effectively combining the complementary strengths of single-view and multi-view cues. MonSter++ fuses monocular depth and multi-view depth into a dual-branched architecture. Confidence-based guidance adaptively selects reliable multi-view cues to correct scale ambiguity in monocular depth. The refined monocular predictions, in turn, effectively guide multi-view estimation in ill-posed regions. This iterative mutual enhancement enables MonSter++ to evolve coarse object-level monocular priors into fine-grained, pixel-level geometry, fully unlocking the potential of multi-view depth estimation. MonSter++ achieves new state-of-the-art on both stereo matching and multi-view stereo. By effectively incorporating monocular priors through our cascaded search and multi-scale depth fusion strategy, our real-time variant RT-MonSter++ also outperforms previous real-time methods by a large margin. As shown in Fig.1, MonSter++ achieves significant improvements over previous methods across eight benchmarks from three tasks -- stereo matching, real-time stereo matching, and multi-view stereo, demonstrating the strong generality of our framework. Besides high accuracy, MonSter++ also demonstrates superior zero-shot generalization capability. We will release both the large and the real-time models to facilitate their use by the open-source community.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 82 of its 118 references that are in the map. First posted on arXiv 15 Jan 2025.
Builds on
82 of 118 references.
References · 82
- 2017Attention Is All You Needcited by 59,932
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
38 more
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2018Pyramid Stereo Matching Networkcited by 486
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 252
- 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 242
- 2019Group-wise Correlation Stereo Networkcited by 235
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
- 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
- 2020Hierarchical Neural Architecture Search for Deep Stereo Matchingcited by 166
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
- 2019Point-Based Multi-View Stereo Networkcited by 147
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
- 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
- 20193D Ken Burns Effect from a Single Imagecited by 128
- 2019Hierarchical Deep Stereo Matching on High-resolution Imagescited by 126
- 2020HITNet: Hierarchical Iterative Tile Refinement Network for Real-time Stereo Matchingcited by 120
- 2021TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformerscited by 117
- 2019DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatchcited by 114
- 2020Fast-MVSNet: Sparse-to-Dense Multi-View Stereo With Learned Propagation and Gauss-Newton Refinementcited by 105
- 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 98
- 2018Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimationcited by 92
- 2018SegStereo: Exploiting Semantic Information for Disparity Estimationcited by 88
- 2020Dense Hybrid Recurrent Multi-view Stereo Net with Dynamic Consistency Checkingcited by 81
- 2018Structured Attention Guided Convolutional Neural Fields for Monocular Depth Estimationcited by 78
- 2014Computing the Stereo Matching Cost with a Convolutional Neural Networkcited by 74
- 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 73
- 2020PCW-Net: Pyramid Combination and Warping Cost Volume for Stereo Matchingcited by 62
50 most cited of 82 All 82 (JSON)
Built on by
Citing papers per year: 2025: 11; 2026: 8.
19 papers.
Sort:
By area:
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformerscited by 47
- 2025Diving into the Fusion of Monocular Priors for Generalized Stereo Matchingcited by 10
- 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Basescited by 10
- 2026TruckDrive: Long-Range Autonomous Highway Driving Datasetcited by 5
- 2025DEPTHOR: Depth Enhancement from a Practical Light-Weight dToF Sensor and RGB Imagecited by 3
- 2025NTIRE 2025 Challenge on HR Depth from Images of Specular and Transparent Surfacescited by 3
- 2025A Wavelet-based Stereo Matching Framework for Solving Frequency Convergence Inconsistencycited by 2
- 2026WAFT-Stereo: Warping-Alone Field Transforms for Stereo Matchingcited by 2
- 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimationcited by 0
- 2025The Role of Cyclopean-Eye in Stereo Visioncited by 0
- 2025Towards Understanding 3D Vision: the Role of Gaussian Curvaturecited by 0
7 more
- 2025MatchAttention: Embedding Explicit Matching Constraints into Attention for Efficient Stereo Matchingcited by 0
- 2026Pip-Stereo: Progressive Iterations Pruner for Iterative Optimization based Stereo Matchingcited by 0
- 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matchingcited by 0
- 2026GemDepth: Geometry-Embedded Features for 3D-Consistent Video Depthcited by 0
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matchingcited by 0
- 2026URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matchingcited by 0
- 2026SeasonStereo: Robust Dense Stereo Matching for Multi-Date Satellite Imagery via Generative AIcited by 0
- 2026SeasonStereo: Robust Dense Stereo Matching for Multi-Date Satellite Imagery via Generative AI29 Jul 2026
- 2026URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matching7 Jul 2026
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching23 Jun 2026
- 2026GemDepth: Geometry-Embedded Features for 3D-Consistent Video Depth11 May 2026
- 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matching10 Apr 2026
- 2026WAFT-Stereo: Warping-Alone Field Transforms for Stereo Matching25 Mar 2026
- 2026TruckDrive: Long-Range Autonomous Highway Driving Dataset2 Mar 2026
- 2026Pip-Stereo: Progressive Iterations Pruner for Iterative Optimization based Stereo Matching24 Feb 2026
- 2025MatchAttention: Embedding Explicit Matching Constraints into Attention for Efficient Stereo Matching16 Oct 2025
- 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformers8 Oct 2025
- 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Bases5 Sep 2025
- 2025Towards Understanding 3D Vision: the Role of Gaussian Curvature15 Aug 2025
7 more
- 2025The Role of Cyclopean-Eye in Stereo Vision26 Jun 2025
- 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimation21 Jun 2025
- 2025NTIRE 2025 Challenge on HR Depth from Images of Specular and Transparent Surfaces6 Jun 2025
- 2025A Wavelet-based Stereo Matching Framework for Solving Frequency Convergence Inconsistency23 May 2025
- 2025Diving into the Fusion of Monocular Priors for Generalized Stereo Matching20 May 2025
- 2025DEPTHOR: Depth Enhancement from a Practical Light-Weight dToF Sensor and RGB Image2 Apr 2025
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matching16 Jan 2025
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2025Diving into the Fusion of Monocular Priors for Generalized Stereo Matchingcited by 10
- 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Basescited by 10
- 2025DEPTHOR: Depth Enhancement from a Practical Light-Weight dToF Sensor and RGB Imagecited by 3
- 2025NTIRE 2025 Challenge on HR Depth from Images of Specular and Transparent Surfacescited by 3
- 2025A Wavelet-based Stereo Matching Framework for Solving Frequency Convergence Inconsistencycited by 2
- 2026WAFT-Stereo: Warping-Alone Field Transforms for Stereo Matchingcited by 2
- 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimationcited by 0
- 2025The Role of Cyclopean-Eye in Stereo Visioncited by 0
- 2025Towards Understanding 3D Vision: the Role of Gaussian Curvaturecited by 0
- 2025MatchAttention: Embedding Explicit Matching Constraints into Attention for Efficient Stereo Matchingcited by 0
- 2026Pip-Stereo: Progressive Iterations Pruner for Iterative Optimization based Stereo Matchingcited by 0
12 most cited of 17 All 17 (JSON)
- 2026SeasonStereo: Robust Dense Stereo Matching for Multi-Date Satellite Imagery via Generative AI29 Jul 2026
- 2026URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matching7 Jul 2026
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching23 Jun 2026
- 2026GemDepth: Geometry-Embedded Features for 3D-Consistent Video Depth11 May 2026
- 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matching10 Apr 2026
- 2026WAFT-Stereo: Warping-Alone Field Transforms for Stereo Matching25 Mar 2026
- 2026Pip-Stereo: Progressive Iterations Pruner for Iterative Optimization based Stereo Matching24 Feb 2026
- 2025MatchAttention: Embedding Explicit Matching Constraints into Attention for Efficient Stereo Matching16 Oct 2025
- 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Bases5 Sep 2025
- 2025Towards Understanding 3D Vision: the Role of Gaussian Curvature15 Aug 2025
- 2025The Role of Cyclopean-Eye in Stereo Vision26 Jun 2025
- 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimation21 Jun 2025
12 newest of 17 All 17 (JSON)