mlsanityData to 7 Oct 2026

MonSter++: Unified Stereo Matching, Multi-view Stereo, and Real-time Stereo with Monodepth Priors

arXiv 2501.08643 ↗First posted 15 Jan 2025cs.CVcited by 19

Not on the map. Why?

Abstract (arXiv)

We introduce MonSter++, a geometric foundation model for multi-view depth estimation, unifying rectified stereo matching and unrectified multi-view stereo. Both tasks fundamentally recover metric depth from correspondence search and consequently face the same dilemma: struggling to handle ill-posed regions with limited matching cues. To address this, we propose MonSter++, a novel method that integrates monocular depth priors into multi-view depth estimation, effectively combining the complementary strengths of single-view and multi-view cues. MonSter++ fuses monocular depth and multi-view depth into a dual-branched architecture. Confidence-based guidance adaptively selects reliable multi-view cues to correct scale ambiguity in monocular depth. The refined monocular predictions, in turn, effectively guide multi-view estimation in ill-posed regions. This iterative mutual enhancement enables MonSter++ to evolve coarse object-level monocular priors into fine-grained, pixel-level geometry, fully unlocking the potential of multi-view depth estimation. MonSter++ achieves new state-of-the-art on both stereo matching and multi-view stereo. By effectively incorporating monocular priors through our cascaded search and multi-scale depth fusion strategy, our real-time variant RT-MonSter++ also outperforms previous real-time methods by a large margin. As shown in Fig.1, MonSter++ achieves significant improvements over previous methods across eight benchmarks from three tasks -- stereo matching, real-time stereo matching, and multi-view stereo, demonstrating the strong generality of our framework. Besides high accuracy, MonSter++ also demonstrates superior zero-shot generalization capability. We will release both the large and the real-time models to facilitate their use by the open-source community.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 82 of its 118 references that are in the map. First posted on arXiv 15 Jan 2025.

Builds on

82 of 118 references.

References · 82

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  4. 2021Vision Transformers for Dense Predictioncited by 1,789
  5. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  6. 2024Depth Anything V2cited by 1,385
  7. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  8. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  9. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
  10. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  11. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
  12. 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
38 more
  1. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
  2. 2018Pyramid Stereo Matching Networkcited by 486
  3. 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
  4. 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
  5. 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
  6. 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
  7. 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
  8. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  9. 2022Unifying Flow, Stereo and Depth Estimationcited by 270
  10. 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 252
  11. 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 242
  12. 2019Group-wise Correlation Stereo Networkcited by 235
  13. 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
  14. 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
  15. 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
  16. 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
  17. 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
  18. 2020Hierarchical Neural Architecture Search for Deep Stereo Matchingcited by 166
  19. 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
  20. 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
  21. 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
  22. 2019Point-Based Multi-View Stereo Networkcited by 147
  23. 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
  24. 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
  25. 20193D Ken Burns Effect from a Single Imagecited by 128
  26. 2019Hierarchical Deep Stereo Matching on High-resolution Imagescited by 126
  27. 2020HITNet: Hierarchical Iterative Tile Refinement Network for Real-time Stereo Matchingcited by 120
  28. 2021TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformerscited by 117
  29. 2019DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatchcited by 114
  30. 2020Fast-MVSNet: Sparse-to-Dense Multi-View Stereo With Learned Propagation and Gauss-Newton Refinementcited by 105
  31. 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 98
  32. 2018Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimationcited by 92
  33. 2018SegStereo: Exploiting Semantic Information for Disparity Estimationcited by 88
  34. 2020Dense Hybrid Recurrent Multi-view Stereo Net with Dynamic Consistency Checkingcited by 81
  35. 2018Structured Attention Guided Convolutional Neural Fields for Monocular Depth Estimationcited by 78
  36. 2014Computing the Stereo Matching Cost with a Convolutional Neural Networkcited by 74
  37. 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 73
  38. 2020PCW-Net: Pyramid Combination and Warping Cost Volume for Stereo Matchingcited by 62

50 most cited of 82 All 82 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 11; 2026: 8.

19 papers.

Sort:

By area:

  1. 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
  2. 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformerscited by 47
  3. 2025Diving into the Fusion of Monocular Priors for Generalized Stereo Matchingcited by 10
  4. 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Basescited by 10
  5. 2026TruckDrive: Long-Range Autonomous Highway Driving Datasetcited by 5
  6. 2025DEPTHOR: Depth Enhancement from a Practical Light-Weight dToF Sensor and RGB Imagecited by 3
  7. 2025NTIRE 2025 Challenge on HR Depth from Images of Specular and Transparent Surfacescited by 3
  8. 2025A Wavelet-based Stereo Matching Framework for Solving Frequency Convergence Inconsistencycited by 2
  9. 2026WAFT-Stereo: Warping-Alone Field Transforms for Stereo Matchingcited by 2
  10. 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimationcited by 0
  11. 2025The Role of Cyclopean-Eye in Stereo Visioncited by 0
  12. 2025Towards Understanding 3D Vision: the Role of Gaussian Curvaturecited by 0
7 more
  1. 2025MatchAttention: Embedding Explicit Matching Constraints into Attention for Efficient Stereo Matchingcited by 0
  2. 2026Pip-Stereo: Progressive Iterations Pruner for Iterative Optimization based Stereo Matchingcited by 0
  3. 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matchingcited by 0
  4. 2026GemDepth: Geometry-Embedded Features for 3D-Consistent Video Depthcited by 0
  5. 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matchingcited by 0
  6. 2026URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matchingcited by 0
  7. 2026SeasonStereo: Robust Dense Stereo Matching for Multi-Date Satellite Imagery via Generative AIcited by 0