mlsanityData to 7 Oct 2026

Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Fail

arXiv 2412.04472 ↗First posted 5 Dec 2024cs.CVcited by 45

Not on the map. Why?

Abstract (arXiv)

We introduce Stereo Anywhere, a novel stereo-matching framework that combines geometric constraints with robust priors from monocular depth Vision Foundation Models (VFMs). By elegantly coupling these complementary worlds through a dual-branch architecture, we seamlessly integrate stereo matching with learned contextual cues. Following this design, our framework introduces novel cost volume fusion mechanisms that effectively handle critical challenges such as textureless regions, occlusions, and non-Lambertian surfaces. Through our novel optical illusion dataset, MonoTrap, and extensive evaluation across multiple benchmarks, we demonstrate that our synthetic-only trained model achieves state-of-the-art results in zero-shot generalization, significantly outperforming existing solutions while showing remarkable robustness to challenging cases such as mirrors and transparencies.

Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 108 of its 143 references that are in the map. First posted on arXiv 5 Dec 2024.

Builds on

108 of 143 references.

References · 108

  1. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  2. 2021Vision Transformers for Dense Predictioncited by 1,789
  3. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  4. 2024Depth Anything V2cited by 1,385
  5. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  6. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  7. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
  8. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  9. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
  10. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  11. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
  12. 2018Pyramid Stereo Matching Networkcited by 486
38 more
  1. 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
  2. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
  3. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  4. 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
  5. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
  6. 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
  7. 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
  8. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  9. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
  10. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
  11. 2022Unifying Flow, Stereo and Depth Estimationcited by 270
  12. 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 242
  13. 2019Group-wise Correlation Stereo Networkcited by 235
  14. 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
  15. 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
  16. 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
  17. 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
  18. 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
  19. 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
  20. 2016Single-Image Depth Perception in the Wildcited by 179
  21. 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
  22. 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
  23. 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
  24. 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
  25. 2015Stereo Matching by Training a Convolutional Neural Network to Compare Image Patchescited by 151
  26. 2018DF-Net: Unsupervised Joint Learning of Depth and Flow using Cross-Task Consistencycited by 148
  27. 2020Self-Supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidancecited by 148
  28. 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
  29. 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
  30. 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
  31. 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
  32. 2019Self-Supervised Monocular Depth Hintscited by 127
  33. 2019Hierarchical Deep Stereo Matching on High-resolution Imagescited by 126
  34. 2021SMD-Nets: Stereo Mixture Density Networkscited by 118
  35. 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
  36. 2019Domain-invariant Stereo Matching Networkscited by 108
  37. 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 100
  38. 2024Learning Temporally Consistent Video Depth from Video Diffusion Priorscited by 100

50 most cited of 108 All 108 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 28; 2026: 17.

45 papers.

Sort:

By area:

  1. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
  2. 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
  3. 2025MVSAnywhere: Zero-Shot Multi-View Stereocited by 26
  4. 2025Fast-FoundationStereo: Real-Time Zero-Shot Stereo Matchingcited by 23
  5. 2025MonSter++: Unified Stereo Matching, Multi-view Stereo, and Real-time Stereo with Monodepth Priorscited by 19
  6. 2025BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignmentcited by 15
  7. 2025GeoSVR: Taming Sparse Voxels for Geometrically Accurate Surface Reconstructioncited by 15
  8. 2025BANet: Bilateral Aggregation Network for Mobile Stereo Matchingcited by 12
  9. 2025Diving into the Fusion of Monocular Priors for Generalized Stereo Matchingcited by 10
  10. 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Basescited by 10
  11. 2025StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenescited by 8
  12. 2025Stereo Any Video: Temporally Consistent Stereo Matchingcited by 7
33 more
  1. 2025What Makes Good Synthetic Training Data for Zero-Shot Stereo Matching?cited by 7
  2. 2026PromptStereo: Zero-Shot Stereo Matching via Structure and Motion Promptscited by 5
  3. 2025URNet: Uncertainty-aware Refinement Network for Event-based Stereo Depth Estimationcited by 4
  4. 2025NTIRE 2025 Challenge on HR Depth from Images of Specular and Transparent Surfacescited by 3
  5. 2025Lite Any Stereo: Efficient Zero-Shot Stereo Matchingcited by 3
  6. 2025DepthFocus: Controllable Depth Estimation for See-Through Scenescited by 3
  7. 2025PanMatch: Unleashing the Potential of Large Vision Models for Unified Matching Modelscited by 2
  8. 2025Towards Depth Foundation Model: Recent Trends in Vision-Based Depth Estimationcited by 2
  9. 2025Aerial Multi-View Stereo via Adaptive Depth Range Inference and Normal Cuescited by 1
  10. 2025CogStereo: Neural Stereo Matching with Implicit Spatial Cognition Embeddingcited by 1
  11. 2025MAFNet:Multi-frequency Adaptive Fusion Network for Real-time Stereo Matchingcited by 1
  12. 2026Ego-1K -- A Large-Scale Multiview Video Dataset for Egocentric Visioncited by 1
  13. 2026Deep S2P: Integrating Learning Based Stereo Matching Into the Satellite Stereo Pipelinecited by 1
  14. 2026StereoVGGT: A Training-Free Visual Geometry Transformer for Stereo Visioncited by 1
  15. 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perceptioncited by 1
  16. 2025Stextsuperscript2Mtextsuperscript2: Scalable Stereo Matching Model for Reliable Depth Estimationcited by 0
  17. 2025Integrating Disparity Confidence Estimation into Relative Depth Prior-Guided Unsupervised Stereo Matchingcited by 0
  18. 2025MatchAttention: Embedding Explicit Matching Constraints into Attention for Efficient Stereo Matchingcited by 0
  19. 2025PPMStereo: Pick-and-Play Memory Construction for Consistent Dynamic Stereo Matchingcited by 0
  20. 2025Generalized Geometry Encoding Volume for Real-time Stereo Matchingcited by 0
  21. 2025The 3D Mirage: Probing and Taming 3D Hallucinationscited by 0
  22. 2026StereoAdapter-2: Globally Structure-Consistent Underwater Stereo Depth Estimationcited by 0
  23. 2026Real-Time Branch-to-Tool Distance Estimation for Autonomous UAV Pruning: Benchmarking Five DEFOM-Stereo Variants from Simulation to Jetson Deploymentcited by 0
  24. 2026EventHub: Data Factory for Generalizable Event-Based Stereo Networks without Active Sensorscited by 0
  25. 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matchingcited by 0
  26. 2026Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric Stereocited by 0
  27. 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matchingcited by 0
  28. 2026LinStereo: Linear-Complexity Global Attention for Multi-Scale Iterative Stereo Matchingcited by 0
  29. 2026LiteMatch: Lightweight Zero-Shot Stereo Matching via Cost Volume Stabilizationcited by 0
  30. 2026Revisiting Matching Response and Swept Feature Volumes for Wide-baseline Omnidirectional Stereocited by 0
  31. 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matchingcited by 0
  32. 2026SeasonStereo: Robust Dense Stereo Matching for Multi-Date Satellite Imagery via Generative AIcited by 0
  33. 2026NBS: No Bias Stereocited by 0