Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Fail
Not on the map. Why?
Abstract (arXiv)
We introduce Stereo Anywhere, a novel stereo-matching framework that combines geometric constraints with robust priors from monocular depth Vision Foundation Models (VFMs). By elegantly coupling these complementary worlds through a dual-branch architecture, we seamlessly integrate stereo matching with learned contextual cues. Following this design, our framework introduces novel cost volume fusion mechanisms that effectively handle critical challenges such as textureless regions, occlusions, and non-Lambertian surfaces. Through our novel optical illusion dataset, MonoTrap, and extensive evaluation across multiple benchmarks, we demonstrate that our synthetic-only trained model achieves state-of-the-art results in zero-shot generalization, significantly outperforming existing solutions while showing remarkable robustness to challenging cases such as mirrors and transparencies.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 108 of its 143 references that are in the map. First posted on arXiv 5 Dec 2024.
Builds on
108 of 143 references.
References · 108
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2018Pyramid Stereo Matching Networkcited by 486
38 more
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
- 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 242
- 2019Group-wise Correlation Stereo Networkcited by 235
- 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
- 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
- 2016Single-Image Depth Perception in the Wildcited by 179
- 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
- 2015Stereo Matching by Training a Convolutional Neural Network to Compare Image Patchescited by 151
- 2018DF-Net: Unsupervised Joint Learning of Depth and Flow using Cross-Task Consistencycited by 148
- 2020Self-Supervised Monocular Depth Estimation: Solving the Dynamic Object Problem by Semantic Guidancecited by 148
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
- 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
- 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
- 2019Self-Supervised Monocular Depth Hintscited by 127
- 2019Hierarchical Deep Stereo Matching on High-resolution Imagescited by 126
- 2021SMD-Nets: Stereo Mixture Density Networkscited by 118
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
- 2019Domain-invariant Stereo Matching Networkscited by 108
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 100
- 2024Learning Temporally Consistent Video Depth from Video Diffusion Priorscited by 100
50 most cited of 108 All 108 (JSON)
Built on by
Citing papers per year: 2025: 28; 2026: 17.
45 papers.
Sort:
By area:
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2025MVSAnywhere: Zero-Shot Multi-View Stereocited by 26
- 2025Fast-FoundationStereo: Real-Time Zero-Shot Stereo Matchingcited by 23
- 2025MonSter++: Unified Stereo Matching, Multi-view Stereo, and Real-time Stereo with Monodepth Priorscited by 19
- 2025BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignmentcited by 15
- 2025GeoSVR: Taming Sparse Voxels for Geometrically Accurate Surface Reconstructioncited by 15
- 2025BANet: Bilateral Aggregation Network for Mobile Stereo Matchingcited by 12
- 2025Diving into the Fusion of Monocular Priors for Generalized Stereo Matchingcited by 10
- 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Basescited by 10
- 2025StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenescited by 8
- 2025Stereo Any Video: Temporally Consistent Stereo Matchingcited by 7
33 more
- 2025What Makes Good Synthetic Training Data for Zero-Shot Stereo Matching?cited by 7
- 2026PromptStereo: Zero-Shot Stereo Matching via Structure and Motion Promptscited by 5
- 2025URNet: Uncertainty-aware Refinement Network for Event-based Stereo Depth Estimationcited by 4
- 2025NTIRE 2025 Challenge on HR Depth from Images of Specular and Transparent Surfacescited by 3
- 2025Lite Any Stereo: Efficient Zero-Shot Stereo Matchingcited by 3
- 2025DepthFocus: Controllable Depth Estimation for See-Through Scenescited by 3
- 2025PanMatch: Unleashing the Potential of Large Vision Models for Unified Matching Modelscited by 2
- 2025Towards Depth Foundation Model: Recent Trends in Vision-Based Depth Estimationcited by 2
- 2025Aerial Multi-View Stereo via Adaptive Depth Range Inference and Normal Cuescited by 1
- 2025CogStereo: Neural Stereo Matching with Implicit Spatial Cognition Embeddingcited by 1
- 2025MAFNet:Multi-frequency Adaptive Fusion Network for Real-time Stereo Matchingcited by 1
- 2026Ego-1K -- A Large-Scale Multiview Video Dataset for Egocentric Visioncited by 1
- 2026Deep S2P: Integrating Learning Based Stereo Matching Into the Satellite Stereo Pipelinecited by 1
- 2026StereoVGGT: A Training-Free Visual Geometry Transformer for Stereo Visioncited by 1
- 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perceptioncited by 1
- 2025Stextsuperscript2Mtextsuperscript2: Scalable Stereo Matching Model for Reliable Depth Estimationcited by 0
- 2025Integrating Disparity Confidence Estimation into Relative Depth Prior-Guided Unsupervised Stereo Matchingcited by 0
- 2025MatchAttention: Embedding Explicit Matching Constraints into Attention for Efficient Stereo Matchingcited by 0
- 2025PPMStereo: Pick-and-Play Memory Construction for Consistent Dynamic Stereo Matchingcited by 0
- 2025Generalized Geometry Encoding Volume for Real-time Stereo Matchingcited by 0
- 2025The 3D Mirage: Probing and Taming 3D Hallucinationscited by 0
- 2026StereoAdapter-2: Globally Structure-Consistent Underwater Stereo Depth Estimationcited by 0
- 2026Real-Time Branch-to-Tool Distance Estimation for Autonomous UAV Pruning: Benchmarking Five DEFOM-Stereo Variants from Simulation to Jetson Deploymentcited by 0
- 2026EventHub: Data Factory for Generalizable Event-Based Stereo Networks without Active Sensorscited by 0
- 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matchingcited by 0
- 2026Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric Stereocited by 0
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matchingcited by 0
- 2026LinStereo: Linear-Complexity Global Attention for Multi-Scale Iterative Stereo Matchingcited by 0
- 2026LiteMatch: Lightweight Zero-Shot Stereo Matching via Cost Volume Stabilizationcited by 0
- 2026Revisiting Matching Response and Swept Feature Volumes for Wide-baseline Omnidirectional Stereocited by 0
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matchingcited by 0
- 2026SeasonStereo: Robust Dense Stereo Matching for Multi-Date Satellite Imagery via Generative AIcited by 0
- 2026NBS: No Bias Stereocited by 0
- 2026NBS: No Bias Stereo28 Aug 2026
- 2026SeasonStereo: Robust Dense Stereo Matching for Multi-Date Satellite Imagery via Generative AI29 Jul 2026
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching22 Jul 2026
- 2026Revisiting Matching Response and Swept Feature Volumes for Wide-baseline Omnidirectional Stereo13 Jul 2026
- 2026LiteMatch: Lightweight Zero-Shot Stereo Matching via Cost Volume Stabilization30 Jun 2026
- 2026LinStereo: Linear-Complexity Global Attention for Multi-Scale Iterative Stereo Matching24 Jun 2026
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching23 Jun 2026
- 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perception11 May 2026
- 2026Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric Stereo16 Apr 2026
- 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matching10 Apr 2026
- 2026EventHub: Data Factory for Generalizable Event-Based Stereo Networks without Active Sensors2 Apr 2026
- 2026StereoVGGT: A Training-Free Visual Geometry Transformer for Stereo Vision31 Mar 2026
33 more
- 2026Real-Time Branch-to-Tool Distance Estimation for Autonomous UAV Pruning: Benchmarking Five DEFOM-Stereo Variants from Simulation to Jetson Deployment27 Mar 2026
- 2026Deep S2P: Integrating Learning Based Stereo Matching Into the Satellite Stereo Pipeline23 Mar 2026
- 2026Ego-1K -- A Large-Scale Multiview Video Dataset for Egocentric Vision14 Mar 2026
- 2026PromptStereo: Zero-Shot Stereo Matching via Structure and Motion Prompts2 Mar 2026
- 2026StereoAdapter-2: Globally Structure-Consistent Underwater Stereo Depth Estimation18 Feb 2026
- 2025The 3D Mirage: Probing and Taming 3D Hallucinations17 Dec 2025
- 2025Fast-FoundationStereo: Real-Time Zero-Shot Stereo Matching11 Dec 2025
- 2025Generalized Geometry Encoding Volume for Real-time Stereo Matching7 Dec 2025
- 2025MAFNet:Multi-frequency Adaptive Fusion Network for Real-time Stereo Matching4 Dec 2025
- 2025DepthFocus: Controllable Depth Estimation for See-Through Scenes21 Nov 2025
- 2025Lite Any Stereo: Efficient Zero-Shot Stereo Matching20 Nov 2025
- 2025CogStereo: Neural Stereo Matching with Implicit Spatial Cognition Embedding25 Oct 2025
- 2025PPMStereo: Pick-and-Play Memory Construction for Consistent Dynamic Stereo Matching23 Oct 2025
- 2025MatchAttention: Embedding Explicit Matching Constraints into Attention for Efficient Stereo Matching16 Oct 2025
- 2025GeoSVR: Taming Sparse Voxels for Geometrically Accurate Surface Reconstruction22 Sep 2025
- 2025StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenes19 Sep 2025
- 2025URNet: Uncertainty-aware Refinement Network for Event-based Stereo Depth Estimation18 Sep 2025
- 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Bases5 Sep 2025
- 2025BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignment6 Aug 2025
- 2025Integrating Disparity Confidence Estimation into Relative Depth Prior-Guided Unsupervised Stereo Matching2 Aug 2025
- 2025Stextsuperscript2Mtextsuperscript2: Scalable Stereo Matching Model for Reliable Depth Estimation17 Jul 2025
- 2025Towards Depth Foundation Model: Recent Trends in Vision-Based Depth Estimation15 Jul 2025
- 2025PanMatch: Unleashing the Potential of Large Vision Models for Unified Matching Models11 Jul 2025
- 2025NTIRE 2025 Challenge on HR Depth from Images of Specular and Transparent Surfaces6 Jun 2025
- 2025Aerial Multi-View Stereo via Adaptive Depth Range Inference and Normal Cues6 Jun 2025
- 2025Diving into the Fusion of Monocular Priors for Generalized Stereo Matching20 May 2025
- 2025What Makes Good Synthetic Training Data for Zero-Shot Stereo Matching?23 Apr 2025
- 2025MVSAnywhere: Zero-Shot Multi-View Stereo28 Mar 2025
- 2025Stereo Any Video: Temporally Consistent Stereo Matching7 Mar 2025
- 2025BANet: Bilateral Aggregation Network for Mobile Stereo Matching5 Mar 2025
- 2025FoundationStereo: Zero-Shot Stereo Matching17 Jan 2025
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matching16 Jan 2025
- 2025MonSter++: Unified Stereo Matching, Multi-view Stereo, and Real-time Stereo with Monodepth Priors15 Jan 2025
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2025MVSAnywhere: Zero-Shot Multi-View Stereocited by 26
- 2025Fast-FoundationStereo: Real-Time Zero-Shot Stereo Matchingcited by 23
- 2025MonSter++: Unified Stereo Matching, Multi-view Stereo, and Real-time Stereo with Monodepth Priorscited by 19
- 2025BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignmentcited by 15
- 2025GeoSVR: Taming Sparse Voxels for Geometrically Accurate Surface Reconstructioncited by 15
- 2025BANet: Bilateral Aggregation Network for Mobile Stereo Matchingcited by 12
- 2025Diving into the Fusion of Monocular Priors for Generalized Stereo Matchingcited by 10
- 2025FlowSeek: Optical Flow Made Easier with Depth Foundation Models and Motion Basescited by 10
- 2025StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenescited by 8
- 2025Stereo Any Video: Temporally Consistent Stereo Matchingcited by 7
12 most cited of 43 All 43 (JSON)
- 2026NBS: No Bias Stereo28 Aug 2026
- 2026SeasonStereo: Robust Dense Stereo Matching for Multi-Date Satellite Imagery via Generative AI29 Jul 2026
- 2026Revisiting Matching Response and Swept Feature Volumes for Wide-baseline Omnidirectional Stereo13 Jul 2026
- 2026LiteMatch: Lightweight Zero-Shot Stereo Matching via Cost Volume Stabilization30 Jun 2026
- 2026LinStereo: Linear-Complexity Global Attention for Multi-Scale Iterative Stereo Matching24 Jun 2026
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching23 Jun 2026
- 2026Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric Stereo16 Apr 2026
- 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matching10 Apr 2026
- 2026EventHub: Data Factory for Generalizable Event-Based Stereo Networks without Active Sensors2 Apr 2026
- 2026StereoVGGT: A Training-Free Visual Geometry Transformer for Stereo Vision31 Mar 2026
- 2026Real-Time Branch-to-Tool Distance Estimation for Autonomous UAV Pruning: Benchmarking Five DEFOM-Stereo Variants from Simulation to Jetson Deployment27 Mar 2026
- 2026Deep S2P: Integrating Learning Based Stereo Matching Into the Satellite Stereo Pipeline23 Mar 2026
12 newest of 43 All 43 (JSON)