Stereo Anything: Unifying Zero-shot Stereo Matching with Large-Scale Mixed Data
Not on the map. Why?
Abstract (arXiv)
Stereo matching serves as a cornerstone in 3D vision, aiming to establish pixel-wise correspondences between stereo image pairs for depth recovery. Despite remarkable progress driven by deep neural architectures, current models often exhibit severe performance degradation when deployed in unseen domains, primarily due to the limited diversity of training data. In this work, we introduce StereoAnything, a data-centric framework that substantially enhances the zero-shot generalization capability of existing stereo models. Rather than devising yet another specialized architecture, we scale stereo training to an unprecedented level by systematically unifying heterogeneous stereo sources: (1) curated labeled datasets covering diverse environments, and (2) large-scale synthetic stereo pairs generated from unlabeled monocular images. Our mixed-data strategy delivers consistent and robust learning signals across domains, effectively mitigating dataset bias. Extensive zero-shot evaluations on four public benchmarks demonstrate that Stereo Anything achieves state-of-the-art generalization. This work paves the way towards truly universal stereo matching, offering a scalable data paradigm applicable to any stereo image pair. We extensively evaluate the zero-shot capabilities of our model on four public datasets, showcasing its impressive ability to generalize to any stereo image pair. Code is available at https://github.com/XiandaGuo/OpenStereo.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 47 of its 71 references that are in the map. First posted on arXiv 21 Nov 2024.
Builds on
47 of 71 references.
References · 47
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2023Segment Anythingcited by 8,234
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2018Pyramid Stereo Matching Networkcited by 489
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
35 more
- 2020Virtual KITTI 2cited by 353
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 309
- 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 244
- 2019Group-wise Correlation Stereo Networkcited by 235
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 190
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
- 2020Hierarchical Neural Architecture Search for Deep Stereo Matchingcited by 166
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 166
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 154
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 148
- 2021SMD-Nets: Stereo Mixture Density Networkscited by 120
- 2019Domain-invariant Stereo Matching Networkscited by 109
- 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 99
- 2018Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimationcited by 92
- 2020A Survey on Deep Learning Techniques for Stereo-based Depth Estimationcited by 90
- 2023Detecting Everything in the Open World: Towards Universal Object Detectioncited by 62
- 2023RealFill: Reference-Driven Generation for Authentic Image Completioncited by 59
- 2021Correlate-and-Excite: Real-Time Stereo Matching via Guided Cost Volume Excitationcited by 47
- 2022Revisiting Domain Generalized Stereo Matching Networks from a Feature Consistency Perspectivecited by 46
- 2020Learning Stereo from Single Imagescited by 45
- 2022GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Featurecited by 43
- 2024Neural Markov Random Field for Stereo Matchingcited by 40
- 2020Matching-space Stereo Networks for Cross-domain Generalizationcited by 32
- 2023OpenStereo: A Comprehensive Benchmark for Stereo Matching and Strong Baselinecited by 30
- 2024LightStereo: Channel Boost Is All You Need for Efficient 2D Cost Aggregationcited by 28
- 2024Match-Stereo-Videos: Bidirectional Alignment for Consistent Dynamic Stereo Matchingcited by 24
- 2024A Survey on Deep Stereo Matching in the Twentiescited by 23
- 2022TemporalStereo: Efficient Spatial-Temporal Stereo Matching Networkcited by 12
- 2021FADNet++: Real-Time and Accurate Disparity Estimation with Configurable Networkscited by 11
- 2024Match Stereo Videos via Bidirectional Alignmentcited by 11
- 2024Temporally Consistent Stereo Matchingcited by 8
- 2023Adjacent-view Transformers for Supervised Surround-view Depth Estimationcited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026WAFT-Stereo: Warping-Alone Field Transforms for Stereo Matchingcited by 3
- 2026AquaStereo: Enabling Underwater Stereo Matching via Depth-Conditioned Diffusion and Geometry Self-Distillationcited by 1
- 2025The 3D Mirage: Probing and Taming 3D Hallucinationscited by 0
- 2026StereoFactory: A Unified Merging Framework for Robust Stereo Matchingcited by 0
- 2026GeoStereo: A Unified Stereo Geometry Estimation Framework for Disparity and Surface Normalcited by 0
- 2026GeoStereo: A Unified Stereo Geometry Estimation Framework for Disparity and Surface Normal27 Jul 2026
- 2026AquaStereo: Enabling Underwater Stereo Matching via Depth-Conditioned Diffusion and Geometry Self-Distillation5 Jul 2026
- 2026StereoFactory: A Unified Merging Framework for Robust Stereo Matching16 Jun 2026
- 2026WAFT-Stereo: Warping-Alone Field Transforms for Stereo Matching25 Mar 2026
- 2025The 3D Mirage: Probing and Taming 3D Hallucinations17 Dec 2025