mlsanityData to 14 Oct 2026

Stereo Anything: Unifying Zero-shot Stereo Matching with Large-Scale Mixed Data

arXiv 2411.14053 ↗First posted 21 Nov 2024cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Stereo matching serves as a cornerstone in 3D vision, aiming to establish pixel-wise correspondences between stereo image pairs for depth recovery. Despite remarkable progress driven by deep neural architectures, current models often exhibit severe performance degradation when deployed in unseen domains, primarily due to the limited diversity of training data. In this work, we introduce StereoAnything, a data-centric framework that substantially enhances the zero-shot generalization capability of existing stereo models. Rather than devising yet another specialized architecture, we scale stereo training to an unprecedented level by systematically unifying heterogeneous stereo sources: (1) curated labeled datasets covering diverse environments, and (2) large-scale synthetic stereo pairs generated from unlabeled monocular images. Our mixed-data strategy delivers consistent and robust learning signals across domains, effectively mitigating dataset bias. Extensive zero-shot evaluations on four public benchmarks demonstrate that Stereo Anything achieves state-of-the-art generalization. This work paves the way towards truly universal stereo matching, offering a scalable data paradigm applicable to any stereo image pair. We extensively evaluate the zero-shot capabilities of our model on four public datasets, showcasing its impressive ability to generalize to any stereo image pair. Code is available at https://github.com/XiandaGuo/OpenStereo.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 47 of its 71 references that are in the map. First posted on arXiv 21 Nov 2024.

Builds on

47 of 71 references.

References · 47

  1. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  3. 2023Segment Anythingcited by 8,234
  4. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  5. 2024Depth Anything V2cited by 1,422
  6. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  7. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  8. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  9. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
  10. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  11. 2018Pyramid Stereo Matching Networkcited by 489
  12. 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
35 more
  1. 2020Virtual KITTI 2cited by 353
  2. 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
  3. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
  4. 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 309
  5. 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 244
  6. 2019Group-wise Correlation Stereo Networkcited by 235
  7. 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
  8. 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 190
  9. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
  10. 2020Hierarchical Neural Architecture Search for Deep Stereo Matchingcited by 166
  11. 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 166
  12. 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 154
  13. 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 148
  14. 2021SMD-Nets: Stereo Mixture Density Networkscited by 120
  15. 2019Domain-invariant Stereo Matching Networkscited by 109
  16. 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 99
  17. 2018Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimationcited by 92
  18. 2020A Survey on Deep Learning Techniques for Stereo-based Depth Estimationcited by 90
  19. 2023Detecting Everything in the Open World: Towards Universal Object Detectioncited by 62
  20. 2023RealFill: Reference-Driven Generation for Authentic Image Completioncited by 59
  21. 2021Correlate-and-Excite: Real-Time Stereo Matching via Guided Cost Volume Excitationcited by 47
  22. 2022Revisiting Domain Generalized Stereo Matching Networks from a Feature Consistency Perspectivecited by 46
  23. 2020Learning Stereo from Single Imagescited by 45
  24. 2022GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Featurecited by 43
  25. 2024Neural Markov Random Field for Stereo Matchingcited by 40
  26. 2020Matching-space Stereo Networks for Cross-domain Generalizationcited by 32
  27. 2023OpenStereo: A Comprehensive Benchmark for Stereo Matching and Strong Baselinecited by 30
  28. 2024LightStereo: Channel Boost Is All You Need for Efficient 2D Cost Aggregationcited by 28
  29. 2024Match-Stereo-Videos: Bidirectional Alignment for Consistent Dynamic Stereo Matchingcited by 24
  30. 2024A Survey on Deep Stereo Matching in the Twentiescited by 23
  31. 2022TemporalStereo: Efficient Spatial-Temporal Stereo Matching Networkcited by 12
  32. 2021FADNet++: Real-Time and Accurate Disparity Estimation with Configurable Networkscited by 11
  33. 2024Match Stereo Videos via Bidirectional Alignmentcited by 11
  34. 2024Temporally Consistent Stereo Matchingcited by 8
  35. 2023Adjacent-view Transformers for Supervised Surround-view Depth Estimationcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.