OpenStereo: A Comprehensive Benchmark for Stereo Matching and Strong Baseline
Not on the map. Why?
Abstract (arXiv)
Stereo matching aims to estimate the disparity between matching pixels in a stereo image pair, which is important to robotics, autonomous driving, and other computer vision tasks. Despite the development of numerous impressive methods in recent years, determining the most suitable architecture for practical application remains challenging. Addressing this gap, our paper introduces a comprehensive benchmark focusing on practical applicability rather than solely on individual models for optimized performance. Specifically, we develop a flexible and efficient stereo matching codebase, called OpenStereo. OpenStereo includes training and inference codes of more than 10 network models, making it, to our knowledge, the most complete stereo matching toolbox available. Based on OpenStereo, we conducted experiments and have achieved or surpassed the performance metrics reported in the original paper. Additionally, we conduct an exhaustive analysis and deconstruction of recent developments in stereo matching through comprehensive ablative experiments. These investigations inspired the creation of StereoBase, a strong baseline model. Our StereoBase ranks 1st on SceneFlow, KITTI 2015, 2012 (Reflective) among published methods and achieves the best performance across all metrics. In addition, StereoBase has strong cross-dataset generalization. Code is available at urlhttps://github.com/XiandaGuo/OpenStereo.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Builds on 56 of its 81 references that are in the map. First posted on arXiv 1 Dec 2023.
Builds on
56 of 81 references.
References · 56
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2018DARTS: Differentiable Architecture Searchcited by 1,798
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2017Random Erasing Data Augmentationcited by 1,239
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
38 more
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
- 2019Once-for-All: Train One Network and Specialize it for Efficient Deploymentcited by 787
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2018Pyramid Stereo Matching Networkcited by 489
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 417
- 2019AutoML: A Survey of the State-of-the-Artcited by 390
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
- 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 244
- 2019Group-wise Correlation Stereo Networkcited by 235
- 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 190
- 2020Hierarchical Neural Architecture Search for Deep Stereo Matchingcited by 166
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 166
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 154
- 2015Stereo Matching by Training a Convolutional Neural Network to Compare Image Patchescited by 151
- 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
- 2019Hierarchical Deep Stereo Matching on High-resolution Imagescited by 126
- 2023RepViT: Revisiting Mobile CNN From ViT Perspectivecited by 123
- 2021MPViT: Multi-Path Vision Transformer for Dense Predictioncited by 122
- 2021SMD-Nets: Stereo Mixture Density Networkscited by 120
- 2019DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatchcited by 114
- 2015Learning to Compare Image Patches via Convolutional Neural Networkscited by 109
- 2019Domain-invariant Stereo Matching Networkscited by 109
- 2018StereoNet: Guided Hierarchical Refinement for Real-Time Edge-Aware Depth Predictioncited by 88
- 2018SegStereo: Exploiting Semantic Information for Disparity Estimationcited by 88
- 2022OpenGait: Revisiting Gait Recognition Toward Better Practicalitycited by 85
- 2021MobileStereoNet: Towards Lightweight Deep Networks for Stereo Matchingcited by 82
- 2018Occlusions, Motion and Depth Boundaries with a Generic Network for Disparity, Optical Flow or Scene Flow Estimationcited by 69
- 2019Adaptive Unimodal Cost Volume Filtering for Deep Stereo Matchingcited by 55
- 2018Anytime Stereo Image Depth Estimation on Mobile Devicescited by 54
- 2021Correlate-and-Excite: Real-Time Stereo Matching via Guided Cost Volume Excitationcited by 47
- 2022Revisiting Domain Generalized Stereo Matching Networks from a Feature Consistency Perspectivecited by 46
- 2020Bi3D: Stereo Depth Estimation via Binary Classificationscited by 34
- 2021Local Similarity Pattern and Cost Self-Reassembling for Deep Stereo Matching Networkscited by 32
- 2020FADNet: A Fast and Accurate Network for Disparity Estimationcited by 31
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2024: 8; 2025: 13; 2026: 9.
30 papers.
Sort:
By area:
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 52
- 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformerscited by 51
- 2024SURDS: Benchmarking Spatial Understanding and Reasoning in Driving Scenarios with Vision Language Modelscited by 29
- 2024LightStereo: Channel Boost Is All You Need for Efficient 2D Cost Aggregationcited by 28
- 2024Playing to Vision Foundation Model's Strengths in Stereo Matchingcited by 23
- 2025BANet: Bilateral Aggregation Network for Mobile Stereo Matchingcited by 12
- 2024Instruct Large Language Models to Drive like Humanscited by 11
- 2024ClearDepth: Enhanced Stereo Perception of Transparent Objects for Robotic Manipulationcited by 9
- 2024Stereo Anything: Unifying Zero-shot Stereo Matching with Large-Scale Mixed Datacited by 5
- 2025Lite Any Stereo: Efficient Zero-Shot Stereo Matchingcited by 4
- 2024MaskFuser: Masked Fusion of Joint Multi-Modal Tokenization for End-to-End Autonomous Drivingcited by 3
- 2025StereoCarla: A High-Fidelity Driving Dataset for Generalizable Stereocited by 3
18 more
- 2025Boosting Zero-shot Stereo Matching using Large-scale Mixed Images Sources in the Real Worldcited by 2
- 2026Pixel-Perfect Visual Geometry Estimationcited by 2
- 2026Stereo-Inertial Poser: Towards Metric-Accurate Shape-Aware Motion Capture Using Sparse IMUs and a Single Stereo Cameracited by 2
- 2024VHS: High-Resolution Iterative Stereo Matching with Visual Hull Priorscited by 1
- 2025Iterative Volume Fusion for Asymmetric Stereo Matchingcited by 1
- 2025ROVR-Open-Dataset: A Large-Scale Depth Dataset for Autonomous Drivingcited by 1
- 2026WideDepth: Millimeter-Accurate Benchmark for Fisheye Depth Estimationcited by 1
- 2026Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AIcited by 1
- 2026AquaStereo: Enabling Underwater Stereo Matching via Depth-Conditioned Diffusion and Geometry Self-Distillationcited by 1
- 2025USAM-Net: A U-Net-based Network for Improved Stereo Correspondence and Scene Depth Estimation using Features from a Pre-trained Image Segmentation networkcited by 0
- 2025A Reinforcement Learning Method for Environments with Stochastic Variables: Post-Decision Proximal Policy Optimization with Dual Critic Networkscited by 0
- 2025DispBench: Benchmarking Disparity Estimation to Synthetic Corruptionscited by 0
- 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimationcited by 0
- 2025Preserving Guidance in Cost-Volume Retrieval under Extreme LiDAR Sparsity in Iterative Stereocited by 0
- 2026StereoFactory: A Unified Merging Framework for Robust Stereo Matchingcited by 0
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matchingcited by 0
- 2026TrustVLA: Mechanism-Guided Inference-Time Defense Against Vision-Language-Action Backdoorscited by 0
- 2026GeoStereo: A Unified Stereo Geometry Estimation Framework for Disparity and Surface Normalcited by 0
- 2026GeoStereo: A Unified Stereo Geometry Estimation Framework for Disparity and Surface Normal27 Jul 2026
- 2026TrustVLA: Mechanism-Guided Inference-Time Defense Against Vision-Language-Action Backdoors14 Jul 2026
- 2026AquaStereo: Enabling Underwater Stereo Matching via Depth-Conditioned Diffusion and Geometry Self-Distillation5 Jul 2026
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching23 Jun 2026
- 2026Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI22 Jun 2026
- 2026StereoFactory: A Unified Merging Framework for Robust Stereo Matching16 Jun 2026
- 2026WideDepth: Millimeter-Accurate Benchmark for Fisheye Depth Estimation22 May 2026
- 2026Stereo-Inertial Poser: Towards Metric-Accurate Shape-Aware Motion Capture Using Sparse IMUs and a Single Stereo Camera2 Mar 2026
- 2026Pixel-Perfect Visual Geometry Estimation8 Jan 2026
- 2025Lite Any Stereo: Efficient Zero-Shot Stereo Matching20 Nov 2025
- 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformers8 Oct 2025
- 2025StereoCarla: A High-Fidelity Driving Dataset for Generalizable Stereo16 Sep 2025
18 more
- 2025ROVR-Open-Dataset: A Large-Scale Depth Dataset for Autonomous Driving19 Aug 2025
- 2025Iterative Volume Fusion for Asymmetric Stereo Matching13 Aug 2025
- 2025Preserving Guidance in Cost-Volume Retrieval under Extreme LiDAR Sparsity in Iterative Stereo26 Jul 2025
- 2025Pixel-Optimization-Free Patch Attack on Stereo Depth Estimation21 Jun 2025
- 2025Boosting Zero-shot Stereo Matching using Large-scale Mixed Images Sources in the Real World13 May 2025
- 2025DispBench: Benchmarking Disparity Estimation to Synthetic Corruptions8 May 2025
- 2025A Reinforcement Learning Method for Environments with Stochastic Variables: Post-Decision Proximal Policy Optimization with Dual Critic Networks7 Apr 2025
- 2025USAM-Net: A U-Net-based Network for Improved Stereo Correspondence and Scene Depth Estimation using Features from a Pre-trained Image Segmentation network19 Mar 2025
- 2025BANet: Bilateral Aggregation Network for Mobile Stereo Matching5 Mar 2025
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matching16 Jan 2025
- 2024Stereo Anything: Unifying Zero-shot Stereo Matching with Large-Scale Mixed Data21 Nov 2024
- 2024SURDS: Benchmarking Spatial Understanding and Reasoning in Driving Scenarios with Vision Language Models20 Nov 2024
- 2024ClearDepth: Enhanced Stereo Perception of Transparent Objects for Robotic Manipulation13 Sep 2024
- 2024LightStereo: Channel Boost Is All You Need for Efficient 2D Cost Aggregation28 Jun 2024
- 2024Instruct Large Language Models to Drive like Humans11 Jun 2024
- 2024VHS: High-Resolution Iterative Stereo Matching with Visual Hull Priors4 Jun 2024
- 2024MaskFuser: Masked Fusion of Joint Multi-Modal Tokenization for End-to-End Autonomous Driving13 May 2024
- 2024Playing to Vision Foundation Model's Strengths in Stereo Matching9 Apr 2024
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 52
- 2024LightStereo: Channel Boost Is All You Need for Efficient 2D Cost Aggregationcited by 28
- 2024Playing to Vision Foundation Model's Strengths in Stereo Matchingcited by 23
- 2025BANet: Bilateral Aggregation Network for Mobile Stereo Matchingcited by 12
- 2024Instruct Large Language Models to Drive like Humanscited by 11
- 2024ClearDepth: Enhanced Stereo Perception of Transparent Objects for Robotic Manipulationcited by 9
- 2024Stereo Anything: Unifying Zero-shot Stereo Matching with Large-Scale Mixed Datacited by 5
- 2025Lite Any Stereo: Efficient Zero-Shot Stereo Matchingcited by 4
- 2025StereoCarla: A High-Fidelity Driving Dataset for Generalizable Stereocited by 3
- 2025Boosting Zero-shot Stereo Matching using Large-scale Mixed Images Sources in the Real Worldcited by 2
- 2026Pixel-Perfect Visual Geometry Estimationcited by 2
- 2026Stereo-Inertial Poser: Towards Metric-Accurate Shape-Aware Motion Capture Using Sparse IMUs and a Single Stereo Cameracited by 2
12 most cited of 25 All 25 (JSON)
- 2026GeoStereo: A Unified Stereo Geometry Estimation Framework for Disparity and Surface Normal27 Jul 2026
- 2026AquaStereo: Enabling Underwater Stereo Matching via Depth-Conditioned Diffusion and Geometry Self-Distillation5 Jul 2026
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching23 Jun 2026
- 2026Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI22 Jun 2026
- 2026StereoFactory: A Unified Merging Framework for Robust Stereo Matching16 Jun 2026
- 2026WideDepth: Millimeter-Accurate Benchmark for Fisheye Depth Estimation22 May 2026
- 2026Stereo-Inertial Poser: Towards Metric-Accurate Shape-Aware Motion Capture Using Sparse IMUs and a Single Stereo Camera2 Mar 2026
- 2026Pixel-Perfect Visual Geometry Estimation8 Jan 2026
- 2025Lite Any Stereo: Efficient Zero-Shot Stereo Matching20 Nov 2025
- 2025StereoCarla: A High-Fidelity Driving Dataset for Generalizable Stereo16 Sep 2025
- 2025ROVR-Open-Dataset: A Large-Scale Depth Dataset for Autonomous Driving19 Aug 2025
- 2025Iterative Volume Fusion for Asymmetric Stereo Matching13 Aug 2025
12 newest of 25 All 25 (JSON)