Pyramid Stereo Matching Network
Not on the map. Why?
Abstract (arXiv)
Recent work has shown that depth estimation from a stereo pair of images can be formulated as a supervised learning task to be resolved with convolutional neural networks (CNNs). However, current architectures rely on patch-based Siamese networks, lacking the means to exploit context information for finding correspondence in illposed regions. To tackle this problem, we propose PSMNet, a pyramid stereo matching network consisting of two main modules: spatial pyramid pooling and 3D CNN. The spatial pyramid pooling module takes advantage of the capacity of global context information by aggregating context in different scales and locations to form a cost volume. The 3D CNN learns to regularize cost volume using stacked multiple hourglass networks in conjunction with intermediate supervision. The proposed approach was evaluated on several benchmark datasets. Our method ranked first in the KITTI 2012 and 2015 leaderboards before March 18, 2018. The codes of PSMNet are available at: https://github.com/JiaRenChang/PSMNet.
Key facts. Cited by 486 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 106; 2022: 86; 2023: 70; 2024: 99; 2025: 78; 2026: 47.
486 papers.
Sort:
By area:
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 215
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 158
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
38 more
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
- 2021SMD-Nets: Stereo Mixture Density Networkscited by 118
- 20213D Object Detection for Autonomous Driving: A Surveycited by 106
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 106
- 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 98
- 2024Stereo4D: Learning How Things Move in 3D from Internet Stereo Videoscited by 89
- 2021Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentationcited by 88
- 2021Depth-conditioned Dynamic Message Propagation for Monocular 3D Object Detectioncited by 84
- 2021P2T: Pyramid Pooling Transformer for Scene Understandingcited by 84
- 2022SimpleRecon: 3D Reconstruction Without 3D Convolutionscited by 83
- 2021MobileStereoNet: Towards Lightweight Deep Networks for Stereo Matchingcited by 82
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2022SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimationcited by 76
- 2021LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detectorcited by 69
- 2022MonoDistill: Learning Spatial Features for Monocular 3D Object Detectioncited by 68
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
- 2024GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Viewscited by 65
- 2022Multi-Frame Self-Supervised Depth with Transformerscited by 64
- 2021Multi-Modal 3D Object Detection in Autonomous Driving: a Surveycited by 63
- 2021Unsupervised Depth Completion with Calibrated Backprojection Layerscited by 61
- 2022Accurate and Efficient Stereo Matching via Attention Concatenation Volumecited by 59
- 2021Learning Monocular Depth in Dynamic Scenes via Instance-Aware Projection Consistencycited by 58
- 2024IGEV++: Iterative Multi-range Geometry Encoding Volumes for Stereo Matchingcited by 55
- 2022STS: Surround-view Temporal Stereo for Multi-view 3D Detectioncited by 53
- 2021Progressive Coordinate Transforms for Monocular 3D Object Detectioncited by 52
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2022Open Challenges in Deep Stereo: the Booster Datasetcited by 48
- 2024MoCha-Stereo: Motif Channel Attention Network for Stereo Matchingcited by 48
- 2021Correlate-and-Excite: Real-Time Stereo Matching via Guided Cost Volume Excitationcited by 47
- 2022Ithaca365: Dataset and Driving Perception under Repeated and Challenging Weather Conditionscited by 47
- 2021Bilateral Grid Learning for Stereo Matching Networkscited by 46
- 2021Multi-View Depth Estimation by Fusing Single-View Depth Probability with Multi-View Geometrycited by 46
- 2022Revisiting Domain Generalized Stereo Matching Networks from a Feature Consistency Perspectivecited by 46
- 2023NeRF-Supervised Deep Stereocited by 46
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 45
- 2021VolumeFusion: Deep Depth Fusion for 3D Scene Reconstructioncited by 44
50 most cited of 486 All 486 (JSON)
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026EpiTransfer: Sparse, Training-Free Long-Range Depth Estimation from Temporal Monocular Aerial Frames27 Sep 2026
- 2026Disparity Has a Sign: Stereo Matching Beyond the Zero-Disparity Plane6 Sep 2026
- 2026EMCStereo: Attention-Enhanced Stereo Matching for Thin-Structure Depth Estimation with a Synthetic Tree-Branch Benchmark2 Sep 2026
- 2026What Does the Encoder Actually Decide? A Controlled Comparison of Vision Backbones on Joint Tree Segmentation and Stereo Depth2 Sep 2026
- 2026PhasorNet: Learning Structure from Frequency for Real-Time Stereo Matching30 Aug 2026
- 2026NBS: No Bias Stereo28 Aug 2026
- 2026StereoDiffuer: Diffusion-based Progressive Geometry Modeling with Saliency Attention Perception for Stereo Matching22 Aug 2026
- 2026Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction30 Jul 2026
- 2026WHTMix: Efficient Stereo Depth Estimation via Walsh-Hadamard Token Mixing28 Jul 2026
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching22 Jul 2026
- 2026Revisiting Matching Response and Swept Feature Volumes for Wide-baseline Omnidirectional Stereo13 Jul 2026
38 more
- 2026URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matching7 Jul 2026
- 2026LiteMatch: Lightweight Zero-Shot Stereo Matching via Cost Volume Stabilization30 Jun 2026
- 2026Independent Samples, Correlated Variance A Learnable Cross-View Cue in Path-Traced Stereo Data24 Jun 2026
- 2026LinStereo: Linear-Complexity Global Attention for Multi-Scale Iterative Stereo Matching24 Jun 2026
- 2026Spherical-to-ERP Epipolar Rectification for Single-Axis Disparity in 360 Stereo23 Jun 2026
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching23 Jun 2026
- 2026Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI22 Jun 2026
- 2026StereoFactory: A Unified Merging Framework for Robust Stereo Matching16 Jun 2026
- 2026Non-Learning Low-Light Stereo Vision29 May 2026
- 2026H-OmniStereo: Zero-Shot Omnidirectional Stereo Matching with Heading-Aligned Normal Priors14 May 2026
- 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perception11 May 2026
- 2026Cross-Modal RGB-D Fusion Transformer for 6D Pose Estimation of Non-Cooperative Spacecraft with Stereo-Derived Depth9 May 2026
- 2026Low-Cost Stereo Vision for Robust 3D Positioning of Thin Radiata Pine Branches in Autonomous Drone Pruning6 May 2026
- 2026DINO Soars: DINOv3 for Open-Vocabulary Semantic Segmentation of Remote Sensing Imagery4 May 2026
- 2026Unlocking the Power of Critical Factors for 3D Visual Geometry Estimation23 Apr 2026
- 2026MLG-Stereo: ViT Based Stereo Matching with Multi-Stage Local-Global Enhancement22 Apr 2026
- 2026Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric Stereo16 Apr 2026
- 2026Positioning radiata pine branches requiring pruning by drone stereo vision12 Apr 2026
- 2026SMFormer: Empowering Self-supervised Stereo Matching via Foundation Models and Data Augmentation11 Apr 2026
- 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matching10 Apr 2026
- 2026EventHub: Data Factory for Generalizable Event-Based Stereo Networks without Active Sensors2 Apr 2026
- 2026Deep S2P: Integrating Learning Based Stereo Matching Into the Satellite Stereo Pipeline23 Mar 2026
- 2026DriveTok: 3D Driving Scene Tokenization for Unified Multi-View Reconstruction and Understanding19 Mar 2026
- 2026Pixel-Accurate Epipolar Guided Matching19 Mar 2026
- 2026Reference-Free Omnidirectional Stereo Matching via Multi-View Consistency Maximization16 Mar 2026
- 2026UE5-Forest: A Photorealistic Synthetic Stereo Dataset for UAV Forestry Depth Estimation13 Mar 2026
- 2026PromptStereo: Zero-Shot Stereo Matching via Structure and Motion Prompts2 Mar 2026
- 2026Progressive Per-Branch Depth Optimization for DEFOM-Stereo and SAM3 Joint Analysis in UAV Forestry Applications24 Feb 2026
- 2026Training Deep Stereo Matching Networks on Tree Branch Imagery: A Benchmark Study for Real-Time UAV Forestry Applications23 Feb 2026
- 2026StereoAdapter-2: Globally Structure-Consistent Underwater Stereo Depth Estimation18 Feb 2026
- 2026Freq-DP Net: A Dual-Branch Network for Fence Removal using Dual-Pixel and Fourier Priors15 Feb 2026
- 2026Two-Stream Interactive Joint Learning of Scene Parsing and Geometric Vision Tasks14 Feb 2026
- 2026PuriLight: A Lightweight Shuffle and Purification Framework for Monocular Depth Estimation11 Feb 2026
- 2026Geometry without Position? When Positional Embeddings Help and Hurt Spatial Reasoning29 Jan 2026
- 2026Towards Gold-Standard Depth Estimation for Tree Branches in UAV Forestry: Benchmarking Deep Stereo Matching Methods27 Jan 2026
- 2025Enhancing 3D Semantic Scene Completion with a Refinement Module20 Dec 2025
- 2025G3Splat: Geometrically Consistent Generalizable Gaussian Splatting19 Dec 2025
- 2025StereoPilot: Learning Unified and Efficient Stereo Conversion via Generative Priors18 Dec 2025
50 newest of 486 All 486 (JSON)
- 2023DiffuVolume: Diffusion Model for Volume based Stereo Matchingcited by 16
- 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimationcited by 3
- 2025GeoDiff: Geometry-Guided Diffusion for Metric Depth Estimationcited by 0
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matchingcited by 0
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching22 Jul 2026
- 2025GeoDiff: Geometry-Guided Diffusion for Metric Depth Estimation21 Oct 2025
- 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimation18 Aug 2025
- 2023DiffuVolume: Diffusion Model for Volume based Stereo Matching30 Aug 2023
- 2024ViM-Disparity: Bridging the Gap of Speed, Accuracy and Memory for Disparity Map Generationcited by 2
- 2025DensePercept-NCSSD: Vision Mamba towards Real-time Dense Visual Perception with Non-Causal State Space Dualitycited by 1
- 2025Robust Real-Time Endoscopic Stereo Matching under Fuzzy Tissue Boundariescited by 0
- 2025StereoMamba: Real-time and Robust Intraoperative Stereo Disparity Estimation via Long-range Spatial Dependenciescited by 0
- 2025DensePercept-NCSSD: Vision Mamba towards Real-time Dense Visual Perception with Non-Causal State Space Duality16 Nov 2025
- 2025StereoMamba: Real-time and Robust Intraoperative Stereo Disparity Estimation via Long-range Spatial Dependencies24 Apr 2025
- 2025Robust Real-Time Endoscopic Stereo Matching under Fuzzy Tissue Boundaries2 Mar 2025
- 2024ViM-Disparity: Bridging the Gap of Speed, Accuracy and Memory for Disparity Map Generation21 Dec 2024
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 215
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 158
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
12 most cited of 473 All 473 (JSON)
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026EpiTransfer: Sparse, Training-Free Long-Range Depth Estimation from Temporal Monocular Aerial Frames27 Sep 2026
- 2026Disparity Has a Sign: Stereo Matching Beyond the Zero-Disparity Plane6 Sep 2026
- 2026EMCStereo: Attention-Enhanced Stereo Matching for Thin-Structure Depth Estimation with a Synthetic Tree-Branch Benchmark2 Sep 2026
- 2026What Does the Encoder Actually Decide? A Controlled Comparison of Vision Backbones on Joint Tree Segmentation and Stereo Depth2 Sep 2026
- 2026PhasorNet: Learning Structure from Frequency for Real-Time Stereo Matching30 Aug 2026
- 2026NBS: No Bias Stereo28 Aug 2026
- 2026StereoDiffuer: Diffusion-based Progressive Geometry Modeling with Saliency Attention Perception for Stereo Matching22 Aug 2026
- 2026Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction30 Jul 2026
- 2026WHTMix: Efficient Stereo Depth Estimation via Walsh-Hadamard Token Mixing28 Jul 2026
- 2026Revisiting Matching Response and Swept Feature Volumes for Wide-baseline Omnidirectional Stereo13 Jul 2026
- 2026URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matching7 Jul 2026
12 newest of 473 All 473 (JSON)