Learning the Distribution of Errors in Stereo Matching for Joint Disparity and Uncertainty Estimation
Not on the map. Why?
Abstract (arXiv)
We present a new loss function for joint disparity and uncertainty estimation in deep stereo matching. Our work is motivated by the need for precise uncertainty estimates and the observation that multi-task learning often leads to improved performance in all tasks. We show that this can be achieved by requiring the distribution of uncertainty to match the distribution of disparity errors via a KL divergence term in the network's loss function. A differentiable soft-histogramming technique is used to approximate the distributions so that they can be used in the loss. We experimentally assess the effectiveness of our approach and observe significant improvements in both disparity and uncertainty prediction on large datasets.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 16 of its 39 references that are in the map. First posted on arXiv 31 Mar 2023.
Builds on
16 of 39 references.
References · 16
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2018Pyramid Stereo Matching Networkcited by 486
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
- 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 340
- 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 242
- 2019Group-wise Correlation Stereo Networkcited by 235
- 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
4 more
- 2018Uncertainty Estimates and Multi-Hypotheses Networks for Optical Flowcited by 135
- 2018SegStereo: Exploiting Semantic Information for Disparity Estimationcited by 88
- 2021On the confidence of stereo matching in a deep-learning era: a quantitative evaluationcited by 23
- 2016Improved Stereo Matching with Constant Highway Networks and Reflective Confidence Learningcited by 18
Built on by
Citing papers per year: 2023: 2; 2024: 10; 2025: 7; 2026: 4.
23 papers.
Sort:
By area:
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 45
- 2023MMST-ViT: Climate Change-aware Crop Yield Prediction via Multi-Modal Spatial-Temporal Vision Transformercited by 29
- 2024NARUTO: Neural Active Reconstruction from Uncertain Target Observationscited by 27
- 2024A Survey on Deep Stereo Matching in the Twentiescited by 23
- 2025ActiveGAMER: Active GAussian Mapping through Efficient Renderingcited by 19
- 2025StereoVLA: Enhancing Vision-Language-Action Models with Stereo Visioncited by 16
- 2023DifFlow3D: Toward Robust Uncertainty-Aware Scene Flow Estimation with Diffusion Modelcited by 11
- 2024Learning Intra-view and Cross-view Geometric Knowledge for Stereo Matchingcited by 11
- 2025Unleashing the Temporal Potential of Stereo Event Cameras for Continuous-Time 3D Object Detectioncited by 3
- 2024Visual SLAM with 3D Gaussian Primitives and Depth Priors Enabling Novel View Synthesiscited by 2
- 2024Unsupervised Stereo Matching Network For VHR Remote Sensing Images Based On Error Predictioncited by 1
11 more
- 2024Probabilistic Modeling of Disparity Uncertainty for Robust and Efficient Stereo Matchingcited by 1
- 2024Robust Confidence Intervals in Stereo Matching using Possibility Theorycited by 0
- 2024Rectified Iterative Disparity for Stereo Matchingcited by 0
- 2024Superpixel Cost Volume Excitation for Stereo Matchingcited by 0
- 2025CMD: Constraining Multimodal Distribution for Domain Adaptation in Stereo Matchingcited by 0
- 2025Uncertainty Quantification Framework for Aerial and UAV Photogrammetry through Error Propagationcited by 0
- 2025Integrating Disparity Confidence Estimation into Relative Depth Prior-Guided Unsupervised Stereo Matchingcited by 0
- 2026Two-Stream Interactive Joint Learning of Scene Parsing and Geometric Vision Taskscited by 0
- 2026StereoAdapter-2: Globally Structure-Consistent Underwater Stereo Depth Estimationcited by 0
- 2026Revisiting Matching Response and Swept Feature Volumes for Wide-baseline Omnidirectional Stereocited by 0
- 2026A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Modelscited by 0
- 2026A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Models30 Aug 2026
- 2026Revisiting Matching Response and Swept Feature Volumes for Wide-baseline Omnidirectional Stereo13 Jul 2026
- 2026StereoAdapter-2: Globally Structure-Consistent Underwater Stereo Depth Estimation18 Feb 2026
- 2026Two-Stream Interactive Joint Learning of Scene Parsing and Geometric Vision Tasks14 Feb 2026
- 2025StereoVLA: Enhancing Vision-Language-Action Models with Stereo Vision26 Dec 2025
- 2025Unleashing the Temporal Potential of Stereo Event Cameras for Continuous-Time 3D Object Detection4 Aug 2025
- 2025Integrating Disparity Confidence Estimation into Relative Depth Prior-Guided Unsupervised Stereo Matching2 Aug 2025
- 2025Uncertainty Quantification Framework for Aerial and UAV Photogrammetry through Error Propagation17 Jul 2025
- 2025CMD: Constraining Multimodal Distribution for Domain Adaptation in Stereo Matching30 Apr 2025
- 2025FoundationStereo: Zero-Shot Stereo Matching17 Jan 2025
- 2025ActiveGAMER: Active GAussian Mapping through Efficient Rendering12 Jan 2025
- 2024Probabilistic Modeling of Disparity Uncertainty for Robust and Efficient Stereo Matching24 Dec 2024
11 more
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Fail5 Dec 2024
- 2024Superpixel Cost Volume Excitation for Stereo Matching20 Nov 2024
- 2024Unsupervised Stereo Matching Network For VHR Remote Sensing Images Based On Error Prediction14 Aug 2024
- 2024Visual SLAM with 3D Gaussian Primitives and Depth Priors Enabling Novel View Synthesis10 Aug 2024
- 2024A Survey on Deep Stereo Matching in the Twenties10 Jul 2024
- 2024Rectified Iterative Disparity for Stereo Matching16 Jun 2024
- 2024Robust Confidence Intervals in Stereo Matching using Possibility Theory9 Apr 2024
- 2024Learning Intra-view and Cross-view Geometric Knowledge for Stereo Matching29 Feb 2024
- 2024NARUTO: Neural Active Reconstruction from Uncertain Target Observations29 Feb 2024
- 2023DifFlow3D: Toward Robust Uncertainty-Aware Scene Flow Estimation with Diffusion Model29 Nov 2023
- 2023MMST-ViT: Climate Change-aware Crop Yield Prediction via Multi-Modal Spatial-Temporal Vision Transformer16 Sep 2023
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 45
- 2023MMST-ViT: Climate Change-aware Crop Yield Prediction via Multi-Modal Spatial-Temporal Vision Transformercited by 29
- 2024NARUTO: Neural Active Reconstruction from Uncertain Target Observationscited by 27
- 2024A Survey on Deep Stereo Matching in the Twentiescited by 23
- 2025ActiveGAMER: Active GAussian Mapping through Efficient Renderingcited by 19
- 2024Learning Intra-view and Cross-view Geometric Knowledge for Stereo Matchingcited by 11
- 2025Unleashing the Temporal Potential of Stereo Event Cameras for Continuous-Time 3D Object Detectioncited by 3
- 2024Visual SLAM with 3D Gaussian Primitives and Depth Priors Enabling Novel View Synthesiscited by 2
- 2024Unsupervised Stereo Matching Network For VHR Remote Sensing Images Based On Error Predictioncited by 1
- 2024Probabilistic Modeling of Disparity Uncertainty for Robust and Efficient Stereo Matchingcited by 1
- 2024Robust Confidence Intervals in Stereo Matching using Possibility Theorycited by 0
12 most cited of 21 All 21 (JSON)
- 2026A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Models30 Aug 2026
- 2026Revisiting Matching Response and Swept Feature Volumes for Wide-baseline Omnidirectional Stereo13 Jul 2026
- 2026StereoAdapter-2: Globally Structure-Consistent Underwater Stereo Depth Estimation18 Feb 2026
- 2026Two-Stream Interactive Joint Learning of Scene Parsing and Geometric Vision Tasks14 Feb 2026
- 2025Unleashing the Temporal Potential of Stereo Event Cameras for Continuous-Time 3D Object Detection4 Aug 2025
- 2025Integrating Disparity Confidence Estimation into Relative Depth Prior-Guided Unsupervised Stereo Matching2 Aug 2025
- 2025Uncertainty Quantification Framework for Aerial and UAV Photogrammetry through Error Propagation17 Jul 2025
- 2025CMD: Constraining Multimodal Distribution for Domain Adaptation in Stereo Matching30 Apr 2025
- 2025FoundationStereo: Zero-Shot Stereo Matching17 Jan 2025
- 2025ActiveGAMER: Active GAussian Mapping through Efficient Rendering12 Jan 2025
- 2024Probabilistic Modeling of Disparity Uncertainty for Robust and Efficient Stereo Matching24 Dec 2024
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Fail5 Dec 2024
12 newest of 21 All 21 (JSON)