RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matching
Not on the map. Why?
Abstract (arXiv)
We introduce RAFT-Stereo, a new deep architecture for rectified stereo based on the optical flow network RAFT. We introduce multi-level convolutional GRUs, which more efficiently propagate information across the image. A modified version of RAFT-Stereo can perform accurate real-time inference. RAFT-stereo ranks first on the Middlebury leaderboard, outperforming the next best method on 1px error by 29% and outperforms all published work on the ETH3D two-view stereo benchmark. Code is available at https://github.com/princeton-vl/RAFT-Stereo.
Key facts. Cited by 348 papers in the map (data through 7 Oct 2026). Builds on 29 of its 49 references that are in the map. First posted on arXiv 15 Sep 2021.
Builds on
29 of 49 references.
References · 29
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2018Pyramid Stereo Matching Networkcited by 486
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
- 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 242
- 2019Group-wise Correlation Stereo Networkcited by 235
- 2017Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Ratescited by 196
17 more
- 2020Hierarchical Neural Architecture Search for Deep Stereo Matchingcited by 166
- 2018Learning Depth with Convolutional Spatial Propagation Networkcited by 135
- 2019Hierarchical Deep Stereo Matching on High-resolution Imagescited by 126
- 2020HITNet: Hierarchical Iterative Tile Refinement Network for Real-time Stereo Matchingcited by 120
- 2019Domain-invariant Stereo Matching Networkscited by 108
- 2018Hierarchical Discrete Distribution Decomposition for Match Density Estimationcited by 93
- 2018Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimationcited by 92
- 2014Computing the Stereo Matching Cost with a Convolutional Neural Networkcited by 74
- 2017Cascade Residual Learning: A Two-stage Convolutional Neural Network for Stereo Matchingcited by 63
- 2019Adaptive Unimodal Cost Volume Filtering for Deep Stereo Matchingcited by 55
- 2020Learning Stereo from Single Imagescited by 44
- 2019EdgeStereo: An Effective Multi-Task Learning Network for Stereo Matching and Edge Detectioncited by 39
- 2020Bi3D: Stereo Depth Estimation via Binary Classificationscited by 34
- 2020AdaStereo: A Simple and Efficient Approach for Adaptive Stereo Matchingcited by 31
- 2021PVStereo: Pyramid Voting Module for End-to-End Self-Supervised Stereo Matchingcited by 28
- 2016Continuous 3D Label Stereo Matching using Local Expansion Movescited by 16
- 2019AMNet: Deep Atrous Multiscale Stereo Disparity Estimation Networkscited by 7
Built on by
Citing papers per year: 2021: 5; 2022: 36; 2023: 46; 2024: 89; 2025: 103; 2026: 69.
348 papers.
Sort:
By area:
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 170
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
38 more
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 129
- 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 98
- 2022CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flowcited by 82
- 2024GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Viewscited by 65
- 2022Accurate and Efficient Stereo Matching via Attention Concatenation Volumecited by 59
- 2021IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereocited by 56
- 2024IGEV++: Iterative Multi-range Geometry Encoding Volumes for Stereo Matchingcited by 55
- 2023IEBins: Iterative Elastic Bins for Monocular Depth Estimationcited by 53
- 2022Multiview Stereo with Cascaded Epipolar RAFTcited by 51
- 2024Robot See Robot Do: Imitating Articulated Object Manipulation with Monocular 4D Reconstructioncited by 51
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2022Open Challenges in Deep Stereo: the Booster Datasetcited by 48
- 2023LRRU: Long-short Range Recurrent Updating Networks for Depth Completioncited by 48
- 2024MoCha-Stereo: Motif Channel Attention Network for Stereo Matchingcited by 48
- 2023NeRF-Supervised Deep Stereocited by 46
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 45
- 2022GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Featurecited by 43
- 2022DiffuStereo: High Quality Human Reconstruction via Diffusion-based Stereo Using Sparse Camerascited by 43
- 2021Toward Practical Monocular Indoor Depth Estimationcited by 42
- 2024Neural Markov Random Field for Stereo Matchingcited by 38
- 2022Context-Enhanced Stereo Transformercited by 37
- 2023Uncertainty Guided Adaptive Warping for Robust and Efficient Stereo Matchingcited by 36
- 2023Tracking and Mapping in Medical Computer Vision: A Reviewcited by 36
- 2023Learning Depth Estimation for Transparent and Mirror Surfacescited by 34
- 2024MeshAvatar: Learning High-quality Triangular Human Avatars from Multi-view Videoscited by 34
- 2023Booster: a Benchmark for Depth from Images of Specular and Transparent Surfacescited by 33
- 2022Disentangling Architecture and Training for Optical Flowcited by 32
- 2023OpenStereo: A Comprehensive Benchmark for Stereo Matching and Strong Baselinecited by 28
- 2024LightStereo: Channel Boost Is All You Need for Efficient 2D Cost Aggregationcited by 28
- 2023RoadFormer: Duplex Transformer for RGB-Normal Semantic Road Scene Parsingcited by 27
- 2024Match-Stereo-Videos: Bidirectional Alignment for Consistent Dynamic Stereo Matchingcited by 24
- 2024Playing to Vision Foundation Model's Strengths in Stereo Matchingcited by 23
- 2024OGNI-DC: Robust Depth Completion with Optimization-Guided Neural Iterationscited by 23
- 2024A Survey on Deep Stereo Matching in the Twentiescited by 23
- 2025Fast-FoundationStereo: Real-Time Zero-Shot Stereo Matchingcited by 23
- 2024GPS-Gaussian+: Generalizable Pixel-wise 3D Gaussian Splatting for Real-Time Human-Scene Rendering from Sparse Viewscited by 22
- 2023Bridging Stereo Geometry and BEV Representation with Reliable Mutual Interaction for Semantic Scene Completioncited by 21
- 2022Self-Supervised Depth Estimation in Laparoscopic Image using 3D Geometric Consistencycited by 19
50 most cited of 348 All 348 (JSON)
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026StereoGaussians: Feed-Forward 3D Gaussian Splatting from Stereo Images29 Sep 2026
- 2026EpiTransfer: Sparse, Training-Free Long-Range Depth Estimation from Temporal Monocular Aerial Frames27 Sep 2026
- 2026PICO: Projection-Informed Consistency Optimisation for 6DoF Surgical Tool Pose Estimation25 Sep 2026
- 2026SatUnreal: A High-Precision Synthetic Dataset for Satellite Stereo Matching via Unreal Engine23 Sep 2026
- 2026SFVO: Decoupled Confidence-Guided Stereo-Flow Visual Odometry with Bidirectional PnP18 Sep 2026
- 2026Disparity Has a Sign: Stereo Matching Beyond the Zero-Disparity Plane6 Sep 2026
- 2026EMCStereo: Attention-Enhanced Stereo Matching for Thin-Structure Depth Estimation with a Synthetic Tree-Branch Benchmark2 Sep 2026
- 2026MV-dVRK: A Multi-Viewpoint Benchmark for Spatial Surgical Perception2 Sep 2026
- 2026PhasorNet: Learning Structure from Frequency for Real-Time Stereo Matching30 Aug 2026
- 2026NBS: No Bias Stereo28 Aug 2026
- 2026Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging28 Aug 2026
38 more
- 2026StereoDiffuer: Diffusion-based Progressive Geometry Modeling with Saliency Attention Perception for Stereo Matching22 Aug 2026
- 2026M2Depth: Unifying Monocular Depth Foundation Priors with Multi-View Stereo21 Aug 2026
- 2026Ego-OSCAR: Egocentric Open source Stereo CAptuRe System8 Aug 2026
- 2026Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction30 Jul 2026
- 2026SeasonStereo: Robust Dense Stereo Matching for Multi-Date Satellite Imagery via Generative AI29 Jul 2026
- 2026WHTMix: Efficient Stereo Depth Estimation via Walsh-Hadamard Token Mixing28 Jul 2026
- 2026NSL-SLAM: High-Fidelity Neural Structured-Light Depth for Practical SLAM and Reconstruction27 Jul 2026
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching22 Jul 2026
- 2026WAVE-Stereo: Warp-Aligned Volume Encoding for Stereo Matching15 Jul 2026
- 2026Point Tracking in Surgery--The 2025 Surgical Tattoos in Infrared Challenge (STIRC2025)14 Jul 2026
- 2026Revisiting Matching Response and Swept Feature Volumes for Wide-baseline Omnidirectional Stereo13 Jul 2026
- 2026URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matching7 Jul 2026
- 2026OmniDS: Dual-Stream Context Fusion for Omnidirectional Depth from Fisheye Cameras3 Jul 2026
- 2026LiteMatch: Lightweight Zero-Shot Stereo Matching via Cost Volume Stabilization30 Jun 2026
- 2026Independent Samples, Correlated Variance A Learnable Cross-View Cue in Path-Traced Stereo Data24 Jun 2026
- 2026LinStereo: Linear-Complexity Global Attention for Multi-Scale Iterative Stereo Matching24 Jun 2026
- 2026Spherical-to-ERP Epipolar Rectification for Single-Axis Disparity in 360 Stereo23 Jun 2026
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching23 Jun 2026
- 2026StereoFactory: A Unified Merging Framework for Robust Stereo Matching16 Jun 2026
- 2026Benchmarking stereo reconstruction for 3D printable Martian terrain models9 Jun 2026
- 2026A Novel Computer Vision Approach for Assessing Fish Responses to Intrusive Objects in Aquaculture28 May 2026
- 2026D'ej`a View: Looping Transformers for Multi-View 3D Reconstruction28 May 2026
- 2026H-OmniStereo: Zero-Shot Omnidirectional Stereo Matching with Heading-Aligned Normal Priors14 May 2026
- 2026The Midas Touch for Metric Depth12 May 2026
- 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perception11 May 2026
- 2026Cross-Modal RGB-D Fusion Transformer for 6D Pose Estimation of Non-Cooperative Spacecraft with Stereo-Derived Depth9 May 2026
- 2026Low-Cost Stereo Vision for Robust 3D Positioning of Thin Radiata Pine Branches in Autonomous Drone Pruning6 May 2026
- 2026ProcFunc: Function-Oriented Abstractions for Procedural 3D Generation in Python29 Apr 2026
- 2026MLG-Stereo: ViT Based Stereo Matching with Multi-Stage Local-Global Enhancement22 Apr 2026
- 2026Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric Stereo16 Apr 2026
- 2026Positioning radiata pine branches requiring pruning by drone stereo vision12 Apr 2026
- 2026SMFormer: Empowering Self-supervised Stereo Matching via Foundation Models and Data Augmentation11 Apr 2026
- 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matching10 Apr 2026
- 2026EventHub: Data Factory for Generalizable Event-Based Stereo Networks without Active Sensors2 Apr 2026
- 2026Towards Minimal Focal Stack in Shape from Focus2 Apr 2026
- 2026StereoVGGT: A Training-Free Visual Geometry Transformer for Stereo Vision31 Mar 2026
- 2026Real-Time Branch-to-Tool Distance Estimation for Autonomous UAV Pruning: Benchmarking Five DEFOM-Stereo Variants from Simulation to Jetson Deployment27 Mar 2026
- 2026WAFT-Stereo: Warping-Alone Field Transforms for Stereo Matching25 Mar 2026
50 newest of 348 All 348 (JSON)
- 2025Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Modelscited by 17
- 2023DiffuVolume: Diffusion Model for Volume based Stereo Matchingcited by 16
- 2025Zero-shot Depth Completion via Test-time Alignment with Affine-invariant Depth Priorcited by 6
- 2025Lightweight and Accurate Multi-View Stereo with Confidence-Aware Diffusion Modelcited by 4
- 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimationcited by 3
- 2025IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videoscited by 1
- 2025GeoDiff: Geometry-Guided Diffusion for Metric Depth Estimationcited by 0
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matchingcited by 0
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching22 Jul 2026
- 2025GeoDiff: Geometry-Guided Diffusion for Metric Depth Estimation21 Oct 2025
- 2025Lightweight and Accurate Multi-View Stereo with Confidence-Aware Diffusion Model18 Sep 2025
- 2025DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimation18 Aug 2025
- 2025Diffuman4D: 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models17 Jul 2025
- 2025IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videos27 Apr 2025
- 2025Zero-shot Depth Completion via Test-time Alignment with Affine-invariant Depth Prior10 Feb 2025
- 2023DiffuVolume: Diffusion Model for Volume based Stereo Matching30 Aug 2023
- 2024ViM-Disparity: Bridging the Gap of Speed, Accuracy and Memory for Disparity Map Generationcited by 2
- 2025DensePercept-NCSSD: Vision Mamba towards Real-time Dense Visual Perception with Non-Causal State Space Dualitycited by 1
- 2025Robust Real-Time Endoscopic Stereo Matching under Fuzzy Tissue Boundariescited by 0
- 2025StereoMamba: Real-time and Robust Intraoperative Stereo Disparity Estimation via Long-range Spatial Dependenciescited by 0
- 2026DenVisCoM: Dense Vision Correspondence Mamba for Efficient and Real-time Optical Flow and Stereo Estimationcited by 0
- 2026DenVisCoM: Dense Vision Correspondence Mamba for Efficient and Real-time Optical Flow and Stereo Estimation2 Feb 2026
- 2025DensePercept-NCSSD: Vision Mamba towards Real-time Dense Visual Perception with Non-Causal State Space Duality16 Nov 2025
- 2025StereoMamba: Real-time and Robust Intraoperative Stereo Disparity Estimation via Long-range Spatial Dependencies24 Apr 2025
- 2025Robust Real-Time Endoscopic Stereo Matching under Fuzzy Tissue Boundaries2 Mar 2025
- 2024ViM-Disparity: Bridging the Gap of Speed, Accuracy and Memory for Disparity Map Generation21 Dec 2024
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 170
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
- 2023Infinite Photorealistic Worlds using Procedural Generationcited by 142
12 most cited of 332 All 332 (JSON)
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026StereoGaussians: Feed-Forward 3D Gaussian Splatting from Stereo Images29 Sep 2026
- 2026EpiTransfer: Sparse, Training-Free Long-Range Depth Estimation from Temporal Monocular Aerial Frames27 Sep 2026
- 2026PICO: Projection-Informed Consistency Optimisation for 6DoF Surgical Tool Pose Estimation25 Sep 2026
- 2026SatUnreal: A High-Precision Synthetic Dataset for Satellite Stereo Matching via Unreal Engine23 Sep 2026
- 2026SFVO: Decoupled Confidence-Guided Stereo-Flow Visual Odometry with Bidirectional PnP18 Sep 2026
- 2026Disparity Has a Sign: Stereo Matching Beyond the Zero-Disparity Plane6 Sep 2026
- 2026EMCStereo: Attention-Enhanced Stereo Matching for Thin-Structure Depth Estimation with a Synthetic Tree-Branch Benchmark2 Sep 2026
- 2026MV-dVRK: A Multi-Viewpoint Benchmark for Spatial Surgical Perception2 Sep 2026
- 2026PhasorNet: Learning Structure from Frequency for Real-Time Stereo Matching30 Aug 2026
- 2026NBS: No Bias Stereo28 Aug 2026
- 2026Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging28 Aug 2026
12 newest of 332 All 332 (JSON)