Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformers
Not on the map. Why?
Abstract (arXiv)
Stereo depth estimation relies on optimal correspondence matching between pixels on epipolar lines in the left and right images to infer depth. In this work, we revisit the problem from a sequence-to-sequence correspondence perspective to replace cost volume construction with dense pixel matching using position information and attention. This approach, named STereo TRansformer (STTR), has several advantages: It 1) relaxes the limitation of a fixed disparity range, 2) identifies occluded regions and provides confidence estimates, and 3) imposes uniqueness constraints during the matching process. We report promising results on both synthetic and real-world datasets and demonstrate that STTR generalizes across different domains, even without fine-tuning.
Key facts. Cited by 190 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 39; 2023: 36; 2024: 50; 2025: 36; 2026: 14.
190 papers.
Sort:
By area:
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2021SPViT: Enabling Faster Vision Transformers via Soft Token Pruningcited by 165
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
- 2022QuadTree Attention for Vision Transformerscited by 129
- 2022Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgerycited by 122
- 2021TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformerscited by 117
38 more
- 2023CompletionFormer: Depth Completion with Convolutions and Vision Transformerscited by 92
- 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentationcited by 84
- 2022SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimationcited by 76
- 2023EndoSurf: Neural Surface Reconstruction of Deformable Tissues with Stereo Endoscope Videoscited by 68
- 2022Multi-Frame Self-Supervised Depth with Transformerscited by 64
- 2024IGEV++: Iterative Multi-range Geometry Encoding Volumes for Stereo Matchingcited by 55
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2022MVSTER: Epipolar Transformer for Efficient Multi-View Stereocited by 50
- 2024MVSFormer++: Revealing the Devil in Transformer's Details for Multi-View Stereocited by 49
- 2022MulT: An End-to-End Multitask Learning Transformercited by 47
- 2021E-DSSR: Efficient Dynamic Surgical Scene Reconstruction with Transformer-based Stereoscopic Depth Perceptioncited by 46
- 2022Revisiting Domain Generalized Stereo Matching Networks from a Feature Consistency Perspectivecited by 46
- 2023NeRF-Supervised Deep Stereocited by 46
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 45
- 2023Neural LerPlane Representations for Fast 4D Reconstruction of Deformable Tissuescited by 44
- 2022GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Featurecited by 43
- 2024Endo-4DGS: Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splattingcited by 43
- 2021Boundary-aware Transformers for Skin Lesion Segmentationcited by 39
- 2024Neural Markov Random Field for Stereo Matchingcited by 38
- 2022Context-Enhanced Stereo Transformercited by 37
- 2023Improving Depth Gradient Continuity in Transformers: A Comparative Study on Monocular Depth Estimation with CNNcited by 35
- 2023Learning Depth Estimation for Transparent and Mirror Surfacescited by 34
- 2024EndoGS: Deformable Endoscopic Tissues Reconstruction with Gaussian Splattingcited by 33
- 2021Input-level Inductive Biases for 3D Reconstructioncited by 31
- 2022MeshMAE: Masked Autoencoders for 3D Mesh Data Analysiscited by 31
- 2023OpenStereo: A Comprehensive Benchmark for Stereo Matching and Strong Baselinecited by 28
- 2023CosPGD: an efficient white-box adversarial attack for pixel-wise prediction taskscited by 27
- 2021Temporally Consistent Online Depth Estimation in Dynamic Scenescited by 26
- 2023ELFNet: Evidential Local-global Fusion for Stereo Matchingcited by 25
- 2022RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmarkcited by 24
- 2024A Survey on Deep Stereo Matching in the Twentiescited by 23
- 2024UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and UnFavOrable Setscited by 22
- 2022WT-MVSNet: Window-based Transformers for Multi-view Stereocited by 20
- 2024EndoGaussian: Real-time Gaussian Splatting for Dynamic Endoscopic Scene Reconstructioncited by 20
- 2022Transformers in Self-Supervised Monocular Depth Estimation with Unknown Camera Intrinsicscited by 19
- 2023Global Occlusion-Aware Transformer for Robust Stereo Matchingcited by 19
- 2024SVG: 3D Stereoscopic Video Generation via Denoising Frame Matrixcited by 19
- 2022Depth Field Networks for Generalizable Multi-view Scene Representationcited by 17
50 most cited of 190 All 190 (JSON)
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026NBS: No Bias Stereo28 Aug 2026
- 2026WHTMix: Efficient Stereo Depth Estimation via Walsh-Hadamard Token Mixing28 Jul 2026
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching22 Jul 2026
- 2026StereoPolicy: Improving Robotic Manipulation Policies via Stereo Perception11 May 2026
- 2026MLG-Stereo: ViT Based Stereo Matching with Multi-Stage Local-Global Enhancement22 Apr 2026
- 2026Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric Stereo16 Apr 2026
- 2026EventHub: Data Factory for Generalizable Event-Based Stereo Networks without Active Sensors2 Apr 2026
- 2026StereoVGGT: A Training-Free Visual Geometry Transformer for Stereo Vision31 Mar 2026
- 2026SurgCUT3R: Surgical Scene-Aware Continuous Understanding of Temporal 3D Representation7 Mar 2026
- 2026Diff2DGS: Reliable Reconstruction of Occluded Surgical Scenes via 2D Gaussian Splatting20 Feb 2026
- 20264D Monocular Surgical Reconstruction under Arbitrary Camera Motions19 Feb 2026
38 more
- 2026StereoAdapter-2: Globally Structure-Consistent Underwater Stereo Depth Estimation18 Feb 2026
- 2026Geometry without Position? When Positional Embeddings Help and Hurt Spatial Reasoning29 Jan 2026
- 2025A Study of Finetuning Video Transformers for Multi-view Geometry Tasks21 Dec 2025
- 2025DepthFocus: Controllable Depth Estimation for See-Through Scenes21 Nov 2025
- 2025Lite Any Stereo: Efficient Zero-Shot Stereo Matching20 Nov 2025
- 2025RobIA: Robust Instance-aware Continual Test-time Adaptation for Deep Stereo13 Nov 2025
- 2025SAGS: Self-Adaptive Alias-Free Gaussian Splatting for Dynamic Surgical Endoscopic Reconstruction31 Oct 2025
- 2025CogStereo: Neural Stereo Matching with Implicit Spatial Cognition Embedding25 Oct 2025
- 2025MatchAttention: Embedding Explicit Matching Constraints into Attention for Efficient Stereo Matching16 Oct 2025
- 2025A Recursive Pyramidal Algorithm for Solving the Image Registration Problem5 Oct 2025
- 2025CCNeXt: An Effective Self-Supervised Stereo Depth Estimation Approach26 Sep 2025
- 2025StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenes19 Sep 2025
- 2025TransForSeg: A Multitask Stereo ViT for Joint Stereo Segmentation and 3D Force Estimation in Catheterization1 Sep 2025
- 2025EndoUFM: Utilizing Foundation Models for Monocular depth estimation of endoscopic images25 Aug 2025
- 2025Surg-InvNeRF: Invertible NeRF for 3D tracking and reconstruction in surgical vision13 Aug 2025
- 2025S^2VG: 3D Stereoscopic and Spatial Video Generation via Denoising Frame Matrix11 Aug 2025
- 2025BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignment6 Aug 2025
- 2025Endoscopic Depth Estimation Based on Deep Learning: A Survey28 Jul 2025
- 2025Preserving Guidance in Cost-Volume Retrieval under Extreme LiDAR Sparsity in Iterative Stereo26 Jul 2025
- 2025Stextsuperscript2Mtextsuperscript2: Scalable Stereo Matching Model for Reliable Depth Estimation17 Jul 2025
- 2025Towards Depth Foundation Model: Recent Trends in Vision-Based Depth Estimation15 Jul 2025
- 2025Learning Robust Stereo Matching in the Wild with Selective Mixture-of-Experts7 Jul 2025
- 2025ESMStereo: Enhanced ShuffleMixer Disparity Upsampling for Real-Time and Accurate Stereo Matching26 Jun 2025
- 2025DepthVanish: Optimizing Adversarial Interval Structures for Stereo-Depth-Invisible Patches20 Jun 2025
- 2025NTIRE 2025 Challenge on HR Depth from Images of Specular and Transparent Surfaces6 Jun 2025
- 2025Generating Synthetic Stereo Datasets using 3D Gaussian Splatting and Expert Knowledge Transfer5 Jun 2025
- 2025Diving into the Fusion of Monocular Priors for Generalized Stereo Matching20 May 2025
- 2025M3Depth: Wavelet-Enhanced Depth Estimation on Mars via Mutual Boosting of Dual-Modal Data20 May 2025
- 2025Multi-Label Stereo Matching for Transparent Scene Depth Estimation20 May 2025
- 20253D Visual Illusion Depth Estimation19 May 2025
- 2025DispBench: Benchmarking Disparity Estimation to Synthetic Corruptions8 May 2025
- 2025JointDiT: Enhancing RGB-Depth Joint Modeling with Diffusion Transformers1 May 2025
- 2025Optimizing Specific and Shared Parameters for Efficient Parameter Tuning4 Apr 2025
- 2025Feature-EndoGaussian: Feature Distilled Gaussian Splatting in Surgical Deformable Scene Reconstruction8 Mar 2025
- 2025Stereo Any Video: Temporally Consistent Stereo Matching7 Mar 2025
- 2025FoundationStereo: Zero-Shot Stereo Matching17 Jan 2025
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matching16 Jan 2025
- 2025Hadamard Attention Recurrent Transformer: A Strong Baseline for Stereo Matching Transformer2 Jan 2025
50 newest of 190 All 190 (JSON)
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 147
- 2022QuadTree Attention for Vision Transformerscited by 129
- 2022Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgerycited by 122
- 2021TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformerscited by 117
- 2023CompletionFormer: Depth Completion with Convolutions and Vision Transformerscited by 92
12 most cited of 183 All 183 (JSON)
- 2026FAST: Flow Any Scene Transformer30 Sep 2026
- 2026NBS: No Bias Stereo28 Aug 2026
- 2026WHTMix: Efficient Stereo Depth Estimation via Walsh-Hadamard Token Mixing28 Jul 2026
- 2026MLG-Stereo: ViT Based Stereo Matching with Multi-Stage Local-Global Enhancement22 Apr 2026
- 2026Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric Stereo16 Apr 2026
- 2026EventHub: Data Factory for Generalizable Event-Based Stereo Networks without Active Sensors2 Apr 2026
- 2026StereoVGGT: A Training-Free Visual Geometry Transformer for Stereo Vision31 Mar 2026
- 2026SurgCUT3R: Surgical Scene-Aware Continuous Understanding of Temporal 3D Representation7 Mar 2026
- 2026Diff2DGS: Reliable Reconstruction of Occluded Surgical Scenes via 2D Gaussian Splatting20 Feb 2026
- 20264D Monocular Surgical Reconstruction under Arbitrary Camera Motions19 Feb 2026
- 2026StereoAdapter-2: Globally Structure-Consistent Underwater Stereo Depth Estimation18 Feb 2026
- 2025A Study of Finetuning Video Transformers for Multi-view Geometry Tasks21 Dec 2025
12 newest of 183 All 183 (JSON)