Stereo Any Video: Temporally Consistent Stereo Matching
Not on the map. Why?
Abstract (arXiv)
This paper introduces Stereo Any Video, a powerful framework for video stereo matching. It can estimate spatially accurate and temporally consistent disparities without relying on auxiliary information such as camera poses or optical flow. The strong capability is driven by rich priors from monocular video depth models, which are integrated with convolutional features to produce stable representations. To further enhance performance, key architectural innovations are introduced: all-to-all-pairs correlation, which constructs smooth and robust matching cost volumes, and temporal convex upsampling, which improves temporal coherence. These components collectively ensure robustness, accuracy, and temporal consistency, setting a new standard in video stereo matching. Extensive experiments demonstrate that our method achieves state-of-the-art performance across multiple datasets both qualitatively and quantitatively in zero-shot settings, as well as strong generalization to real-world indoor and outdoor scenarios.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 62 of its 82 references that are in the map. First posted on arXiv 7 Mar 2025.
Builds on
62 of 82 references.
References · 62
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
- 2018Pyramid Stereo Matching Networkcited by 489
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 417
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 360
38 more
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
- 2017Sparsity Invariant CNNscited by 326
- 2022Unifying Flow, Stereo and Depth Estimationcited by 275
- 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 244
- 2019Group-wise Correlation Stereo Networkcited by 235
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
- 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 204
- 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 190
- 2018Neighbourhood Consensus Networkscited by 174
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
- 2020Hierarchical Neural Architecture Search for Deep Stereo Matchingcited by 166
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 166
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 154
- 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 148
- 2019GLU-Net: Global-Local Universal Network for Dense Flow and Correspondencescited by 139
- 2019Hierarchical Deep Stereo Matching on High-resolution Imagescited by 126
- 2020HITNet: Hierarchical Iterative Tile Refinement Network for Real-time Stereo Matchingcited by 120
- 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 99
- 2018Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimationcited by 92
- 2024Local All-Pair Correspondence for Point Trackingcited by 80
- 2024DELTA: Dense Efficient Long-range 3D Tracking for any videocited by 65
- 2017Cascade Residual Learning: A Two-stage Convolutional Neural Network for Stereo Matchingcited by 63
- 2022Accurate and Efficient Stereo Matching via Attention Concatenation Volumecited by 59
- 2024IGEV++: Iterative Multi-range Geometry Encoding Volumes for Stereo Matchingcited by 59
- 2018Anytime Stereo Image Depth Estimation on Mobile Devicescited by 54
- 2020GOCor: Bringing Globally Optimized Correspondence Volumes into Your Neural Networkcited by 53
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 52
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 47
- 2021Bilateral Grid Learning for Stereo Matching Networkscited by 46
- 2022Revisiting Domain Generalized Stereo Matching Networks from a Feature Consistency Perspectivecited by 46
- 2022ITSA: An Information-Theoretic Approach to Automatic Shortcut Avoidance and Domain Generalization in Stereo Matching Networkscited by 39
- 2022Context-Enhanced Stereo Transformercited by 37
- 2023Uncertainty Guided Adaptive Warping for Robust and Efficient Stereo Matchingcited by 37
- 2021KITTI-CARLA: a KITTI-like dataset generated by CARLA Simulatorcited by 34
- 2024LightStereo: Channel Boost Is All You Need for Efficient 2D Cost Aggregationcited by 28
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2025Lite Any Stereo: Efficient Zero-Shot Stereo Matchingcited by 4
- 2025DepthFocus: Controllable Depth Estimation for See-Through Scenescited by 3
- 2025StereoWorld: Geometry-Aware Monocular-to-Stereo Video Generationcited by 3
- 2025MAFNet:Multi-frequency Adaptive Fusion Network for Real-time Stereo Matchingcited by 2
- 2026Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AIcited by 1
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matchingcited by 0
- 2026Disparity Has a Sign: Stereo Matching Beyond the Zero-Disparity Planecited by 0
- 2026SCOPE-4D: Endoscopic 4D Geometry Foundation Modelscited by 0
- 2026SCOPE-4D: Endoscopic 4D Geometry Foundation Models1 Oct 2026
- 2026Disparity Has a Sign: Stereo Matching Beyond the Zero-Disparity Plane6 Sep 2026
- 2026Lite Any Stereo V2: Faster and Stronger Efficient Zero-Shot Stereo Matching23 Jun 2026
- 2026Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI22 Jun 2026
- 2025StereoWorld: Geometry-Aware Monocular-to-Stereo Video Generation10 Dec 2025
- 2025MAFNet:Multi-frequency Adaptive Fusion Network for Real-time Stereo Matching4 Dec 2025
- 2025DepthFocus: Controllable Depth Estimation for See-Through Scenes21 Nov 2025
- 2025Lite Any Stereo: Efficient Zero-Shot Stereo Matching20 Nov 2025