Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matching
Not on the map. Why?
Abstract (arXiv)
The deep multi-view stereo (MVS) and stereo matching approaches generally construct 3D cost volumes to regularize and regress the output depth or disparity. These methods are limited when high-resolution outputs are needed since the memory and time costs grow cubically as the volume resolution increases. In this paper, we propose a both memory and time efficient cost volume formulation that is complementary to existing multi-view stereo and stereo matching approaches based on 3D cost volumes. First, the proposed cost volume is built upon a standard feature pyramid encoding geometry and context at gradually finer scales. Then, we can narrow the depth (or disparity) range of each stage by the depth (or disparity) map from the previous stage. With gradually higher cost volume resolution and adaptive adjustment of depth (or disparity) intervals, the output is recovered in a coarser to fine manner. We apply the cascade cost volume to the representative MVS-Net, and obtain a 23.1% improvement on DTU benchmark (1st place), with 50.6% and 74.2% reduction in GPU memory and run-time. It is also the state-of-the-art learning-based method on Tanks and Temples benchmark. The statistics of accuracy, run-time and GPU memory on other representative stereo CNNs also validate the effectiveness of our proposed method.
Key facts. Cited by 414 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 52; 2022: 68; 2023: 77; 2024: 85; 2025: 82; 2026: 50.
414 papers.
Sort:
By area:
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
38 more
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 175
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
- 2021Efficient Neural Radiance Fields for Interactive Free-viewpoint Videocited by 150
- 2025Streaming 4D Visual Geometry Transformercited by 147
- 2021Improving neural implicit surfaces geometry with patch warpingcited by 136
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 136
- 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
- 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
- 2021SMD-Nets: Stereo Mixture Density Networkscited by 118
- 2021TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformerscited by 117
- 2024RaDe-GS: Rasterizing Depth in Gaussian Splattingcited by 110
- 2022NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstructioncited by 99
- 2022BEVStereo: Enhancing Depth Estimation in Multi-view 3D Object Detection with Dynamic Temporal Stereocited by 89
- 2022SimpleRecon: 3D Reconstruction Without 3D Convolutionscited by 83
- 2022Rethinking Depth Estimation for Multi-View Stereo: A Unified Representationcited by 82
- 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 82
- 2022Neural 3D Reconstruction in the Wildcited by 79
- 2021Learning Signed Distance Field for Multi-view Surface Reconstructioncited by 76
- 2024Large Spatial Model: End-to-end Unposed Images to Semantic 3Dcited by 73
- 2021AA-RMVSNet: Adaptive Aggregation Recurrent Multi-view Stereo Networkcited by 71
- 2024TranSplat: Generalizable 3D Gaussian Splatting from Sparse Multi-View Images with Transformerscited by 71
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networkscited by 69
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 69
- 2022Unified Implicit Neural Stylizationcited by 67
- 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 67
- 2024GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Viewscited by 65
- 2022NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologiescited by 62
- 2022VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstructioncited by 61
- 2023DBARF: Deep Bundle-Adjusting Generalizable Neural Radiance Fieldscited by 60
- 2022Accurate and Efficient Stereo Matching via Attention Concatenation Volumecited by 59
- 2021IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereocited by 56
- 2024IGEV++: Iterative Multi-range Geometry Encoding Volumes for Stereo Matchingcited by 55
- 2024LaRa: Efficient Large-Baseline Radiance Fieldscited by 54
- 2022STS: Surround-view Temporal Stereo for Multi-view 3D Detectioncited by 53
- 2022Multiview Stereo with Cascaded Epipolar RAFTcited by 51
50 most cited of 414 All 414 (JSON)
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Compute28 Sep 2026
- 2026Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation21 Sep 2026
- 2026Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction18 Sep 2026
- 2026CrossDepth: Geometry-Constrained Attention for Generalizable Multi-View Surround Depth Estimation4 Sep 2026
- 2026GeoRay: Gauge-Aware Feed-Forward Satellite 3D Reconstruction in the Geodetic Frame30 Aug 2026
- 2026ZipMVS: Multi-View Stereo with Compressed Cost Volumes28 Aug 2026
- 2026StereoDiffuer: Diffusion-based Progressive Geometry Modeling with Saliency Attention Perception for Stereo Matching22 Aug 2026
- 2026M2Depth: Unifying Monocular Depth Foundation Priors with Multi-View Stereo21 Aug 2026
- 2026VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Clouds21 Aug 2026
- 2026CrossView: Can Vision-Language Models Reason Across Cameras?16 Aug 2026
- 2026D^2-4DGS: Dual-Depth Guided Sparse-Camera 4D Gaussian Splatting3 Aug 2026
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching22 Jul 2026
38 more
- 2026URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matching7 Jul 2026
- 2026CascadeOcc: Rethinking 3D Occupancy World Models with Cascaded VQ Representations26 Jun 2026
- 2026LinStereo: Linear-Complexity Global Attention for Multi-Scale Iterative Stereo Matching24 Jun 2026
- 2026QVGGT: Post-Training Quantized Visual Geometry Grounded Transformer29 May 2026
- 2026DVSM: Decoder-only View Synthesis Model Done Right28 May 2026
- 2026ROAR-3D: Routing Arbitrary Views for High-Fidelity 3D Generation20 May 2026
- 2026Cross-View Splatter: Feed-Forward View Synthesis with Georeferenced Images19 May 2026
- 2026UAVFF3D: A Geometry-Aware Benchmark for Feed-Forward UAV 3D Reconstruction18 May 2026
- 2026IVGT: Implicit Visual Geometry Transformer for Neural Scene Representation15 May 2026
- 2026VGGT-Omega14 May 2026
- 2026Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrieval10 May 2026
- 2026Geometry-Guided 3D Visual Token Pruning for Video-Language Models20 Apr 2026
- 20263DTV: A Feedforward Interpolation Network for Real-Time View Synthesis13 Apr 2026
- 2026A Comparison of Multi-View Stereo Methods for Photogrammetric 3D Reconstruction: From Traditional to Learning-Based Approaches11 Apr 2026
- 2026Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matching10 Apr 2026
- 2026SimpleProc: Fully Procedural Synthetic Data from Simple Rules for Multi-View Stereo6 Apr 2026
- 2026SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Prediction3 Apr 2026
- 2026RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Space1 Apr 2026
- 2026Fisheye3R: Adapting Unified 3D Feed-Forward Foundation Models to Fisheye Lenses30 Mar 2026
- 2026HGGT: Robust and Flexible 3D Hand Mesh Reconstruction from Uncalibrated Images25 Mar 2026
- 20262K Retrofit: Entropy-Guided Efficient Sparse Refinement for High-Resolution 3D Geometry Prediction20 Mar 2026
- 2026Reference-Free Omnidirectional Stereo Matching via Multi-View Consistency Maximization16 Mar 2026
- 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis16 Mar 2026
- 2026OVGGT: O(1) Constant-Cost Streaming Visual Geometry Transformer6 Mar 2026
- 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splatting3 Mar 2026
- 2026MERG3R: A Divide-and-Conquer Approach to Large-Scale Neural Visual Geometry2 Mar 2026
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories2 Mar 2026
- 2026SwiftNDC: Fast Neural Depth Correction for High-Fidelity 3D Reconstruction26 Feb 2026
- 2026XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compression25 Feb 2026
- 2026Pip-Stereo: Progressive Iterations Pruner for Iterative Optimization based Stereo Matching24 Feb 2026
- 2026Breaking the Sub-Millimeter Barrier: Eyeframe Acquisition from Color Images18 Feb 2026
- 2026GSM-GS: Geometry-Constrained Single and Multi-view Gaussian Splatting for Surface Reconstruction13 Feb 2026
- 2026SurfSplat: Conquering Feedforward 2D Gaussian Splatting with Surface Continuity Priors2 Feb 2026
- 2026Distill3R: A Pipeline for Democratizing 3D Foundation Models on Commodity Hardware31 Jan 2026
- 2026GVGS: Gaussian Visibility-Aware Multi-View Geometry for Accurate Surface Reconstruction28 Jan 2026
- 2026Affostruction: 3D Affordance Grounding with Generative Reconstruction14 Jan 2026
- 2026InfiniteVGGT: Visual Geometry Grounded Transformer for Endless Streams5 Jan 2026
- 2026XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compression3 Jan 2026
50 newest of 414 All 414 (JSON)
- 2023Direct2.5: Diverse Text-to-3D Generation via Multi-view 2.5D Diffusioncited by 50
- 2023DiffuVolume: Diffusion Model for Volume based Stereo Matchingcited by 16
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memoriescited by 15
- 2024Pixel-Aligned Multi-View Generation with Depth Guided Decodercited by 4
- 2025Lightweight and Accurate Multi-View Stereo with Confidence-Aware Diffusion Modelcited by 4
- 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesiscited by 3
- 2023EfficientDreamer: High-Fidelity and Robust 3D Creation via Orthogonal-view Diffusion Priorcited by 2
- 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splattingcited by 2
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matchingcited by 0
- 2026STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching22 Jul 2026
- 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis16 Mar 2026
- 2026Intrinsic Geometry-Appearance Consistency Optimization for Sparse-View Gaussian Splatting3 Mar 2026
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories2 Mar 2026
- 2025Lightweight and Accurate Multi-View Stereo with Confidence-Aware Diffusion Model18 Sep 2025
- 2024Pixel-Aligned Multi-View Generation with Depth Guided Decoder26 Aug 2024
- 2023Direct2.5: Diverse Text-to-3D Generation via Multi-view 2.5D Diffusion27 Nov 2023
- 2023DiffuVolume: Diffusion Model for Volume based Stereo Matching30 Aug 2023
- 2023EfficientDreamer: High-Fidelity and Robust 3D Creation via Orthogonal-view Diffusion Prior25 Aug 2023
- 2025LiteVGGT: Boosting Vanilla VGGT via Geometry-aware Cached Token Mergingcited by 16
- 2026XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compressioncited by 6
- 2026OVGGT: O(1) Constant-Cost Streaming Visual Geometry Transformercited by 1
- 2026XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compressioncited by 0
- 2026OVGGT: O(1) Constant-Cost Streaming Visual Geometry Transformer6 Mar 2026
- 2026XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compression25 Feb 2026
- 2026XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compression3 Jan 2026
- 2025LiteVGGT: Boosting Vanilla VGGT via Geometry-aware Cached Token Merging4 Dec 2025
- 2026CrossView: Can Vision-Language Models Reason Across Cameras?16 Aug 2026
- 2025MVSMamba: Multi-View Stereo with State Space Modelcited by 1
- 2025MVSMamba: Multi-View Stereo with State Space Model3 Nov 2025
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2021GeoNeRF: Generalizing NeRF with Geometry Priorscited by 195
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
12 most cited of 394 All 394 (JSON)
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Compute28 Sep 2026
- 2026Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation21 Sep 2026
- 2026Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction18 Sep 2026
- 2026CrossDepth: Geometry-Constrained Attention for Generalizable Multi-View Surround Depth Estimation4 Sep 2026
- 2026GeoRay: Gauge-Aware Feed-Forward Satellite 3D Reconstruction in the Geodetic Frame30 Aug 2026
- 2026ZipMVS: Multi-View Stereo with Compressed Cost Volumes28 Aug 2026
- 2026StereoDiffuer: Diffusion-based Progressive Geometry Modeling with Saliency Attention Perception for Stereo Matching22 Aug 2026
- 2026M2Depth: Unifying Monocular Depth Foundation Priors with Multi-View Stereo21 Aug 2026
- 2026VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Clouds21 Aug 2026
- 2026D^2-4DGS: Dual-Depth Guided Sparse-Camera 4D Gaussian Splatting3 Aug 2026
- 2026URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matching7 Jul 2026
- 2026LinStereo: Linear-Complexity Global Attention for Multi-Scale Iterative Stereo Matching24 Jun 2026
12 newest of 394 All 394 (JSON)