PatchmatchNet: Learned Multi-View Patchmatch Stereo
Not on the map. Why?
Abstract (arXiv)
We present PatchmatchNet, a novel and learnable cascade formulation of Patchmatch for high-resolution multi-view stereo. With high computation speed and low memory requirement, PatchmatchNet can process higher resolution imagery and is more suited to run on resource limited devices than competitors that employ 3D cost volume regularization. For the first time we introduce an iterative multi-scale Patchmatch in an end-to-end trainable architecture and improve the Patchmatch core algorithm with a novel and learned adaptive propagation and evaluation scheme for each iteration. Extensive experiments show a very competitive performance and generalization for our method on DTU, Tanks & Temples and ETH3D, but at a significantly higher efficiency than all existing top-performing models: at least two and a half times faster than state-of-the-art methods with twice less memory usage.
Key facts. Cited by 204 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 43; 2023: 44; 2024: 42; 2025: 38; 2026: 25.
204 papers.
Sort:
By area:
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 280
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 136
- 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
38 more
- 2021TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformerscited by 117
- 2023DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Renderingcited by 103
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 98
- 2022BEVStereo: Enhancing Depth Estimation in Multi-view 3D Object Detection with Dynamic Temporal Stereocited by 89
- 2022Rethinking Depth Estimation for Multi-View Stereo: A Unified Representationcited by 82
- 2021Learning Signed Distance Field for Multi-view Surface Reconstructioncited by 76
- 2023Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflectioncited by 68
- 2024GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Viewscited by 65
- 2022VolRecon: Volume Rendering of Signed Ray Distance Functions for Generalizable Multi-View Reconstructioncited by 61
- 2021IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereocited by 56
- 2023Urban Radiance Field Representation with Deformable Neural Mesh Primitivescited by 55
- 2023VA-DepthNet: A Variational Approach to Single Image Depth Predictioncited by 54
- 2022STS: Surround-view Temporal Stereo for Multi-view 3D Detectioncited by 53
- 2022MVSTER: Epipolar Transformer for Efficient Multi-View Stereocited by 50
- 2022MVSFormer: Multi-View Stereo by Learning Robust Image Features and Temperature-based Depthcited by 50
- 2024MVSFormer++: Revealing the Devil in Transformer's Details for Multi-View Stereocited by 49
- 2024MoCha-Stereo: Motif Channel Attention Network for Stereo Matchingcited by 48
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2021MVS2D: Efficient Multi-view Stereo via Attention-Driven 2D Convolutionscited by 43
- 2022DIP: Deep Inverse Patchmatch for High-Resolution Optical Flowcited by 40
- 2022FWD: Real-time Novel View Synthesis with Forward Warping and Depthcited by 39
- 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 39
- 2022A Benchmark and a Baseline for Robust Multi-view Depth Estimationcited by 38
- 2024LRM-Zero: Training Large Reconstruction Models with Synthesized Datacited by 35
- 2021Generalized Binary Search Network for Highly-Efficient Multi-View Stereocited by 32
- 2024Hierarchical Temporal Context Learning for Camera-based Semantic Scene Completioncited by 32
- 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Poolcited by 32
- 2021Digging into Uncertainty in Self-supervised Multi-view Stereocited by 31
- 2022Uncertainty-Aware Deep Multi-View Photometric Stereocited by 30
- 2022RC-MVSNet: Unsupervised Multi-View Stereo with Neural Renderingcited by 30
- 2024Adaptive Fusion of Single-View and Multi-View Depth for Autonomous Drivingcited by 30
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 30
- 2022PlaneMVS: 3D Plane Reconstruction from Multi-View Stereocited by 29
- 2023UniSDF: Unifying Neural Representations for High-Fidelity 3D Reconstruction of Complex Scenes with Reflectionscited by 29
- 2022PlanarRecon: Real-time 3D Plane Detection and Reconstruction from Posed Monocular Videoscited by 27
- 2025MVSAnywhere: Zero-Shot Multi-View Stereocited by 26
- 2025CityGS-X: A Scalable Architecture for Efficient and Geometrically Accurate Large-Scale Scene Reconstructioncited by 26
- 2021Neural Radiance Fields Approach to Deep Multi-View Photometric Stereocited by 25
50 most cited of 204 All 204 (JSON)
- 2026SpatialSpeak: QA-Native Reconstruction with Local and Global Context for Spatial Chain-of-Thought Reasoning27 Sep 2026
- 2026Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation21 Sep 2026
- 2026SAMV-DUSt3R: Instance-Centric 3D Scene Decoupling from Sparse Multi-Views10 Sep 2026
- 2026ZipMVS: Multi-View Stereo with Compressed Cost Volumes28 Aug 2026
- 2026StereoDiffuer: Diffusion-based Progressive Geometry Modeling with Saliency Attention Perception for Stereo Matching22 Aug 2026
- 2026VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Clouds21 Aug 2026
- 2026Geometry-Grounded Unified 3D Perception for Autonomous Driving13 Aug 2026
- 2026D^2-4DGS: Dual-Depth Guided Sparse-Camera 4D Gaussian Splatting3 Aug 2026
- 2026Aerial-ground LiDAR place recognition with patch-level self-supervised learning and expanded reciprocal re-ranking17 Jun 2026
- 2026ActMVS: Active Scene Reconstruction with Monocular Multi-View Stereo31 May 2026
- 2026ROAR-3D: Routing Arbitrary Views for High-Fidelity 3D Generation20 May 2026
- 2026UAVFF3D: A Geometry-Aware Benchmark for Feed-Forward UAV 3D Reconstruction18 May 2026
38 more
- 2026SpaceMind++: Toward Allocentric Cognitive Maps for Spatially Grounded Video MLLMs10 May 2026
- 2026PAGaS: Pixel-Aligned 1DoF Gaussian Splatting for Depth Refinement24 Apr 2026
- 2026A Comparison of Multi-View Stereo Methods for Photogrammetric 3D Reconstruction: From Traditional to Learning-Based Approaches11 Apr 2026
- 2026SimpleProc: Fully Procedural Synthetic Data from Simple Rules for Multi-View Stereo6 Apr 2026
- 2026RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Space1 Apr 2026
- 2026Fisheye3R: Adapting Unified 3D Feed-Forward Foundation Models to Fisheye Lenses30 Mar 2026
- 2026Reference-Free Omnidirectional Stereo Matching via Multi-View Consistency Maximization16 Mar 2026
- 2026OVGGT: O(1) Constant-Cost Streaming Visual Geometry Transformer6 Mar 2026
- 2026VGGT-Det: Mining VGGT Internal Priors for Sensor-Geometry-Free Multi-View Indoor 3D Object Detection1 Mar 2026
- 2026Breaking the Sub-Millimeter Barrier: Eyeframe Acquisition from Color Images18 Feb 2026
- 2026FUSE-Flow: Scalable Real-Time Multi-View Point Cloud Reconstruction Using Confidence1 Feb 2026
- 2026SPARK: Scalable Real-Time Point Cloud Aggregation with Multi-View Self-Calibration13 Jan 2026
- 2026ImLoc: Revisiting Visual Localization with Image-based Representation7 Jan 2026
- 2025G3Splat: Geometrically Consistent Generalizable Gaussian Splatting19 Dec 2025
- 2025Gaussian Entropy Fields: Driving Adaptive Sparsity in 3D Gaussian Optimization4 Dec 2025
- 2025Emergent Outlier View Rejection in Visual Geometry Grounded Transformers3 Dec 2025
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backend25 Nov 2025
- 2025MVS-TTA: Test-Time Adaptation for Multi-View Stereo via Meta-Auxiliary Learning22 Nov 2025
- 2025MVSMamba: Multi-View Stereo with State Space Model3 Nov 2025
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generation27 Oct 2025
- 2025VAD-GS: Visibility-Aware Densification for 3D Gaussian Splatting in Dynamic Urban Scenes10 Oct 2025
- 2025MoRe: Monocular Geometry Refinement via Graph Optimization for Cross-View Consistency8 Oct 2025
- 2025Lightweight and Accurate Multi-View Stereo with Confidence-Aware Diffusion Model18 Sep 2025
- 2025No Mesh, No Problem: Estimating Coral Volume and Surface from Sparse Multi-View Images14 Sep 2025
- 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Pool5 Sep 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens6 Aug 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025DVP-MVS++: Synergize Depth-Normal-Edge and Harmonized Visibility Prior for Multi-View Stereo16 Jun 2025
- 2025VEIGAR: View-consistent Explicit Inpainting and Geometry Alignment for 3D object Removal13 Jun 2025
- 2025Aerial Multi-View Stereo via Adaptive Depth Range Inference and Normal Cues6 Jun 2025
- 2025Multi-view Surface Reconstruction Using Normal and Reflectance Cues4 Jun 2025
- 2025K-Buffers: A Plug-in Method for Enhancing Neural Fields with Multiple Buffers26 May 2025
- 2025IA-MVS: Instance-Focused Adaptive Depth Sampling for Multi-View Stereo19 May 2025
- 2025Multi-view dense image matching with similarity learning and geometry priors16 May 2025
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splatting4 May 2025
- 2025TSGS: Improving Gaussian Splatting for Transparent Surface Reconstruction via Normal and De-lighting Priors17 Apr 2025
- 2025Detail-aware multi-view stereo network for depth estimation31 Mar 2025
50 newest of 204 All 204 (JSON)
- 2025MVSMamba: Multi-View Stereo with State Space Modelcited by 1
- 2025MVSMamba: Multi-View Stereo with State Space Model3 Nov 2025
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 280
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 136
- 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
12 most cited of 197 All 197 (JSON)
- 2026Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation21 Sep 2026
- 2026SAMV-DUSt3R: Instance-Centric 3D Scene Decoupling from Sparse Multi-Views10 Sep 2026
- 2026ZipMVS: Multi-View Stereo with Compressed Cost Volumes28 Aug 2026
- 2026StereoDiffuer: Diffusion-based Progressive Geometry Modeling with Saliency Attention Perception for Stereo Matching22 Aug 2026
- 2026VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Clouds21 Aug 2026
- 2026Geometry-Grounded Unified 3D Perception for Autonomous Driving13 Aug 2026
- 2026D^2-4DGS: Dual-Depth Guided Sparse-Camera 4D Gaussian Splatting3 Aug 2026
- 2026Aerial-ground LiDAR place recognition with patch-level self-supervised learning and expanded reciprocal re-ranking17 Jun 2026
- 2026ActMVS: Active Scene Reconstruction with Monocular Multi-View Stereo31 May 2026
- 2026ROAR-3D: Routing Arbitrary Views for High-Fidelity 3D Generation20 May 2026
- 2026UAVFF3D: A Geometry-Aware Benchmark for Feed-Forward UAV 3D Reconstruction18 May 2026
- 2026PAGaS: Pixel-Aligned 1DoF Gaussian Splatting for Depth Refinement24 Apr 2026
12 newest of 197 All 197 (JSON)