Review of Feed-forward 3D Reconstruction: From DUSt3R to VGGT
Not on the map. Why?
Abstract (arXiv)
3D reconstruction, which aims to recover the dense three-dimensional structure of a scene, is a cornerstone technology for numerous applications, including augmented/virtual reality, autonomous driving, and robotics. While traditional pipelines like Structure from Motion (SfM) and Multi-View Stereo (MVS) achieve high precision through iterative optimization, they are limited by complex workflows, high computational cost, and poor robustness in challenging scenarios like texture-less regions. Recently, deep learning has catalyzed a paradigm shift in 3D reconstruction. A new family of models, exemplified by DUSt3R, has pioneered a feed-forward approach. These models employ a unified deep network to jointly infer camera poses and dense geometry directly from an Unconstrained set of images in a single forward pass. This survey provides a systematic review of this emerging domain. We begin by dissecting the technical framework of these feed-forward models, including their Transformer-based correspondence modeling, joint pose and geometry regression mechanisms, and strategies for scaling from two-view to multi-view scenarios. To highlight the disruptive nature of this new paradigm, we contrast it with both traditional pipelines and earlier learning-based methods like MVSNet. Furthermore, we provide an overview of relevant datasets and evaluation metrics. Finally, we discuss the technology's broad application prospects and identify key future challenges and opportunities, such as model accuracy and scalability, and handling dynamic scenes.
Key facts. Cited by 8 papers in the map (data through 13 Oct 2026). Builds on 40 of its 53 references that are in the map. First posted on arXiv 11 Jul 2025.
Builds on
40 of 53 references.
References · 40
- 2017Attention Is All You Needcited by 60,106
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,096
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,440
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,539
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,169
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 979
- 2024Grounding Image Matching in 3D with MASt3Rcited by 965
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 895
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 879
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 782
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 752
28 more
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 732
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 648
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 557
- 2025Continuous 3D Perception Model with Persistent Statecited by 534
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 521
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 488
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 445
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 437
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 358
- 2020Virtual KITTI 2cited by 349
- 20243D Reconstruction with Spatial Memorycited by 271
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 167
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 137
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 113
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 101
- 2025Easi3R: Estimating Disentangled Motion from DUSt3R Without Trainingcited by 89
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 82
- 2024Align3R: Aligned Monocular Depth Estimation for Dynamic Videoscited by 79
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 70
- 2019Learning Inverse Depth Regression for Multi-View Stereo with Correlation Cost Volumecited by 59
- 2025AerialMegaDepth: Learning Aerial-Ground Reconstruction and View Synthesiscited by 39
- 2024Driv3R: Learning Dense 4D Reconstruction for Autonomous Drivingcited by 28
- 2024PreF3R: Pose-Free Feed-Forward 3D Gaussian Splatting from Variable-length Image Sequencecited by 26
- 2025Test3R: Learning to Reconstruct 3D at Test Timecited by 19
- 2025PE3R: Perception-Efficient 3D Reconstructioncited by 9
- 2025Regist3R: Incremental Registration with Stereo Foundation Modelcited by 9
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2025Towards Geometry-Grounded Dense Semantic Matching with VGGT Priorscited by 3
- 2026UAVFF3D: A Geometry-Aware Benchmark for Feed-Forward UAV 3D Reconstructioncited by 3
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directionscited by 2
- 2026Uncertainty Quality of VGGT: An Analysis on the DTU Benchmark Datasetcited by 1
- 2026Think Locally, Refine Globally for Memory-Efficient 3D Reconstructioncited by 1
- 2026Event3R: Asynchronous-to-Global 3D Reconstruction from Event Camera via Spatial-Temporal Feature Aggregationcited by 0
- 2026HiCo-GS: Hierarchical Context Aggregation and Geometric Consistency for Octree Gaussian Splattingcited by 0
- 2026A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Modelscited by 0
- 2026Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction18 Sep 2026
- 2026A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Models30 Aug 2026
- 2026HiCo-GS: Hierarchical Context Aggregation and Geometric Consistency for Octree Gaussian Splatting14 Aug 2026
- 2026Event3R: Asynchronous-to-Global 3D Reconstruction from Event Camera via Spatial-Temporal Feature Aggregation17 Jul 2026
- 2026Uncertainty Quality of VGGT: An Analysis on the DTU Benchmark Dataset15 Jun 2026
- 2026UAVFF3D: A Geometry-Aware Benchmark for Feed-Forward UAV 3D Reconstruction18 May 2026
- 2026Towards Next-Generation SLAM: A Survey on 3DGS-SLAM Focusing on Performance, Robustness, and Future Directions4 Feb 2026
- 2025Towards Geometry-Grounded Dense Semantic Matching with VGGT Priors25 Sep 2025