mlsanityData to 13 Oct 2026

Review of Feed-forward 3D Reconstruction: From DUSt3R to VGGT

arXiv 2507.08448 ↗First posted 11 Jul 2025cs.CV cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

3D reconstruction, which aims to recover the dense three-dimensional structure of a scene, is a cornerstone technology for numerous applications, including augmented/virtual reality, autonomous driving, and robotics. While traditional pipelines like Structure from Motion (SfM) and Multi-View Stereo (MVS) achieve high precision through iterative optimization, they are limited by complex workflows, high computational cost, and poor robustness in challenging scenarios like texture-less regions. Recently, deep learning has catalyzed a paradigm shift in 3D reconstruction. A new family of models, exemplified by DUSt3R, has pioneered a feed-forward approach. These models employ a unified deep network to jointly infer camera poses and dense geometry directly from an Unconstrained set of images in a single forward pass. This survey provides a systematic review of this emerging domain. We begin by dissecting the technical framework of these feed-forward models, including their Transformer-based correspondence modeling, joint pose and geometry regression mechanisms, and strategies for scaling from two-view to multi-view scenarios. To highlight the disruptive nature of this new paradigm, we contrast it with both traditional pipelines and earlier learning-based methods like MVSNet. Furthermore, we provide an overview of relevant datasets and evaluation metrics. Finally, we discuss the technology's broad application prospects and identify key future challenges and opportunities, such as model accuracy and scalability, and handling dynamic scenes.

Key facts. Cited by 8 papers in the map (data through 13 Oct 2026). Builds on 40 of its 53 references that are in the map. First posted on arXiv 11 Jul 2025.

Builds on

40 of 53 references.

References · 40

  1. 2017Attention Is All You Needcited by 60,106
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,096
  4. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,440
  5. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,539
  6. 2019Habitat: A Platform for Embodied AI Researchcited by 1,169
  7. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 979
  8. 2024Grounding Image Matching in 3D with MASt3Rcited by 965
  9. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 895
  10. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 879
  11. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 782
  12. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 752
28 more
  1. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 732
  2. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 648
  3. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 557
  4. 2025Continuous 3D Perception Model with Persistent Statecited by 534
  5. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 521
  6. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 488
  7. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 445
  8. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 437
  9. 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
  10. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 358
  11. 2020Virtual KITTI 2cited by 349
  12. 20243D Reconstruction with Spatial Memorycited by 271
  13. 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 167
  14. 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
  15. 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 137
  16. 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 113
  17. 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 101
  18. 2025Easi3R: Estimating Disentangled Motion from DUSt3R Without Trainingcited by 89
  19. 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 82
  20. 2024Align3R: Aligned Monocular Depth Estimation for Dynamic Videoscited by 79
  21. 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 70
  22. 2019Learning Inverse Depth Regression for Multi-View Stereo with Correlation Cost Volumecited by 59
  23. 2025AerialMegaDepth: Learning Aerial-Ground Reconstruction and View Synthesiscited by 39
  24. 2024Driv3R: Learning Dense 4D Reconstruction for Autonomous Drivingcited by 28
  25. 2024PreF3R: Pose-Free Feed-Forward 3D Gaussian Splatting from Variable-length Image Sequencecited by 26
  26. 2025Test3R: Learning to Reconstruct 3D at Test Timecited by 19
  27. 2025PE3R: Perception-Efficient 3D Reconstructioncited by 9
  28. 2025Regist3R: Incremental Registration with Stereo Foundation Modelcited by 9

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.