An Evaluation of DUSt3R/MASt3R/VGGT 3D Reconstruction on Photogrammetric Aerial Blocks
Not on the map. Why?
Abstract (arXiv)
State-of-the-art 3D computer vision algorithms continue to advance in handling sparse, unordered image sets. Recently developed foundational models for 3D reconstruction, such as Dense and Unconstrained Stereo 3D Reconstruction (DUSt3R), Matching and Stereo 3D Reconstruction (MASt3R), and Visual Geometry Grounded Transformer (VGGT), have attracted attention due to their ability to handle very sparse image overlaps. Evaluating DUSt3R/MASt3R/VGGT on typical aerial images matters, as these models may handle extremely low image overlaps, stereo occlusions, and textureless regions. For redundant collections, they can accelerate 3D reconstruction by using extremely sparsified image sets. Despite tests on various computer vision benchmarks, their potential on photogrammetric aerial blocks remains unexplored. This paper conducts a comprehensive evaluation of the pre-trained DUSt3R/MASt3R/VGGT models on the aerial blocks of the UseGeo dataset for pose estimation and dense 3D reconstruction. Results show these methods can accurately reconstruct dense point clouds from very sparse image sets (fewer than 10 images, up to 518 pixels resolution), with completeness gains up to +50% over COLMAP. VGGT also demonstrates higher computational efficiency, scalability, and more reliable camera pose estimation. However, all exhibit limitations with high-resolution images and large sets, as pose reliability declines with more images and geometric complexity. These findings suggest transformer-based methods cannot fully replace traditional SfM and MVS, but offer promise as complementary approaches, especially in challenging, low-resolution, and sparse scenarios.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 28 of its 87 references that are in the map. First posted on arXiv 20 Jul 2025.
Builds on
28 of 87 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
16 more
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
- 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 206
- 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 200
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 180
- 2018Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstructioncited by 159
- 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 112
- 2019Deep Mesh Reconstruction from Single RGB Images via Topology Modification Networkscited by 106
- 2019Image-based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Eracited by 87
- 2025AerialMegaDepth: Learning Aerial-Ground Reconstruction and View Synthesiscited by 39
- 2017Learned Multi-Patch Similaritycited by 24
- 2020Self-supervised monocular depth estimation from oblique UAV videoscited by 11
- 2024Image Fusion in Remote Sensing: An Overview and Meta Analysiscited by 10
- 2023Point Cloud Registration for LiDAR and Photogrammetric Data: a Critical Synthesis and Performance Analysis on Classic and Deep Learning Algorithmscited by 7
- 2022A Comparative Study on Deep-Learning Methods for Dense Image Matching of Multi-angle and Multi-date Remote Sensing Stereo Imagescited by 5
- 2019Self-Supervised Learning for Stereo Reconstruction on Aerial Imagescited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025OccuFly: A 3D Vision Benchmark for Semantic Scene Completion from the Aerial Perspectivecited by 5
- 2026Uncertainty Quality of VGGT: An Analysis on the DTU Benchmark Datasetcited by 1
- 2026Geometric Consistency Protocol for Foundation Model Features in Multi-View Satellite Imagerycited by 1
- 2026EO-VGGT: Orbital Ray-Conditioned 3D Foundation Models for Satellite Multi-View Reconstructioncited by 1
- 2026A Comparison of Multi-View Stereo Methods for Photogrammetric 3D Reconstruction: From Traditional to Learning-Based Approachescited by 0
- 2026EO-VGGT: Orbital Ray-Conditioned 3D Foundation Models for Satellite Multi-View Reconstruction1 Jul 2026
- 2026Geometric Consistency Protocol for Foundation Model Features in Multi-View Satellite Imagery16 Jun 2026
- 2026Uncertainty Quality of VGGT: An Analysis on the DTU Benchmark Dataset15 Jun 2026
- 2026A Comparison of Multi-View Stereo Methods for Photogrammetric 3D Reconstruction: From Traditional to Learning-Based Approaches11 Apr 2026
- 2025OccuFly: A 3D Vision Benchmark for Semantic Scene Completion from the Aerial Perspective23 Dec 2025