Glob3R: Global Structure-from-Motion with 3D Foundation Models
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Recent 3D geometric foundation models, such as VGGT, provide robust feed-forward 3D reconstruction by directly predicting camera poses and 3D scene points from input images. However, their results remain inaccurate, and scaling them to long sequences or large unordered image sets typically requires chunk-wise processing, which can introduce drift and inconsistency. We present Glob3R, a global SfM-style reconstruction built on 3D foundation models. Our key idea is to explicitly optimize feed-forward geometric predictions. To this end, we augment a frozen Pi3X backbone with a lightweight dense matching head that predicts image warps between selected reference frames and neighboring views. These dense warps are converted into sparse but reliable multi-view feature tracks, which provide correspondence constraints for global optimization. We further introduce a keyframe-based sliding-window association strategy that propagates tracks and relative poses across overlapping windows, enabling scalable reconstruction. Finally, we perform global motion averaging and bundle adjustment to refine camera poses, reduce scale inconsistencies, and recover dense scene geometry. Extensive experiments on indoor, outdoor, large-scale driving, and unordered SfM benchmarks demonstrate that Glob3R achieves robust and accurate reconstruction. It consistently improves over feed-forward foundation-model baselines and recent scalable reconstruction methods, while being more robust than classical SfM pipelines. The refined poses also lead to higher-quality neural rendering, validating the benefit of combining foundation-model priors with global geometric optimization. Project page: https://junyuandeng.github.io/Glob3r
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 59 of its 71 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
59 of 71 references.
Closest ancestors · 1
Same direction, newest first
Other references · 58
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
38 more
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2020Virtual KITTI 2cited by 345
- 2023RoMa: Robust Dense Feature Matchingcited by 296
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2024Global Structure-from-Motion Revisitedcited by 215
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
- 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
- 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 174
- 2018BA-Net: Dense Bundle Adjustment Networkcited by 173
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
- 2023Optimal Transport Aggregation for Visual Place Recognitioncited by 151
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 130
- 2021SMD-Nets: Stereo Mixture Density Networkscited by 118
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 113
- 2025VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequencescited by 107
- 2025FastVGGT: Training-Free Acceleration of Visual Geometry Transformercited by 93
- 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 82
- 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizercited by 73
- 2023Detector-Free Structure from Motioncited by 71
- 2019DeepSFM: Structure From Motion Via Deep Bundle Adjustmentcited by 70
- 2024FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descentcited by 61
- 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 44
- 2023NeRF-LOAM: Neural Implicit Representation for Large-Scale Incremental LiDAR Odometry and Mappingcited by 41
- 2026LoGeR: Long-Context Geometric Reconstruction with Hybrid Memorycited by 33
- 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Poolcited by 32
- 2026LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstructioncited by 32
- 2026Scal3R: Scalable Test-Time Training for Large-Scale 3D Reconstructioncited by 25
- 2026VGGT-SLAM 2.0: Real-time Dense Feed-forward Scene Reconstructioncited by 22
- 2025MoRE: 3D Visual Geometry Reconstruction Meets Mixture-of-Expertscited by 19
- 2025SAIL-Recon: Large SfM by Augmenting Scene Regression with Localizationcited by 18
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Speed3R: Sparse Feed-forward 3D Reconstruction Models
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective
- 2026CAM3R: Camera-Agnostic Model for 3D Reconstruction
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories
- 2026Surflo: Consistent 3D Surface Flow Model with Global State
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Rendering
- 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Models
- 2026GeoWM: Efficient Direct World Modeling in Explicit Geometry