Light3R-SfM: Towards Feed-forward Structure-from-Motion
Not on the map. Why?
Abstract (arXiv)
We present Light3R-SfM, a feed-forward, end-to-end learnable framework for efficient large-scale Structure-from-Motion (SfM) from unconstrained image collections. Unlike existing SfM solutions that rely on costly matching and global optimization to achieve accurate 3D reconstructions, Light3R-SfM addresses this limitation through a novel latent global alignment module. This module replaces traditional global optimization with a learnable attention mechanism, effectively capturing multi-view constraints across images for robust and precise camera pose estimation. Light3R-SfM constructs a sparse scene graph via retrieval-score-guided shortest path tree to dramatically reduce memory usage and computational overhead compared to the naive approach. Extensive experiments demonstrate that Light3R-SfM achieves competitive accuracy while significantly reducing runtime, making it ideal for 3D reconstruction tasks in real-world applications with a runtime constraint. This work pioneers a data-driven, feed-forward SfM approach, paving the way toward scalable, accurate, and efficient 3D reconstruction in the wild.
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). Builds on 36 of its 61 references that are in the map. First posted on arXiv 24 Jan 2025.
Builds on
36 of 61 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
24 more
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2023RoMa: Robust Dense Feature Matchingcited by 296
- 20243D Reconstruction with Spatial Memorycited by 269
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2024Global Structure-from-Motion Revisitedcited by 215
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 174
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
- 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 146
- 2020Patch2Pix: Epipolar-Guided Pixel-Level Correspondencescited by 128
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
- 2023RelPose++: Recovering 6D Poses from Sparse-view Observationscited by 87
- 2022Rethinking Depth Estimation for Multi-View Stereo: A Unified Representationcited by 82
- 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizercited by 73
- 2023Detector-Free Structure from Motioncited by 71
- 2024FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descentcited by 61
- 2021A Pose-only Solution to Visual Reconstruction and Navigationcited by 20
- 2020Image Retrieval for Structure-from-Motion via Graph Convolutional Networkcited by 8
Built on by
Citing papers per year: 2025: 21; 2026: 26.
47 papers.
Sort:
By area:
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
- 2025Block-Sparse Global Attention for Efficient Multi-View Geometry Transformerscited by 22
- 2026VGGT-Omegacited by 20
- 2025SAIL-Recon: Large SfM by Augmenting Scene Regression with Localizationcited by 18
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 16
- 2026VGG-T3: Offline Feed-Forward 3D Reconstruction at Scalecited by 14
- 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
- 2025Alligat0R: Pre-Training Through Co-Visibility Segmentation for Relative Camera Pose Regressioncited by 10
- 20253R-GS: Best Practice in Optimizing Camera Poses Along with 3DGScited by 10
- 2025Regist3R: Incremental Registration with Stereo Foundation Modelcited by 9
35 more
- 20254D-VGGT: A General Foundation Model with SpatioTemporal Awareness for Dynamic Scene Geometry Estimationcited by 8
- 2026MVGGT: Multimodal Visual Geometry Grounded Transformer for Multiview 3D Referring Expression Segmentationcited by 8
- 2026Flow4R: Unifying 4D Reconstruction and Tracking with Scene Flowcited by 8
- 2026LoMa: Local Feature Matching Revisitedcited by 7
- 2025E3D-Bench: A Benchmark for End-to-End 3D Geometric Foundation Modelscited by 6
- 2025A Scene is Worth a Thousand Features: Feed-Forward Camera Localization from a Collection of Image Featurescited by 4
- 2026UFO-4D: Unposed Feedforward 4D Reconstruction from Two Imagescited by 4
- 2025Mem4D: Decoupling Static and Dynamic Memory for Dynamic Scene Reconstructioncited by 3
- 2025MoRe: Monocular Geometry Refinement via Graph Optimization for Cross-View Consistencycited by 3
- 2026Marginalized Bundle Adjustment: Multi-View Camera Pose from Monocular Depth Estimatescited by 3
- 2025HuPrior3R: Incorporating Human Priors for Better 3D Dynamic Reconstruction from Monocular Videoscited by 2
- 2026LiDAR Prompted Spatio-Temporal Multi-View Stereo for Autonomous Drivingcited by 2
- 2026Dark3R: Learning Structure from Motion in the Darkcited by 2
- 2026Geometry-Guided Camera Motion Understanding in VideoLLMscited by 2
- 2026S-VGGT: Structure-Aware Subscene Decomposition for Scalable 3D Foundation Modelscited by 2
- 2025DeblurSplat: SfM-free 3D Gaussian Splatting with Event Camera for Robust Deblurringcited by 1
- 2025CuSfM: CUDA-Accelerated Structure-from-Motioncited by 1
- 2026Global-Aware Edge Prioritization for Pose Graph Initializationcited by 1
- 2026SEAR: Simple and Efficient Adaptation of Visual Geometric Transformers for Unpaired RGB+Thermal 3D Reconstructioncited by 1
- 2026G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimationcited by 1
- 2026Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparisoncited by 1
- 2025Large-scale visual SLAM for in-the-wild videoscited by 0
- 2025Not All Pixels Are Equal: Confidence-Guided Attention for Feature Matchingcited by 0
- 2025PROFusion: Robust and Accurate Dense Reconstruction via Camera Pose Regression and Optimizationcited by 0
- 2026S2D: Sparse to Dense Lifting for 3D Reconstruction with Minimal Inputscited by 0
- 2026Seeing Across Skies and Streets: Feedforward 3D Reconstruction from Satellite, Drone, and Ground Imagescited by 0
- 2026LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videoscited by 0
- 2026EPO: Boosting 3D Foundation Models with Edge-based Pose Optimizationcited by 0
- 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assemblycited by 0
- 2026Feed-Forward Multi-view Multi-person Reconstruction with Contrastive Human-Aware 3D Representationcited by 0
- 2026VI3: Grounding Pretrained 3D Foundation Models with Inertial Cuescited by 0
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstructioncited by 0
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priorscited by 0
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backendcited by 0
- 2026QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimationcited by 0
- 2026QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimation26 Sep 2026
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend17 Sep 2026
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026VI3: Grounding Pretrained 3D Foundation Models with Inertial Cues3 Sep 2026
- 2026Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparison1 Sep 2026
- 2026Feed-Forward Multi-view Multi-person Reconstruction with Contrastive Human-Aware 3D Representation1 Sep 2026
- 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly18 Aug 2026
- 2026EPO: Boosting 3D Foundation Models with Edge-based Pose Optimization1 Jul 2026
- 2026G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimation6 Jun 2026
- 2026LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videos17 May 2026
- 2026VGGT-Omega14 May 2026
35 more
- 2026Seeing Across Skies and Streets: Feedforward 3D Reconstruction from Satellite, Drone, and Ground Images8 May 2026
- 2026LoMa: Local Feature Matching Revisited6 Apr 2026
- 2026SEAR: Simple and Efficient Adaptation of Visual Geometric Transformers for Unpaired RGB+Thermal 3D Reconstruction19 Mar 2026
- 2026S-VGGT: Structure-Aware Subscene Decomposition for Scalable 3D Foundation Models18 Mar 2026
- 2026Geometry-Guided Camera Motion Understanding in VideoLLMs13 Mar 2026
- 2026S2D: Sparse to Dense Lifting for 3D Reconstruction with Minimal Inputs11 Mar 2026
- 2026Dark3R: Learning Structure from Motion in the Dark5 Mar 2026
- 2026LiDAR Prompted Spatio-Temporal Multi-View Stereo for Autonomous Driving4 Mar 2026
- 2026UFO-4D: Unposed Feedforward 4D Reconstruction from Two Images27 Feb 2026
- 2026VGG-T3: Offline Feed-Forward 3D Reconstruction at Scale26 Feb 2026
- 2026Global-Aware Edge Prioritization for Pose Graph Initialization25 Feb 2026
- 2026Marginalized Bundle Adjustment: Multi-View Camera Pose from Monocular Depth Estimates21 Feb 2026
- 2026Flow4R: Unifying 4D Reconstruction and Tracking with Scene Flow15 Feb 2026
- 2026MVGGT: Multimodal Visual Geometry Grounded Transformer for Multiview 3D Referring Expression Segmentation11 Jan 2026
- 2025HuPrior3R: Incorporating Human Priors for Better 3D Dynamic Reconstruction from Monocular Videos6 Dec 2025
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backend25 Nov 2025
- 20254D-VGGT: A General Foundation Model with SpatioTemporal Awareness for Dynamic Scene Geometry Estimation23 Nov 2025
- 2025CuSfM: CUDA-Accelerated Structure-from-Motion17 Oct 2025
- 2025MoRe: Monocular Geometry Refinement via Graph Optimization for Cross-View Consistency8 Oct 2025
- 2025A Scene is Worth a Thousand Features: Feed-Forward Camera Localization from a Collection of Image Features1 Oct 2025
- 2025PROFusion: Robust and Accurate Dense Reconstruction via Camera Pose Regression and Optimization29 Sep 2025
- 2025DeblurSplat: SfM-free 3D Gaussian Splatting with Event Camera for Robust Deblurring23 Sep 2025
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstruction16 Sep 2025
- 2025Block-Sparse Global Attention for Efficient Multi-View Geometry Transformers8 Sep 2025
- 2025SAIL-Recon: Large SfM by Augmenting Scene Regression with Localization25 Aug 2025
- 2025ViPE: Video Pose Engine for 3D Geometric Perception12 Aug 2025
- 2025Mem4D: Decoupling Static and Dynamic Memory for Dynamic Scene Reconstruction11 Aug 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey19 Jul 2025
- 2025E3D-Bench: A Benchmark for End-to-End 3D Geometric Foundation Models2 Jun 2025
- 2025Not All Pixels Are Equal: Confidence-Guided Attention for Feature Matching4 May 2025
- 2025Large-scale visual SLAM for in-the-wild videos29 Apr 2025
- 2025Regist3R: Incremental Registration with Stereo Foundation Model16 Apr 2025
- 20253R-GS: Best Practice in Optimizing Camera Poses Along with 3DGS5 Apr 2025
- 2025Alligat0R: Pre-Training Through Co-Visibility Segmentation for Relative Camera Pose Regression10 Mar 2025
- 2026Geometry-Guided Camera Motion Understanding in VideoLLMscited by 2
- 2026Geometry-Guided Camera Motion Understanding in VideoLLMs13 Mar 2026
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
- 2025Block-Sparse Global Attention for Efficient Multi-View Geometry Transformerscited by 22
- 2026VGGT-Omegacited by 20
- 2025SAIL-Recon: Large SfM by Augmenting Scene Regression with Localizationcited by 18
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 16
- 2026VGG-T3: Offline Feed-Forward 3D Reconstruction at Scalecited by 14
- 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
- 2025Alligat0R: Pre-Training Through Co-Visibility Segmentation for Relative Camera Pose Regressioncited by 10
- 20253R-GS: Best Practice in Optimizing Camera Poses Along with 3DGScited by 10
- 2025Regist3R: Incremental Registration with Stereo Foundation Modelcited by 9
12 most cited of 45 All 45 (JSON)
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend17 Sep 2026
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026VI3: Grounding Pretrained 3D Foundation Models with Inertial Cues3 Sep 2026
- 2026Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparison1 Sep 2026
- 2026Feed-Forward Multi-view Multi-person Reconstruction with Contrastive Human-Aware 3D Representation1 Sep 2026
- 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly18 Aug 2026
- 2026EPO: Boosting 3D Foundation Models with Edge-based Pose Optimization1 Jul 2026
- 2026G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimation6 Jun 2026
- 2026LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videos17 May 2026
- 2026VGGT-Omega14 May 2026
- 2026Seeing Across Skies and Streets: Feedforward 3D Reconstruction from Satellite, Drone, and Ground Images8 May 2026
12 newest of 45 All 45 (JSON)