mlsanityData to 7 Oct 2026

Light3R-SfM: Towards Feed-forward Structure-from-Motion

arXiv 2501.14914 ↗First posted 24 Jan 2025cs.CV cs.LGcited by 47

Not on the map. Why?

Abstract (arXiv)

We present Light3R-SfM, a feed-forward, end-to-end learnable framework for efficient large-scale Structure-from-Motion (SfM) from unconstrained image collections. Unlike existing SfM solutions that rely on costly matching and global optimization to achieve accurate 3D reconstructions, Light3R-SfM addresses this limitation through a novel latent global alignment module. This module replaces traditional global optimization with a learnable attention mechanism, effectively capturing multi-view constraints across images for robust and precise camera pose estimation. Light3R-SfM constructs a sparse scene graph via retrieval-score-guided shortest path tree to dramatically reduce memory usage and computational overhead compared to the naive approach. Extensive experiments demonstrate that Light3R-SfM achieves competitive accuracy while significantly reducing runtime, making it ideal for 3D reconstruction tasks in real-world applications with a runtime constraint. This work pioneers a data-driven, feed-forward SfM approach, paving the way toward scalable, accurate, and efficient 3D reconstruction in the wild.

Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). Builds on 36 of its 61 references that are in the map. First posted on arXiv 24 Jan 2025.

Builds on

36 of 61 references.

References · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  6. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  7. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  8. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
  9. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
  10. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  11. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  12. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
24 more
  1. 2023LightGlue: Local Feature Matching at Light Speedcited by 583
  2. 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
  3. 2023CoTracker: It is Better to Track Togethercited by 516
  4. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
  5. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
  6. 2023RoMa: Robust Dense Feature Matchingcited by 296
  7. 20243D Reconstruction with Spatial Memorycited by 269
  8. 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
  9. 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
  10. 2024Global Structure-from-Motion Revisitedcited by 215
  11. 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
  12. 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 174
  13. 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 165
  14. 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
  15. 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 146
  16. 2020Patch2Pix: Epipolar-Guided Pixel-Level Correspondencescited by 128
  17. 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
  18. 2023RelPose++: Recovering 6D Poses from Sparse-view Observationscited by 87
  19. 2022Rethinking Depth Estimation for Multi-View Stereo: A Unified Representationcited by 82
  20. 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizercited by 73
  21. 2023Detector-Free Structure from Motioncited by 71
  22. 2024FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descentcited by 61
  23. 2021A Pose-only Solution to Visual Reconstruction and Navigationcited by 20
  24. 2020Image Retrieval for Structure-from-Motion via Graph Convolutional Networkcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 21; 2026: 26.

47 papers.

Sort:

By area:

  1. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  2. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
  3. 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
  4. 2025Block-Sparse Global Attention for Efficient Multi-View Geometry Transformerscited by 22
  5. 2026VGGT-Omegacited by 20
  6. 2025SAIL-Recon: Large SfM by Augmenting Scene Regression with Localizationcited by 18
  7. 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 16
  8. 2026VGG-T3: Offline Feed-Forward 3D Reconstruction at Scalecited by 14
  9. 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
  10. 2025Alligat0R: Pre-Training Through Co-Visibility Segmentation for Relative Camera Pose Regressioncited by 10
  11. 20253R-GS: Best Practice in Optimizing Camera Poses Along with 3DGScited by 10
  12. 2025Regist3R: Incremental Registration with Stereo Foundation Modelcited by 9
35 more
  1. 20254D-VGGT: A General Foundation Model with SpatioTemporal Awareness for Dynamic Scene Geometry Estimationcited by 8
  2. 2026MVGGT: Multimodal Visual Geometry Grounded Transformer for Multiview 3D Referring Expression Segmentationcited by 8
  3. 2026Flow4R: Unifying 4D Reconstruction and Tracking with Scene Flowcited by 8
  4. 2026LoMa: Local Feature Matching Revisitedcited by 7
  5. 2025E3D-Bench: A Benchmark for End-to-End 3D Geometric Foundation Modelscited by 6
  6. 2025A Scene is Worth a Thousand Features: Feed-Forward Camera Localization from a Collection of Image Featurescited by 4
  7. 2026UFO-4D: Unposed Feedforward 4D Reconstruction from Two Imagescited by 4
  8. 2025Mem4D: Decoupling Static and Dynamic Memory for Dynamic Scene Reconstructioncited by 3
  9. 2025MoRe: Monocular Geometry Refinement via Graph Optimization for Cross-View Consistencycited by 3
  10. 2026Marginalized Bundle Adjustment: Multi-View Camera Pose from Monocular Depth Estimatescited by 3
  11. 2025HuPrior3R: Incorporating Human Priors for Better 3D Dynamic Reconstruction from Monocular Videoscited by 2
  12. 2026LiDAR Prompted Spatio-Temporal Multi-View Stereo for Autonomous Drivingcited by 2
  13. 2026Dark3R: Learning Structure from Motion in the Darkcited by 2
  14. 2026Geometry-Guided Camera Motion Understanding in VideoLLMscited by 2
  15. 2026S-VGGT: Structure-Aware Subscene Decomposition for Scalable 3D Foundation Modelscited by 2
  16. 2025DeblurSplat: SfM-free 3D Gaussian Splatting with Event Camera for Robust Deblurringcited by 1
  17. 2025CuSfM: CUDA-Accelerated Structure-from-Motioncited by 1
  18. 2026Global-Aware Edge Prioritization for Pose Graph Initializationcited by 1
  19. 2026SEAR: Simple and Efficient Adaptation of Visual Geometric Transformers for Unpaired RGB+Thermal 3D Reconstructioncited by 1
  20. 2026G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimationcited by 1
  21. 2026Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparisoncited by 1
  22. 2025Large-scale visual SLAM for in-the-wild videoscited by 0
  23. 2025Not All Pixels Are Equal: Confidence-Guided Attention for Feature Matchingcited by 0
  24. 2025PROFusion: Robust and Accurate Dense Reconstruction via Camera Pose Regression and Optimizationcited by 0
  25. 2026S2D: Sparse to Dense Lifting for 3D Reconstruction with Minimal Inputscited by 0
  26. 2026Seeing Across Skies and Streets: Feedforward 3D Reconstruction from Satellite, Drone, and Ground Imagescited by 0
  27. 2026LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videoscited by 0
  28. 2026EPO: Boosting 3D Foundation Models with Edge-based Pose Optimizationcited by 0
  29. 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assemblycited by 0
  30. 2026Feed-Forward Multi-view Multi-person Reconstruction with Contrastive Human-Aware 3D Representationcited by 0
  31. 2026VI3: Grounding Pretrained 3D Foundation Models with Inertial Cuescited by 0
  32. 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstructioncited by 0
  33. 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priorscited by 0
  34. 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backendcited by 0
  35. 2026QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimationcited by 0