NoDrift3R: Raymap-Guided Coupling for Drift-Robust Unposed Feed-Forward 3D Reconstruction
On the map: World models → World models for autonomous driving
Abstract (arXiv)
Pose-Free Feed-forward 3D Gaussian Splatting (3DGS) has recently emerged as a powerful paradigm for fast scene reconstruction. However, its performance degrades significantly in long image sequences due to cumulative camera pose estimation drift, which propagates errors into geometric modeling and severely limits rendering fidelity. In this work, we revisit the long-sequence bottleneck and identify pose drift as the primary factor restricting reconstruction quality. Furthermore, while SfM-based pseudo ground-truth poses introduce sensor noise, purely rendering-based supervision often leads to optimization instability and local minima due to the entangled optimization of geometry and pose. To address the challenges, we propose a synergistic pose-free framework that explicitly couples geometry and appearance via a Raymap-Guided Coupling Module (RGC). Concretely, we anchor Gaussian centers to raymap-induced geometry and jointly optimize RGB reconstruction, raymap consistency, and camera regularization under a unified objective, yielding a bidirectional feedback loop: stronger geometry improves rendering, and appearance supervision in turn refines geometry and pose. To further stabilize learning across wide temporal ranges, we introduce a Dual-Frequency Viewpoint Scheduling strategy that combines easy-to-hard interval expansion with replay of short-interval pairs. Extensive experiments across in-domain and cross-domain datasets show consistent gains in both rendering and pose estimation, with notably improved robustness on long sequences. Ablation studies validate our central insight: explicitly designed geometry-appearance synergy is the key to scalable and drift-robust pose-free feed-forward 3D reconstruction. Project page: https://xiangyu1sun.github.io/NoDrift3R-project-page/
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 46 of its 52 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
46 of 52 references.
References · 46
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
34 more
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 355
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 248
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
- 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
- 2025Test-Time Training Done Rightcited by 130
- 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 116
- 2024Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splatscited by 114
- 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 70
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 62
- 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 46
- 2024SelfSplat: Pose-Free and 3D Prior-Free Generalizable 3D Gaussian Splattingcited by 42
- 2025No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Viewscited by 40
- 2025YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splattingcited by 37
- 2025Uni3R: Unified 3D Reconstruction and Semantic Understanding via Generalizable Gaussian Splatting from Unposed Multi-View Imagescited by 26
- 2025E-RayZer: Self-supervised 3D Reconstruction as Spatial Visual Pre-trainingcited by 22
- 2025iLRM: An Iterative Large 3D Reconstruction Modelcited by 19
- 2024Generative Densification: Learning to Densify Gaussians for High-Fidelity Generalizable 3D Reconstructioncited by 18
- 2026tttLRM: Test-Time Training for Long Context and Autoregressive 3D Reconstructioncited by 12
- 2025Multi-view Pyramid Transformer: Look Coarser to See Broadercited by 7
- 2025LVT: Large-Scale Scene Reconstruction via Local View Transformerscited by 6
- 2025Selfi: Self Improving Reconstruction Engine via 3D Geometric Feature Alignmentcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 20262Xplat: Decoupling Geometry and Appearance Modeling for Feed-Forward 3D Gaussian Splatting
- 2025Diffusion-Guided Gaussian Splatting for Large-Scale Unconstrained 3D Reconstruction and Novel View Synthesis
- 2026DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given
- 2025FixingGS: Enhancing 3D Gaussian Splatting via Training-Free Score Distillation
- 2026DualSplat: Robust 3D Gaussian Splatting via Pseudo-Mask Bootstrapping from Reconstruction Failures
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
- 2025EA-3DGS: Efficient and Adaptive 3D Gaussians with Highly Enhanced Quality for outdoor scenes
- 2025Breaking the Vicious Cycle: Coherent 3D Gaussian Splatting from Sparse and Motion-Blurred Views