Dark3R: Learning Structure from Motion in the Dark
Not on the map. Why?
Abstract (arXiv)
We introduce Dark3R, a framework for structure from motion in the dark that operates directly on raw images with signal-to-noise ratios (SNRs) below -4 dB -- a regime where conventional feature- and learning-based methods break down. Our key insight is to adapt large-scale 3D foundation models to extreme low-light conditions through a teacher--student distillation process, enabling robust feature matching and camera pose estimation in low light. Dark3R requires no 3D supervision; it is trained solely on noisy--clean raw image pairs, which can be either captured directly or synthesized using a simple Poisson--Gaussian noise model applied to well-exposed raw images. To train and evaluate our approach, we introduce a new, exposure-bracketed dataset that includes ~42,000 multi-view raw images with ground-truth 3D annotations, and we demonstrate that Dark3R achieves state-of-the-art structure from motion in the low-SNR regime. Further, we demonstrate state-of-the-art novel view synthesis in the dark using Dark3R's predicted poses and a coarse-to-fine radiance field optimization procedure.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 53 of its 76 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
53 of 76 references.
References · 53
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
38 more
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
- 2016Direct Sparse Odometrycited by 479
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2018Learning to See in the Darkcited by 459
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
- 2023Gaussian Splatting SLAMcited by 410
- 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
- 2018Unprocessing Images for Learned Raw Denoisingcited by 250
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
- 2017Benchmarking Denoising Algorithms with Real Photographscited by 209
- 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2018Residual Dense Network for Image Restorationcited by 181
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 161
- 2017Burst Denoising with Kernel Prediction Networkscited by 156
- 2019Variational Denoising Network: Toward Blind Noise Modeling and Removalcited by 117
- 2021HDR-NeRF: High Dynamic Range Neural Radiance Fieldscited by 113
- 2022ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wildcited by 90
- 2024Stereo4D: Learning How Things Move in 3D from Internet Stereo Videoscited by 89
- 2021Deep Burst Super-Resolutioncited by 83
- 2021PDC-Net+: Enhanced Probabilistic Dense Correspondence Networkcited by 80
- 2022NerfAcc: A General NeRF Acceleration Toolboxcited by 73
- 2025Bolt3D: Generating 3D Scenes in Secondscited by 57
- 2019Handheld Mobile Photography in Very Low Lightcited by 56
- 2024LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometrycited by 54
- 2022NAN: Noise-Aware NeRFs for Burst-Denoisingcited by 48
- 2025Light3R-SfM: Towards Feed-forward Structure-from-Motioncited by 47
- 2024Lighting Every Darkness with 3DGS: Fast Training and Real-Time Rendering for HDR View Synthesiscited by 27
- 2021DF-VO: What Should Be Learnt for Visual Odometry?cited by 22
- 2023Neural Spline Fields for Burst Image Fusion and Layer Separationcited by 16
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.