DarkVGGT: Seeing Through Darkness Using Thermal Geometry
Not on the map. Why?
Abstract (arXiv)
Recent feed-forward 3D reconstruction methods have demonstrated strong performance and flexibility in efficient end-to-end scene geometry estimation from image streams. However, their reliance on visible-light appearance makes them vulnerable in dark and low-visibility environments, where RGB cues are severely degraded and geometric evidence becomes ambiguous. To address this challenge, we propose DarkVGGT, a structured RGB-T adaptation of pretrained VGGT for robust 3D estimation in low-light scenes. DarkVGGT introduces two complementary modules. First, complementary thermal feature factorization processes thermal tokens through content-preserving and high-frequency residual pathways controlled by learned complementary allocation weights. Second, geometry-shared thermal routing aligns RGB and thermal representations in a shared latent space and selectively injects a gated feature correction into the RGB stream. Together, these components enable accurate thermal-informed geometry estimation under degraded RGB conditions while largely preserving performance in well-lit environments. Experiments on low-visibility RGB-T benchmarks demonstrate consistent improvements in both depth and camera pose estimation over existing feed-forward geometry baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 63 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
41 of 63 references.
References · 41
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 20243D Reconstruction with Spatial Memorycited by 277
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
29 more
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 162
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 141
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 136
- 2024Multimodal Fusion on Low-quality Data: A Comprehensive Surveycited by 49
- 2022ViViD++: Vision for Visibility Datasetcited by 34
- 2024DrivingRecon: Large 4D Gaussian Reconstruction Model For Autonomous Drivingcited by 29
- 2026Masked Depth Modeling for Spatial Perceptioncited by 28
- 2021Self-Supervised Depth and Ego-Motion Estimation for Monocular Thermal Video Using Multi-Spectral Consistency Losscited by 16
- 2024Thermal3D-GS: Physics-induced 3D Gaussians for Thermal Infrared Novel-view Synthesiscited by 16
- 2025ThermalGen: Style-Disentangled Flow-Based Generative Models for RGB-to-Thermal Image Translationcited by 14
- 2023RGB-D And Thermal Sensor Fusion: A Systematic Literature Reviewcited by 13
- 2024ThermalNeRF: Thermal Radiance Fieldscited by 13
- 2024ThermalGaussian: Thermal 3D Gaussian Splattingcited by 13
- 2023Humans as Light Bulbs: 3D Human Reconstruction from Thermal Reflectioncited by 10
- 2026Robo3R: Enhancing Robotic Manipulation with Accurate Feed-Forward 3D Reconstructioncited by 9
- 2026MoRe: Motion-aware Feed-forward 4D Reconstruction Transformercited by 9
- 2024Pedestrian Detection in Low-Light Conditions: A Comprehensive Surveycited by 8
- 2025VR-Drive: Viewpoint-Robust End-to-End Driving with Feed-Forward 3D Gaussian Splattingcited by 6
- 2025MonoTher-Depth: Enhancing Thermal Depth Estimation via Confidence-Aware Distillationcited by 5
- 2026AnyThermal: Towards Learning Universal Representations for Thermal Perceptioncited by 5
- 2026EventVGGT: Exploring Cross-Modal Distillation for Consistent Event-based Depth Estimationcited by 5
- 2024ThermoNeRF: Joint RGB and Thermal Novel View Synthesis for Building Facades using Multimodal Neural Radiance Fieldscited by 3
- 2025Bridging Spectral-wise and Multi-spectral Depth Estimation via Geometry-guided Contrastive Learningcited by 3
- 2025EAG3R: Event-Augmented 3D Geometry Estimation for Dynamic and Extreme-Lighting Scenescited by 3
- 2026Dark3R: Learning Structure from Motion in the Darkcited by 2
- 2026SEAR: Simple and Efficient Adaptation of Visual Geometric Transformers for Unpaired RGB+Thermal 3D Reconstructioncited by 2
- 2022Unsupervised Visible-light Images Guided Cross-Spectrum Depth Estimation from Dual-Modality Camerascited by 1
- 2025MrGS: Multi-modal Radiance Fields with 3D Gaussian Splatting for RGB-Thermal Novel View Synthesiscited by 1
Built on by
Not cited yet.