VI3: Grounding Pretrained 3D Foundation Models with Inertial Cues
Not on the map. Why?
Abstract (arXiv)
3D foundation models (3DFMs) excel at predicting camera poses and dense depth from multiple views of a scene, showcasing strong zero-shot generalization. However, as metric scale is not observable from monocular images, their absolute scale predictions are typically inaccurate. Inertial measurement units (IMUs), present in most devices, naturally complement monocular cameras by observing scaled motion. We introduce VI3, a model-agnostic framework that metrically anchors a pretrained 3DFM using only IMU readings. VI3 initializes and preintegrates the IMU to obtain a metric motion reference, which is then used to recover the scale of the 3DFM outputs. Our method includes adaptable anchoring strategies tailored to diverse 3DFM architectures. Experiments on synthetic and real aerial datasets demonstrate that VI3 recovers metric scale without ground-truth supervision while preserving geometric consistency, acting as a fine refinement under well-conditioned motion and as a strong prior when motion is less informative.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 54 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
45 of 54 references.
References · 45
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 423
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
33 more
- 20243D Reconstruction with Spatial Memorycited by 277
- 2024Global Structure-from-Motion Revisitedcited by 218
- 2025Streaming 4D Visual Geometry Transformercited by 161
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 141
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 141
- 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 129
- 2025Cameras as Relative Positional Encodingcited by 105
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 102
- 2015On-Manifold Preintegration for Real-Time Visual-Inertial Odometrycited by 95
- 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 87
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 82
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 79
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 78
- 2024GeoCalib: Learning Single-image Calibration with Geometric Optimizationcited by 52
- 2025Light3R-SfM: Towards Feed-forward Structure-from-Motioncited by 47
- 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
- 2026LoGeR: Long-Context Geometric Reconstruction with Hybrid Memorycited by 39
- 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Poolcited by 35
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 35
- 2026ZipMap: Linear-Time Stateful 3D Reconstruction via Test-Time Trainingcited by 26
- 2025OmniVGGT: Omni-Modality Driven Visual Geometry Grounded Transformercited by 22
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 20
- 2025ViT3: Unlocking Test-Time Training in Visioncited by 18
- 2024NeRFs in Robotics: A Surveycited by 16
- 2025Evict3R: Training-Free Token Eviction for Memory-Bounded Streaming Visual Geometry Transformerscited by 14
- 2025G-CUT3R: Guided 3D Reconstruction with Camera and Depth Prior Integrationcited by 12
- 2025A Guide to Structureless Visual Localizationcited by 9
- 2025MASt3R-Fusion: Integrating Feed-Forward Visual Model with IMU, GNSS for High-Functionality SLAMcited by 6
- 2025VIGS-SLAM: Visual Inertial Gaussian Splatting SLAMcited by 6
- 2025Puzzles: Unbounded Video-Depth Augmentation for Scalable End-to-End 3D Reconstructioncited by 5
- 2025OKVIS2-X: Open Keyframe-based Visual-Inertial SLAM Configurable with Dense Depth or LiDAR, and GNSScited by 4
- 2025An Efficient Closed-Form Solution to Full Visual-Inertial State Initializationcited by 2
- 2026UniScale: Unified Scale-Aware 3D Reconstruction for Multi-View Understanding via Prior Injection for Robotic Perceptioncited by 2
Built on by
Not cited yet.