StreamRig: Exploiting Intra-Rig Geometry for Streaming Multi-Camera Odometry
Not on the map. Why?
Abstract (arXiv)
Mobile robots and vehicles carry synchronized multi-camera rigs, yet many streaming 3D foundation models are designed for monocular input, leaving efficient use of rig geometry a challenge. We present StreamRig, a freeze-and-stream framework that builds causal streaming odometry for calibrated rigs on a frozen multi-view 3D foundation model. The frozen front-end jointly perceives the synchronized views using rig calibration. A Rig-Resampler compresses their features, a CausalBridge applies causal attention with a key-value cache, and a lightweight head regresses rig poses. A periodic re-anchoring protocol supports stable pose estimation over long sequences. Only these modules are trained, 74.6M parameters in total, with relative poses as the sole supervision. Our two-stage training strategy combines group relocalization pretraining with causal rig training to transfer the geometric priors of the frozen front-end and the alignment ability of the pretrained modules to streaming odometry. We evaluate on NCLT, TartanGround, KITTI-360, and our self-collected humanoid-robot dataset ZJH, where training uses only simulation and real-world evaluation is zero-shot. Across all four datasets, StreamRig achieves lower translation and rotation drift than the evaluated non-oracle monocular streaming and rig-aware offline models, while maintaining low inference cost. Ablations and controlled camera-count experiments identify the sources of these gains. We further examine how longer training windows affect inference over longer horizons. Code has been released at https://github.com/WeiYuFei0217/StreamRig.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 26 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
22 of 26 references.
References · 22
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
- 20243D Reconstruction with Spatial Memorycited by 277
- 2025Streaming 4D Visual Geometry Transformercited by 161
10 more
- 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 129
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 82
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 82
- 2026LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstructioncited by 37
- 2025TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigationcited by 36
- 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Poolcited by 35
- 2020Redesigning SLAM for Arbitrary Multi-Camera Systemscited by 13
- 2026HorizonStream: Long-Horizon Attention for Streaming 3D Reconstructioncited by 9
- 2022Design and Evaluation of a Generic Visual SLAM Framework for Multi-Camera Systemscited by 4
- 2026G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026NeuRIO: A Streaming Neural Estimator for Zero-Shot Sim-to-Real Multi-Robot Relative Inertial Odometry ↗
- 2026PoseFM: Relative Camera Pose Estimation Through Flow Matching
- 2026VOCA: Visual Odometry with Codec Awareness
- 2024Leveraging Consistent Spatio-Temporal Correspondence for Robust Visual Odometry
- 2026OVGGT: O(1) Constant-Cost Streaming Visual Geometry Transformer
- 2025UNO: Unified Self-Supervised Monocular Odometry for Platform-Agnostic Deployment
- 2026TRIG: Trajectory-Rig Decoupled Metric Geometry Learning
- 2024Robust Monocular Visual Odometry using Curriculum Learning