RD-VIO: Robust Visual-Inertial Odometry for Mobile Augmented Reality in Dynamic Environments
Not on the map. Why?
Abstract (arXiv)
It is typically challenging for visual or visual-inertial odometry systems to handle the problems of dynamic scenes and pure rotation. In this work, we design a novel visual-inertial odometry (VIO) system called RD-VIO to handle both of these two problems. Firstly, we propose an IMU-PARSAC algorithm which can robustly detect and match keypoints in a two-stage process. In the first state, landmarks are matched with new keypoints using visual and IMU measurements. We collect statistical information from the matching and then guide the intra-keypoint matching in the second stage. Secondly, to handle the problem of pure rotation, we detect the motion type and adapt the deferred-triangulation technique during the data-association process. We make the pure-rotational frames into the special subframes. When solving the visual-inertial bundle adjustment, they provide additional constraints to the pure-rotational motion. We evaluate the proposed VIO system on public datasets and online comparison. Experiments show the proposed RD-VIO has obvious advantages over other methods in dynamic environments. The source code is available at: hrefhttps://github.com/openxrlab/xrslamfontfamilypcrselectfont https://github.com/openxrlab/xrslam.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 27 of its 60 references that are in the map. First posted on arXiv 23 Oct 2023.
Builds on
27 of 60 references.
References · 27
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
- 2023Co-SLAM: Joint Coordinate and Sparse Parametric Encodings for Neural Real-Time SLAMcited by 183
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2022Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representationcited by 149
- 2018DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenescited by 130
- 2015On-Manifold Preintegration for Real-Time Visual-Inertial Odometrycited by 95
- 2018MaskFusion: Real-Time Recognition, Tracking and Reconstruction of Multiple Moving Objectscited by 95
15 more
- 2018DS-SLAM: A Semantic Visual SLAM towards Dynamic Environmentscited by 90
- 2022Vox-Surf: Voxel-based Implicit Surface Representationcited by 49
- 2020DynaSLAM II: Tightly-Coupled Multi-Object Tracking and SLAMcited by 47
- 2019A General Optimization-based Framework for Local Odometry Estimation with Multiple Sensorscited by 44
- 2019A General Optimization-based Framework for Global Pose Estimation with Multiple Sensorscited by 41
- 2018Direct Sparse Visual-Inertial Odometry using Dynamic Marginalizationcited by 34
- 2016Visual-Inertial Monocular SLAM with Map Reusecited by 32
- 2022PVO: Panoptic Visual Odometrycited by 26
- 2018ADVIO: An authentic dataset for visual-inertial odometrycited by 22
- 2022DM-VIO: Delayed Marginalization Visual-Inertial Odometrycited by 22
- 2020PL-VINS: Real-Time Monocular Visual-Inertial SLAM with Point and Line Featurescited by 15
- 2022DynaVINS: A Visual-Inertial SLAM for Dynamic Environmentscited by 11
- 2018Robocentric Visual-Inertial Odometrycited by 7
- 2023RGB-D Inertial Odometry for a Resource-Restricted Robot in Dynamic Environmentscited by 5
- 2021RP-VIO: Robust Plane-based Visual-Inertial Odometry for Dynamic Environmentscited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 3.
9 papers.
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Visioncited by 37
- 2024DVLO: Deep Visual-LiDAR Odometry with Local-to-Global Feature Fusion and Bi-Directional Structure Alignmentcited by 25
- 2026CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperationcited by 4
- 2025EGG-Fusion: Efficient 3D Reconstruction with Geometry-aware Gaussian Surfel on the Flycited by 3
- 2025Sketch3DVE: Sketch-based 3D-Aware Scene Video Editingcited by 2
- 2025Generative Augmented Reality: Paradigms, Technologies, and Future Applicationscited by 1
- 2024STAG-VIO: Stabilized Prompt-to-Geometry Interface for Robust Dynamic Visual--Inertial Odometrycited by 0
- 2026Understanding Sensor Vulnerabilities in Industrial XR Trackingcited by 0
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraintscited by 0
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraints5 Jun 2026
- 2026Understanding Sensor Vulnerabilities in Industrial XR Tracking16 Feb 2026
- 2026CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperation13 Feb 2026
- 2025EGG-Fusion: Efficient 3D Reconstruction with Geometry-aware Gaussian Surfel on the Fly1 Dec 2025
- 2025Generative Augmented Reality: Paradigms, Technologies, and Future Applications20 Nov 2025
- 2025Sketch3DVE: Sketch-based 3D-Aware Scene Video Editing19 Aug 2025
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Vision3 Apr 2025
- 2024STAG-VIO: Stabilized Prompt-to-Geometry Interface for Robust Dynamic Visual--Inertial Odometry28 Nov 2024
- 2024DVLO: Deep Visual-LiDAR Odometry with Local-to-Global Feature Fusion and Bi-Directional Structure Alignment27 Mar 2024