MPVO: Motion-Prior based Visual Odometry for PointGoal Navigation
Not on the map. Why?
Abstract (arXiv)
Visual odometry (VO) is essential for enabling accurate point-goal navigation of embodied agents in indoor environments where GPS and compass sensors are unreliable and inaccurate. However, traditional VO methods face challenges in wide-baseline scenarios, where fast robot motions and low frames per second (FPS) during inference hinder their performance, leading to drift and catastrophic failures in point-goal navigation. Recent deep-learned VO methods show robust performance but suffer from sample inefficiency during training; hence, they require huge datasets and compute resources. So, we propose a robust and sample-efficient VO pipeline based on motion priors available while an agent is navigating an environment. It consists of a training-free action-prior based geometric VO module that estimates a coarse relative pose which is further consumed as a motion prior by a deep-learned VO model, which finally produces a fine relative pose to be used by the navigation policy. This strategy helps our pipeline achieve up to 2x sample efficiency during training and demonstrates superior accuracy and robustness in point-goal navigation tasks compared to state-of-the-art VO method(s). Realistic indoor environments of the Gibson dataset is used in the AI-Habitat simulator to evaluate the proposed approach using navigation metrics (like success/SPL) and pose metrics (like RPE/ATE). We hope this method further opens a direction of work where motion priors from various sources can be utilized to improve VO estimates and achieve better results in embodied navigation tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 33 references that are in the map. First posted on arXiv 7 Nov 2024.
Builds on
23 of 33 references.
References · 23
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2018On Evaluation of Embodied Navigation Agentscited by 547
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 481
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
- 2020Learning to Explore using Active Neural SLAMcited by 316
- 2020DISK: Learning local features with policy gradientcited by 312
- 2020TEASER: Fast and Certifiable Point Cloud Registrationcited by 274
- 2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
- 2020ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objectscited by 244
11 more
- 2017Cognitive Mapping and Planning for Visual Navigationcited by 212
- 2017DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networkscited by 175
- 2020Rearrangement: A Challenge for Embodied AIcited by 155
- 2020TartanVO: A Generalizable Learning-based VOcited by 108
- 2021UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Renderingcited by 44
- 2022Is Mapping Necessary for Realistic PointGoal Navigation?cited by 35
- 2021Differentiable SLAM-net: Learning Particle SLAM for Visual Navigationcited by 34
- 2020Integrating Egocentric Localization for More Realistic Point-Goal Navigation Agentscited by 27
- 2021The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigationcited by 27
- 2022DoRO: Disambiguation of referred object for embodied agentscited by 5
- 2024Teledrive: An Embodied AI based Telepresence Systemcited by 1
Built on by
Not cited yet.