# PO-MSCKF: An Efficient Visual-Inertial Odometry by Reconstructing the Multi-State Constrained Kalman Filter with the Pose-only Theory

arXiv: https://arxiv.org/abs/2407.01888 · HTML: https://mlsanity.com/paper/2407.01888/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 10 of its 39 references that are in the map.
- First posted on arXiv 2 Jul 2024.

## Builds on (most cited first, 10 of 10)

- [ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM](https://mlsanity.com/paper/2007.11898/) (2020)
- [Direct Sparse Odometry](https://mlsanity.com/paper/1607.02565/) (2016)
- [VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator](https://mlsanity.com/paper/1708.03852/) (2017)
- [Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mapping](https://mlsanity.com/paper/1910.02490/) (2019)
- [Visual-Inertial Mapping with Non-Linear Factor Recovery](https://mlsanity.com/paper/1904.06504/) (2019)
- [Direct Sparse Visual-Inertial Odometry using Dynamic Marginalization](https://mlsanity.com/paper/1804.05625/) (2018)
- [Robust Stereo Visual Inertial Odometry for Fast Autonomous Flight](https://mlsanity.com/paper/1712.00036/) (2017)
- [A Pose-only Solution to Visual Reconstruction and Navigation](https://mlsanity.com/paper/2103.01530/) (2021)
- [Equivalent Constraints for Two-View Geometry: Pose Solution/Pure Rotation Identification and 3D Reconstruction](https://mlsanity.com/paper/1810.05863/) (2018)
- [EqVIO: An Equivariant Filter for Visual Inertial Odometry](https://mlsanity.com/paper/2205.01980/) (2022)

## Built on by (most cited first, 1 of 1)

- [Understanding Sensor Vulnerabilities in Industrial XR Tracking](https://mlsanity.com/paper/2602.14413/) (2026)

## Abstract (arXiv)

Efficient Visual-Inertial Odometry (VIO) is crucial for payload-constrained robots. Though modern optimization-based algorithms have achieved superior accuracy, the MSCKF-based VIO algorithms are still widely demanded for their efficient and consistent performance. As MSCKF is built upon the conventional multi-view geometry, the measured residuals are not only related to the state errors but also related to the feature position errors. To apply EKF fusion, a projection process is required to remove the feature position error from the observation model, which can lead to model and accuracy degradation. To obtain an efficient visual-inertial fusion model, while also preserving the model consistency, we propose to reconstruct the MSCKF VIO with the novel Pose-Only (PO) multi-view geometry description. In the newly constructed filter, we have modeled PO reprojection residuals, which are solely related to the motion states and thus overcome the requirements of space projection. Moreover, the new filter does not require any feature position information, which removes the computational cost and linearization errors brought in by the 3D reconstruction procedure. We have conducted comprehensive experiments on multiple datasets, where the proposed method has shown accuracy improvements and consistent performance in challenging sequences.