# MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry

arXiv: https://arxiv.org/abs/2606.02996 · HTML: https://mlsanity.com/paper/2606.02996/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 27 of its 39 references that are in the map.
- First posted on arXiv 2 Jun 2026.

## Builds on (most cited first, 27 of 27)

- [On the Continuity of Rotation Representations in Neural Networks](https://mlsanity.com/paper/1812.07035/) (2018)
- [VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator](https://mlsanity.com/paper/1708.03852/) (2017)
- [Project Aria: A New Tool for Egocentric Multi-Modal AI Research](https://mlsanity.com/paper/2308.13561/) (2023)
- [Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors](https://mlsanity.com/paper/2203.08528/) (2022)
- [Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs](https://mlsanity.com/paper/1703.08014/) (2017)
- [Transformer Inertial Poser: Real-time Human Motion Reconstruction from Sparse IMUs with Simultaneous Terrain Generation](https://mlsanity.com/paper/2203.15720/) (2022)
- [RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, and New Methods](https://mlsanity.com/paper/1905.12853/) (2019)
- [IONet: Learning to Cure the Curse of Drift in Inertial Odometry](https://mlsanity.com/paper/1802.02209/) (2018)
- [TLIO: Tight Learned Inertial Odometry](https://mlsanity.com/paper/2007.01867/) (2020)
- [IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbuds](https://mlsanity.com/paper/2304.12518/) (2023)
- [VINet: Visual-Inertial Odometry as a Sequence-to-Sequence Learning Problem](https://mlsanity.com/paper/1701.08376/) (2017)
- [RIDI: Robust IMU Double Integration](https://mlsanity.com/paper/1712.09004/) (2017)
- [DiffusionPoser: Real-time Human Motion Reconstruction From Arbitrary Sparse Sensors Using Autoregressive Diffusion](https://mlsanity.com/paper/2308.16682/) (2023)
- [Visual-Inertial Navigation: A Concise Review](https://mlsanity.com/paper/1906.02650/) (2019)
- [IDOL: Inertial Deep Orientation-Estimation and Localization](https://mlsanity.com/paper/2102.04024/) (2021)
- [Physical Non-inertial Poser (PNP): Modeling Non-inertial Effects in Sparse-inertial Human Motion Capture](https://mlsanity.com/paper/2404.19619/) (2024)
- [MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices](https://mlsanity.com/paper/2504.12492/) (2025)
- [Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Input](https://mlsanity.com/paper/2504.08449/) (2025)
- [RIO: Rotation-equivariance supervised learning of robust inertial odometry](https://mlsanity.com/paper/2111.11676/) (2021)
- [Improving Global Motion Estimation in Sparse IMU-based Motion Capture with Physics](https://mlsanity.com/paper/2505.05010/) (2025)
- [VQF: Highly Accurate IMU Orientation Estimation with Bias Estimation and Magnetic Disturbance Rejection](https://mlsanity.com/paper/2203.17024/) (2022)
- [LiDAR Odometry Survey: Recent Advancements and Remaining Challenges](https://mlsanity.com/paper/2312.17487/) (2023)
- [AirIO: Learning Inertial Odometry with Enhanced IMU Feature Observability](https://mlsanity.com/paper/2501.15659/) (2025)
- [Transformer IMU Calibrator: Dynamic On-body IMU Calibration for Inertial Motion Capture](https://mlsanity.com/paper/2506.10580/) (2025)
- [MINS: Efficient and Robust Multisensor-aided Inertial Navigation System](https://mlsanity.com/paper/2309.15390/) (2023)
- [BaroPoser: Real-time Human Motion Tracking from IMUs and Barometers in Everyday Devices](https://mlsanity.com/paper/2508.03313/) (2025)
- [MagShield: Towards Better Robustness in Sparse Inertial Motion Capture Under Magnetic Disturbances](https://mlsanity.com/paper/2506.22907/) (2025)

## Abstract (arXiv)

Inertial odometry (IO) using only Inertial Measurement Units (IMUs) provides a lightweight solution for human motion tracking in augmented reality (AR) and wearable devices. Recent learning-based IO methods have improved the generalizability of inertial localization through large-scale pretraining on human motion datasets. However, these approaches remain prone to drift and noise because they do not explicitly capture human motion dynamics, especially on daily activity datasets such as Nymeria. In this work, we propose to ground inertial odometry in human kinematics through a learned IMU-inferred pose prior, which promotes physically consistent motion constraints. We integrate this pose prior into existing IO architectures and reduce positional drift by up to 36% on the challenging Nymeria dataset, which is 5x larger than datasets used in prior work. We further improve long-term performance with a sensor-fusion framework that incorporates auxiliary signals from lightweight sensors already available on commercial AR glasses, including magnetometers, barometers, and secondary IMUs. With this fusion strategy, positional drift is reduced by up to 42%, improving robustness and generalization across diverse motion conditions. Together, our results introduce a new paradigm for inertial and lightweight odometry by unifying human motion kinematics with multimodal sensing, setting a new benchmark for accurate and robust camera-less human tracking. Our website is available at https://spice-lab.org/projects/MARIO/.
