MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry
Not on the map. Why?
Abstract (arXiv)
Inertial odometry (IO) using only Inertial Measurement Units (IMUs) provides a lightweight solution for human motion tracking in augmented reality (AR) and wearable devices. Recent learning-based IO methods have improved the generalizability of inertial localization through large-scale pretraining on human motion datasets. However, these approaches remain prone to drift and noise because they do not explicitly capture human motion dynamics, especially on daily activity datasets such as Nymeria. In this work, we propose to ground inertial odometry in human kinematics through a learned IMU-inferred pose prior, which promotes physically consistent motion constraints. We integrate this pose prior into existing IO architectures and reduce positional drift by up to 36% on the challenging Nymeria dataset, which is 5x larger than datasets used in prior work. We further improve long-term performance with a sensor-fusion framework that incorporates auxiliary signals from lightweight sensors already available on commercial AR glasses, including magnetometers, barometers, and secondary IMUs. With this fusion strategy, positional drift is reduced by up to 42%, improving robustness and generalization across diverse motion conditions. Together, our results introduce a new paradigm for inertial and lightweight odometry by unifying human motion kinematics with multimodal sensing, setting a new benchmark for accurate and robust camera-less human tracking. Our website is available at https://spice-lab.org/projects/MARIO/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 39 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
27 of 39 references.
References · 27
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 423
- 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 208
- 2022Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensorscited by 146
- 2017Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUscited by 109
- 2022Transformer Inertial Poser: Real-time Human Motion Reconstruction from Sparse IMUs with Simultaneous Terrain Generationcited by 76
- 2019RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, and New Methodscited by 73
- 2018IONet: Learning to Cure the Curse of Drift in Inertial Odometrycited by 55
- 2020TLIO: Tight Learned Inertial Odometrycited by 55
- 2023IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbudscited by 54
- 2017VINet: Visual-Inertial Odometry as a Sequence-to-Sequence Learning Problemcited by 51
- 2017RIDI: Robust IMU Double Integrationcited by 41
15 more
- 2023DiffusionPoser: Real-time Human Motion Reconstruction From Arbitrary Sparse Sensors Using Autoregressive Diffusioncited by 31
- 2019Visual-Inertial Navigation: A Concise Reviewcited by 28
- 2021IDOL: Inertial Deep Orientation-Estimation and Localizationcited by 26
- 2024Physical Non-inertial Poser (PNP): Modeling Non-inertial Effects in Sparse-inertial Human Motion Capturecited by 24
- 2025MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devicescited by 23
- 2025Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Inputcited by 17
- 2021RIO: Rotation-equivariance supervised learning of robust inertial odometrycited by 14
- 2025Improving Global Motion Estimation in Sparse IMU-based Motion Capture with Physicscited by 12
- 2022VQF: Highly Accurate IMU Orientation Estimation with Bias Estimation and Magnetic Disturbance Rejectioncited by 7
- 2023LiDAR Odometry Survey: Recent Advancements and Remaining Challengescited by 7
- 2025AirIO: Learning Inertial Odometry with Enhanced IMU Feature Observabilitycited by 7
- 2025Transformer IMU Calibrator: Dynamic On-body IMU Calibration for Inertial Motion Capturecited by 7
- 2023MINS: Efficient and Robust Multisensor-aided Inertial Navigation Systemcited by 3
- 2025BaroPoser: Real-time Human Motion Tracking from IMUs and Barometers in Everyday Devicescited by 3
- 2025MagShield: Towards Better Robustness in Sparse Inertial Motion Capture Under Magnetic Disturbancescited by 2
Built on by
Not cited yet.