# TLIO: Tight Learned Inertial Odometry

arXiv: https://arxiv.org/abs/2007.01867 · HTML: https://mlsanity.com/paper/2007.01867/

## Key facts

- Cited by 55 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 6 Jul 2020.

## Built on by (most cited first, 30 of 55)

- [IDOL: Inertial Deep Orientation-Estimation and Localization](https://mlsanity.com/paper/2102.04024/) (2021)
- [Bayesian Deep Basis Fitting for Depth Completion with Uncertainty](https://mlsanity.com/paper/2103.15254/) (2021)
- [Deep Learning for Inertial Positioning: A Survey](https://mlsanity.com/paper/2303.03757/) (2023)
- [Towards Scale-Aware, Robust, and Generalizable Unsupervised Monocular Depth Estimation by Integrating IMU Motion Dynamics](https://mlsanity.com/paper/2207.04680/) (2022)
- [EV-Catcher: High-Speed Object Catching Using Low-latency Event-based Neural Networks](https://mlsanity.com/paper/2304.07200/) (2023)
- [Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling](https://mlsanity.com/paper/2402.10211/) (2024)
- [RIO: Rotation-equivariance supervised learning of robust inertial odometry](https://mlsanity.com/paper/2111.11676/) (2021)
- [Neural Inertial Localization](https://mlsanity.com/paper/2203.15851/) (2022)
- [CTIN: Robust Contextual Transformer Network for Inertial Navigation](https://mlsanity.com/paper/2112.02143/) (2021)
- [IMU Data Processing For Inertial Aided Navigation: A Recurrent Neural Network Based Approach](https://mlsanity.com/paper/2103.14286/) (2021)
- [Chat2Map: Efficient Scene Mapping from Multi-Ego Conversations](https://mlsanity.com/paper/2301.02184/) (2023)
- [EqNIO: Subequivariant Neural Inertial Odometry](https://mlsanity.com/paper/2408.06321/) (2024)
- [AirIO: Learning Inertial Odometry with Enhanced IMU Feature Observability](https://mlsanity.com/paper/2501.15659/) (2025)
- [Recent Advancements in Deep Learning Applications and Methods for Autonomous Navigation: A Comprehensive Review](https://mlsanity.com/paper/2302.11089/) (2023)
- [AirIMU: Learning Uncertainty Propagation for Inertial Odometry](https://mlsanity.com/paper/2310.04874/) (2023)
- [VIPose: Real-time Visual-Inertial 6D Object Pose Tracking](https://mlsanity.com/paper/2107.12617/) (2021)
- [Learned Monocular Depth Priors in Visual-Inertial Initialization](https://mlsanity.com/paper/2204.09171/) (2022)
- [Aria-NeRF: Multimodal Egocentric View Synthesis](https://mlsanity.com/paper/2311.06455/) (2023)
- [Legged Robot State Estimation With Invariant Extended Kalman Filter Using Neural Measurement Network](https://mlsanity.com/paper/2402.00366/) (2024)
- [MARG: MAstering Risky Gap Terrains for Legged Robots with Elevation Mapping](https://mlsanity.com/paper/2509.20036/) (2025)
- [LGC-Net: A Lightweight Gyroscope Calibration Network for Efficient Attitude Estimation](https://mlsanity.com/paper/2209.08816/) (2022)
- [Deep Single Image Camera Calibration by Heatmap Regression to Recover Fisheye Images Under Manhattan World Assumption](https://mlsanity.com/paper/2303.17166/) (2023)
- [RetailOpt: Opt-In, Easy-to-Deploy Trajectory Estimation from Smartphone Motion Data and Retail Facility Information](https://mlsanity.com/paper/2404.12548/) (2024)
- [Learning IMU Bias with Diffusion Model](https://mlsanity.com/paper/2505.11763/) (2025)
- [Learnable Spatio-Temporal Map Embeddings for Deep Inertial Localization](https://mlsanity.com/paper/2211.07635/) (2022)
- [Physics-Informed Data Denoising for Real-Life Sensing Systems](https://mlsanity.com/paper/2311.06968/) (2023)
- [Multiple and Gyro-Free Inertial Datasets](https://mlsanity.com/paper/2403.15494/) (2024)
- [3D Freehand Ultrasound using Visual Inertial and Deep Inertial Odometry for Measuring Patellar Tracking](https://mlsanity.com/paper/2404.15847/) (2024)
- [Egocentric Action-aware Inertial Localization in Point Clouds with Vision-Language Guidance](https://mlsanity.com/paper/2505.14346/) (2025)
- [Physical Self-Supervised Learning: IMU Sensing without Manual Labels](https://mlsanity.com/paper/2607.18361/) (2026)

## Abstract (arXiv)

In this work we propose a tightly-coupled Extended Kalman Filter framework for IMU-only state estimation. Strap-down IMU measurements provide relative state estimates based on IMU kinematic motion model. However the integration of measurements is sensitive to sensor bias and noise, causing significant drift within seconds. Recent research by Yan et al. (RoNIN) and Chen et al. (IONet) showed the capability of using trained neural networks to obtain accurate 2D displacement estimates from segments of IMU data and obtained good position estimates from concatenating them. This paper demonstrates a network that regresses 3D displacement estimates and its uncertainty, giving us the ability to tightly fuse the relative state measurement into a stochastic cloning EKF to solve for pose, velocity and sensor biases. We show that our network, trained with pedestrian data from a headset, can produce statistically consistent measurement and uncertainty to be used as the update step in the filter, and the tightly-coupled system outperforms velocity integration approaches in position estimates, and AHRS attitude filter in orientation estimates.
