Legged Robot State Estimation With Invariant Extended Kalman Filter Using Neural Measurement Network
Not on the map. Why?
Abstract (arXiv)
This paper introduces a novel proprioceptive state estimator for legged robots that combines model-based filters and deep neural networks. Recent studies have shown that neural networks such as multi-layer perceptron or recurrent neural networks can estimate the robot states, including contact probability and linear velocity. Inspired by this, we develop a state estimation framework that integrates a neural measurement network (NMN) with an invariant extended Kalman filter. We show that our framework improves estimation performance in various terrains. Existing studies that combine model-based filters and learning-based approaches typically use real-world data. However, our approach relies solely on simulation data, as it allows us to easily obtain extensive data. This difference leads to a gap between the learning and the inference domain, commonly referred to as a sim-to-real gap. We address this challenge by adapting existing learning techniques and regularization. To validate our proposed method, we conduct experiments using a quadruped robot on four types of terrain: textitflat, textitdebris, textitsoft, and textitslippery. We observe that our approach significantly reduces position drift compared to the existing model-based state estimator.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 28 of its 42 references that are in the map. First posted on arXiv 1 Feb 2024.
Builds on
28 of 42 references.
References · 28
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 494
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 418
- 2015On-Manifold Preintegration for Real-Time Visual-Inertial Odometrycited by 95
- 2021Blind Bipedal Stair Traversal via Sim-to-Real Reinforcement Learningcited by 73
- 2019RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, and New Methodscited by 72
- 2022Concurrent Training of a Control Policy and a State Estimator for Dynamic and Robust Legged Locomotioncited by 61
- 2020TLIO: Tight Learned Inertial Odometrycited by 53
- 2018IONet: Learning to Cure the Curse of Drift in Inertial Odometrycited by 52
- 2020Regularizing Action Policies for Smooth Control with Reinforcement Learningcited by 47
16 more
- 2023Not Only Rewards But Also Constraints: Applications on Legged Robot Locomotioncited by 33
- 2017Quaternion kinematics for the error-state Kalman filtercited by 30
- 2019AI-IMU Dead-Reckoningcited by 27
- 2020Denoising IMU Gyroscopes with Deep Learning for Open-Loop Attitude Estimationcited by 26
- 2021IDOL: Inertial Deep Orientation-Estimation and Localizationcited by 26
- 2021VILENS: Visual, Inertial, Lidar, and Leg Odometry for All-Terrain Legged Robotscited by 25
- 2019Contact-Aided Invariant Extended Kalman Filtering for Robot State Estimationcited by 16
- 2021Learning Inertial Odometry for Dynamic Legged Robot State Estimationcited by 16
- 2014The invariant extended Kalman filter as a stable observercited by 14
- 2021Legged Robot State Estimation using Invariant Kalman Filtering and Learned Contact Eventscited by 12
- 2022Learned Inertial Odometry for Autonomous Drone Racingcited by 11
- 2018The Blackbird Dataset: A large-scale dataset for UAV perception in aggressive flightcited by 8
- 2021IMU Data Processing For Inertial Aided Navigation: A Recurrent Neural Network Based Approachcited by 8
- 2018Hybrid Contact Preintegration for Visual-Inertial-Contact State Estimation Using Factor Graphscited by 7
- 2017Legged Robot State-Estimation Through Combined Forward Kinematic and Preintegrated Contact Factorscited by 6
- 2022DIDO: Deep Inertial Quadrotor Dynamical Odometrycited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Attention-Based Neural-Augmented Kalman Filter for Legged Robot State Estimationcited by 1
- 2026CoCo-InEKF: State Estimation with Learned Contact Covariances in Dynamic, Contact-Rich Scenarioscited by 0
- 2026TRACE: Learned Proprioceptive Odometry for Legged Robots under Unreliable Contact Conditionscited by 0
- 2026TRACE: Learned Proprioceptive Odometry for Legged Robots under Unreliable Contact Conditions6 Aug 2026
- 2026CoCo-InEKF: State Estimation with Learned Contact Covariances in Dynamic, Contact-Rich Scenarios14 May 2026
- 2026Attention-Based Neural-Augmented Kalman Filter for Legged Robot State Estimation26 Jan 2026