# Enhancing State Estimation in Robots: A Data-Driven Approach with Differentiable Ensemble Kalman Filters

arXiv: https://arxiv.org/abs/2308.09870 · HTML: https://mlsanity.com/paper/2308.09870/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 Aug 2023.

## Built on by (most cited first, 4 of 4)

- [TorchDA: A Python package for performing data assimilation with deep learning forward and transformation functions](https://mlsanity.com/paper/2409.00244/) (2024)
- [TokenMotion: Motion-Guided Vision Transformer for Video Camouflaged Object Detection Via Learnable Token Selection](https://mlsanity.com/paper/2311.02535/) (2023)
- [DiffPF: Differentiable Particle Filtering with Generative Sampling via Conditional Diffusion Models](https://mlsanity.com/paper/2507.15716/) (2025)
- [DnD Filter: Differentiable State Estimation for Dynamic Systems using Diffusion Models](https://mlsanity.com/paper/2503.01274/) (2025)

## Abstract (arXiv)

This paper introduces a novel state estimation framework for robots using differentiable ensemble Kalman filters (DEnKF). DEnKF is a reformulation of the traditional ensemble Kalman filter that employs stochastic neural networks to model the process noise implicitly. Our work is an extension of previous research on differentiable filters, which has provided a strong foundation for our modular and end-to-end differentiable framework. This framework enables each component of the system to function independently, leading to improved flexibility and versatility in implementation. Through a series of experiments, we demonstrate the flexibility of this model across a diverse set of real-world tracking tasks, including visual odometry and robot manipulation. Moreover, we show that our model effectively handles noisy observations, is robust in the absence of observations, and outperforms state-of-the-art differentiable filters in terms of error metrics. Specifically, we observe a significant improvement of at least 59% in translational error when using DEnKF with noisy observations. Our results underscore the potential of DEnKF in advancing state estimation for robotics. Code for DEnKF is available at https://github.com/ir-lab/DEnKF
