# The Rank-Reduced Kalman Filter: Approximate Dynamical-Low-Rank Filtering In High Dimensions

arXiv: https://arxiv.org/abs/2306.07774 · HTML: https://mlsanity.com/paper/2306.07774/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 8 of its 49 references that are in the map.
- First posted on arXiv 13 Jun 2023.

## Builds on (most cited first, 8 of 8)

- [Gaussian Processes for Big Data](https://mlsanity.com/paper/1309.6835/) (2013)
- [Spatio-Temporal Variational Gaussian Processes](https://mlsanity.com/paper/2111.01732/) (2021)
- [The Ensemble Kalman Filter: A Signal Processing Perspective](https://mlsanity.com/paper/1702.08061/) (2017)
- [Doubly Sparse Variational Gaussian Processes](https://mlsanity.com/paper/2001.05363/) (2020)
- [Tikhonov Regularization Within Ensemble Kalman Inversion](https://mlsanity.com/paper/1901.10382/) (2019)
- [Fenrir: Physics-Enhanced Regression for Initial Value Problems](https://mlsanity.com/paper/2202.01287/) (2022)
- [Combining Pseudo-Point and State Space Approximations for Sum-Separable Gaussian Processes](https://mlsanity.com/paper/2106.10210/) (2021)
- [Efficient Spatio-Temporal Gaussian Regression via Kalman Filtering](https://mlsanity.com/paper/1705.01485/) (2017)

## Built on by (most cited first, 5 of 5)

- [Computation-Aware Kalman Filtering and Smoothing](https://mlsanity.com/paper/2405.08971/) (2024)
- [Martingale Posterior Neural Networks for Fast Sequential Decision Making](https://mlsanity.com/paper/2506.11898/) (2025)
- [The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modeling](https://mlsanity.com/paper/2605.31547/) (2026)
- [Tensor network square root Kalman filter for online Gaussian process regression](https://mlsanity.com/paper/2409.03276/) (2024)
- [Filtered Markovian Projection: Dimensionality Reduction in Filtering for Stochastic Reaction Networks](https://mlsanity.com/paper/2502.07918/) (2025)

## Abstract (arXiv)

Inference and simulation in the context of high-dimensional dynamical systems remain computationally challenging problems. Some form of dimensionality reduction is required to make the problem tractable in general. In this paper, we propose a novel approximate Gaussian filtering and smoothing method which propagates low-rank approximations of the covariance matrices. This is accomplished by projecting the Lyapunov equations associated with the prediction step to a manifold of low-rank matrices, which are then solved by a recently developed, numerically stable, dynamical low-rank integrator. Meanwhile, the update steps are made tractable by noting that the covariance update only transforms the column space of the covariance matrix, which is low-rank by construction. The algorithm differentiates itself from existing ensemble-based approaches in that the low-rank approximations of the covariance matrices are deterministic, rather than stochastic. Crucially, this enables the method to reproduce the exact Kalman filter as the low-rank dimension approaches the true dimensionality of the problem. Our method reduces computational complexity from cubic (for the Kalman filter) to quadratic in the state-space size in the worst-case, and can achieve linear complexity if the state-space model satisfies certain criteria. Through a set of experiments in classical data-assimilation and spatio-temporal regression, we show that the proposed method consistently outperforms the ensemble-based methods in terms of error in the mean and covariance with respect to the exact Kalman filter. This comes at no additional cost in terms of asymptotic computational complexity.
