# Regret-Optimal Filtering for Prediction and Estimation

arXiv: https://arxiv.org/abs/2101.10357 · HTML: https://mlsanity.com/paper/2101.10357/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 5 of its 31 references that are in the map.
- First posted on arXiv 25 Jan 2021.

## Builds on (most cited first, 5 of 5)

- [Online Control with Adversarial Disturbances](https://mlsanity.com/paper/1902.08721/) (2019)
- [Improper Learning for Non-Stochastic Control](https://mlsanity.com/paper/2001.09254/) (2020)
- [Learning Linear-Quadratic Regulators Efficiently with only √T Regret](https://mlsanity.com/paper/1902.06223/) (2019)
- [The Nonstochastic Control Problem](https://mlsanity.com/paper/1911.12178/) (2019)
- [Worst-case Prediction Performance Analysis of the Kalman Filter](https://mlsanity.com/paper/1611.02050/) (2016)

## Abstract (arXiv)

The filtering problem of causally estimating a desired signal from a related observation signal is investigated through the lens of regret optimization. Classical filter designs, such as mathcal H2 (Kalman) and mathcal H_∞, minimize the average and worst-case estimation errors, respectively. As a result mathcal H2 filters are sensitive to inaccuracies in the underlying statistical model, and mathcal H_∞ filters are overly conservative since they safeguard against the worst-case scenario. We propose instead to minimize the regret in order to design filters that perform well in different noise regimes by comparing their performance with that of a clairvoyant filter. More explicitly, we minimize the largest deviation of the squared estimation error of a causal filter from that of a non-causal filter that has access to future observations. In this sense, the regret-optimal filter will have the best competitive performance with respect to the non-causal benchmark filter no matter what the true signal and the observation process are. For the important case of signals that can be described with a time-invariant state-space, we provide an explicit construction for the regret optimal filter in the estimation (causal) and the prediction (strictly-causal) regimes. These solutions are obtained by reducing the regret filtering problem to a Nehari problem, i.e., approximating a non-causal operator by a causal one in spectral norm. The regret-optimal filters bear some resemblance to Kalman and H_∞ filters: they are expressed as state-space models, inherit the finite dimension of the original state-space, and their solutions require solving algebraic Riccati equations. Numerical simulations demonstrate that regret minimization inherently interpolates between the performances of the H2 and H_∞ filters and is thus a viable approach for filter design.