mlsanityData to 14 Oct 2026

Robust Automatic Differentiation of Square-Root Kalman Filters via Gramian Differentials

arXiv 2603.13559 ↗First posted 13 Mar 2026stat.ML cs.LG cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

Square-root Kalman filters propagate state covariances in Cholesky-factor form for numerical stability, and are a natural target for gradient-based parameter learning in state-space models. Their core operation, triangularization of a matrix M ∈ ℝn × m, is computed via a QR decomposition in practice, but naively differentiating through it causes two problems: the semi-orthogonal factor is non-unique when m > n, yielding undefined gradients; and the standard Jacobian formula involves inverses, which diverges when M is rank-deficient. Both are resolved by the observation that all filter outputs relevant to learning depend on the input matrix only through the Gramian MM^top, so the composite loss is smooth in M even where the triangularization is not. We derive a closed-form chain-rule directly from the differential of this Gramian identity, prove it exact for the Kalman log-marginal likelihood and filtered moments, and extend it to rank-deficient inputs via a two-component decomposition: a column-space term based on the Moore--Penrose pseudoinverse, and a null-space correction for perturbations outside the column space of M.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 12 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

4 of 12 references.

References · 4

  1. 2015Automatic differentiation in machine learning: a surveycited by 855
  2. 2022You Only Linearize Once: Tangents Transpose to Gradientscited by 10
  3. 2017Auto-Differentiating Linear Algebracited by 7
  4. 2022Parallel square-root statistical linear regression for inference in nonlinear state space modelscited by 6

Built on by

Not cited yet.