mlsanityData to 14 Oct 2026

pDANSE: Particle-based Data-driven Nonlinear State Estimation from Nonlinear Measurements

arXiv 2510.27503 ↗First posted 31 Oct 2025eess.SP cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We consider the problem of designing a data-driven nonlinear state estimation (DANSE) method that uses (noisy) nonlinear measurements of a process whose underlying state transition model (STM) is unknown. Such a process is referred to as a model-free process. A recurrent neural network (RNN) provides parameters of a Gaussian prior that characterize the state of the model-free process, using all previous measurements at a given time point. In the case of DANSE, the measurement system was linear, leading to a closed-form solution for the state posterior. However, the presence of a nonlinear measurement system renders a closed-form solution infeasible. Instead, the secondorder statistics of the state posterior are computed using the nonlinear measurements observed at the time point. We address the nonlinear measurements using a reparameterization trickbased particle sampling approach, and estimate the second-order statistics of the state posterior. The proposed method is referred to as particle-based DANSE (pDANSE). The RNN of pDANSE uses sequential measurements efficiently and avoids the use of computationally intensive sequential Monte-Carlo (SMC) and/or ancestral sampling. We describe the semi-supervised learning method for pDANSE, which transitions to unsupervised learning in the absence of labeled data. Using a stochastic Lorenz-63 system as a benchmark process, we experimentally demonstrate the state estimation performance for four nonlinear measurement systems. We explore cubic nonlinearity and a cameramodel nonlinearity where unsupervised learning is used; then we explore half-wave rectification nonlinearity and Cartesian-tospherical nonlinearity where semi-supervised learning is used. Additionally, we also show the performance of pDANSE for the stochastic Lorenz-96 system with a half-wave, rectified measurement system. The performance of state estimation is shown to be competitive vis-a-vis model-driven methods that have complete knowledge of the STM of the dynamical system.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 42 references that are in the map. First posted on arXiv 31 Oct 2025.

Builds on

27 of 42 references.

References · 27

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
  4. 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
  5. 2015Deep Kalman Filterscited by 166
  6. 2021KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamicscited by 132
  7. 2020Dynamical Variational Autoencoders: A Comprehensive Reviewcited by 128
  8. 2017A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learningcited by 107
  9. 2018Differentiable Particle Filters: End-to-End Learning with Algorithmic Priorscited by 59
  10. 2021Differentiable Particle Filtering via Entropy-Regularized Optimal Transportcited by 59
  11. 2014Variational Gaussian Process State-Space Modelscited by 43
  12. 2019Combining Generative and Discriminative Models for Hybrid Inferencecited by 34
15 more
  1. 2021Auto-differentiable Ensemble Kalman Filterscited by 28
  2. 2013Bayesian Inference and Learning in Gaussian Process State-Space Models with Particle MCMCcited by 24
  3. 2023An overview of differentiable particle filters for data-adaptive sequential Bayesian inferencecited by 23
  4. 2014Particle Gibbs with Ancestor Samplingcited by 21
  5. 2023DANSE: Data-driven Non-linear State Estimation of Model-free Process in Unsupervised Learning Setupcited by 19
  6. 2015Computationally Efficient Bayesian Learning of Gaussian Process State Space Modelscited by 18
  7. 2017The Ensemble Kalman Filter: A Signal Processing Perspectivecited by 17
  8. 2021Unsupervised Learned Kalman Filteringcited by 17
  9. 2023Latent-KalmanNet: Learned Kalman Filtering for Tracking from High-Dimensional Signalscited by 17
  10. 2018A Survey on State Estimation Techniques and Challenges in Smart Distribution Systemscited by 10
  11. 2023Adaptive KalmanNet: Data-Driven Kalman Filter with Fast Adaptationcited by 9
  12. 2021Self-Supervised Inference in State-Space Modelscited by 3
  13. 2025Deep Variational Sequential Monte Carlo for High-Dimensional Observationscited by 2
  14. 2025Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systemscited by 2
  15. 2024Semi-Supervised Model-Free Bayesian State Estimation from Compressed Measurementscited by 1

Built on by

Not cited yet.