# Deep Variational Sequential Monte Carlo for High-Dimensional Observations

arXiv: https://arxiv.org/abs/2501.05982 · HTML: https://mlsanity.com/paper/2501.05982/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 15 of its 29 references that are in the map.
- First posted on arXiv 10 Jan 2025.

## Builds on (most cited first, 15 of 15)

- [Variational Sequential Monte Carlo](https://mlsanity.com/paper/1705.11140/) (2017)
- [Filtering Variational Objectives](https://mlsanity.com/paper/1705.09279/) (2017)
- [Implicit Reparameterization Gradients](https://mlsanity.com/paper/1805.08498/) (2018)
- [Auto-Encoding Sequential Monte Carlo](https://mlsanity.com/paper/1705.10306/) (2017)
- [Elements of Sequential Monte Carlo](https://mlsanity.com/paper/1903.04797/) (2019)
- [Differentiable Particle Filters: End-to-End Learning with Algorithmic Priors](https://mlsanity.com/paper/1805.11122/) (2018)
- [Differentiable Particle Filtering via Entropy-Regularized Optimal Transport](https://mlsanity.com/paper/2102.07850/) (2021)
- [Rao-Blackwellised Particle Filtering for Dynamic Bayesian Networks](https://mlsanity.com/paper/1301.3853/) (2013)
- [Combining Generative and Discriminative Models for Hybrid Inference](https://mlsanity.com/paper/1906.02547/) (2019)
- [An overview of differentiable particle filters for data-adaptive sequential Bayesian inference](https://mlsanity.com/paper/2302.09639/) (2023)
- [Differentiable Particle Filtering without Modifying the Forward Pass](https://mlsanity.com/paper/2106.10314/) (2021)
- [Latent-KalmanNet: Learned Kalman Filtering for Tracking from High-Dimensional Signals](https://mlsanity.com/paper/2304.07827/) (2023)
- [Stochastic Backpropagation through Mixture Density Distributions](https://mlsanity.com/paper/1607.05690/) (2016)
- [Unsupervised Learning of Sampling Distributions for Particle Filters](https://mlsanity.com/paper/2302.01174/) (2023)
- [Learning Differentiable Particle Filter on the Fly](https://mlsanity.com/paper/2312.05955/) (2023)

## Built on by (most cited first, 2 of 2)

- [pDANSE: Particle-based Data-driven Nonlinear State Estimation from Nonlinear Measurements](https://mlsanity.com/paper/2510.27503/) (2025)
- [VSE: Variational state estimation of complex model-free process](https://mlsanity.com/paper/2601.21887/) (2026)

## Abstract (arXiv)

Sequential Monte Carlo (SMC), or particle filtering, is widely used in nonlinear state-space systems, but its performance often suffers from poorly approximated proposal and state-transition distributions. This work introduces a differentiable particle filter that leverages the unsupervised variational SMC objective to parameterize the proposal and transition distributions with a neural network, designed to learn from high-dimensional observations. Experimental results demonstrate that our approach outperforms established baselines in tracking the challenging Lorenz attractor from high-dimensional and partial observations. Furthermore, an evidence lower bound based evaluation indicates that our method offers a more accurate representation of the posterior distribution.
