Variational Sequential Monte Carlo
Not on the map. Why?
Abstract (arXiv)
Many recent advances in large scale probabilistic inference rely on variational methods. The success of variational approaches depends on (i) formulating a flexible parametric family of distributions, and (ii) optimizing the parameters to find the member of this family that most closely approximates the exact posterior. In this paper we present a new approximating family of distributions, the variational sequential Monte Carlo (VSMC) family, and show how to optimize it in variational inference. VSMC melds variational inference (VI) and sequential Monte Carlo (SMC), providing practitioners with flexible, accurate, and powerful Bayesian inference. The VSMC family is a variational family that can approximate the posterior arbitrarily well, while still allowing for efficient optimization of its parameters. We demonstrate its utility on state space models, stochastic volatility models for financial data, and deep Markov models of brain neural circuits.
Key facts. Cited by 93 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 11; 2023: 17; 2024: 16; 2025: 10; 2026: 12.
93 papers.
Sort:
By area:
- 2021KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamicscited by 128
- 2023Score-based Data Assimilationcited by 91
- 2021Annealed Flow Transport Monte Carlocited by 90
- 2022Continual Repeated Annealed Flow Transport Monte Carlocited by 66
- 2021Differentiable Particle Filtering via Entropy-Regularized Optimal Transportcited by 59
- 2022A Variational Perspective on Generative Flow Networkscited by 39
- 2021Differentiable Annealed Importance Sampling and the Perils of Gradient Noisecited by 36
- 2021Auto-differentiable Ensemble Kalman Filterscited by 28
- 2023An overview of differentiable particle filters for data-adaptive sequential Bayesian inferencecited by 23
- 2022SIXO: Smoothing Inference with Twisted Objectivescited by 22
- 2021Structured World Belief for Reinforcement Learning in POMDPcited by 21
- 2021Improving Lossless Compression Rates via Monte Carlo Bits-Back Codingcited by 19
38 more
- 2021Online Variational Filtering and Parameter Learningcited by 19
- 2021Differentiable Particle Filtering without Modifying the Forward Passcited by 18
- 2021Unsupervised Learned Kalman Filteringcited by 17
- 2021RNN with Particle Flow for Probabilistic Spatio-temporal Forecastingcited by 16
- 2021Stein Variational Gradient Descent: many-particle and long-time asymptoticscited by 15
- 2024Inferring stochastic low-rank recurrent neural networks from neural datacited by 15
- 2021Nested Variational Inferencecited by 14
- 2021Surrogate Likelihoods for Variational Annealed Importance Samplingcited by 14
- 2022On Uncertainty in Deep State Space Models for Model-Based Reinforcement Learningcited by 13
- 2021HYPER: Learned Hybrid Trajectory Prediction via Factored Inference and Adaptive Samplingcited by 12
- 2023Reduced-Order Autodifferentiable Ensemble Kalman Filterscited by 12
- 2021On Incorporating Inductive Biases into VAEscited by 11
- 2021Variational Combinatorial Sequential Monte Carlo Methods for Bayesian Phylogenetic Inferencecited by 10
- 2024Normalizing Flow-based Differentiable Particle Filterscited by 10
- 2024KalMamba: Towards Efficient Probabilistic State Space Models for RL under Uncertaintycited by 9
- 2022Recursive Monte Carlo and Variational Inference with Auxiliary Variablescited by 8
- 2023Adaptive Annealed Importance Sampling with Constant Rate Progresscited by 7
- 2024Sequential Monte Carlo for Inclusive KL Minimization in Amortized Variational Inferencecited by 7
- 2024Meta-Dynamical State Space Models for Integrative Neural Data Analysiscited by 7
- 2021Learning Proposals for Probabilistic Programs with Inference Combinatorscited by 6
- 2021Learning Dynamical Systems from Noisy Sensor Measurements using Multiple Shootingcited by 6
- 2021Variational Marginal Particle Filterscited by 6
- 2021Uncertainty in Data-Driven Kalman Filtering for Partially Known State-Space Modelscited by 6
- 2023Cheap and Deterministic Inference for Deep State-Space Models of Interacting Dynamical Systemscited by 5
- 2025Trust-Region Twisted Policy Improvementcited by 5
- 2023NAS-X: Neural Adaptive Smoothing via Twistingcited by 4
- 2023On Feynman--Kac training of partial Bayesian neural networkscited by 4
- 2023Online Variational Sequential Monte Carlocited by 4
- 2024Provably Scalable Black-Box Variational Inference with Structured Variational Familiescited by 4
- 2024Probabilistic Programming with Programmable Variational Inferencecited by 4
- 2025End-To-End Learning of Gaussian Mixture Priors for Diffusion Samplercited by 4
- 2021An Easy to Interpret Diagnostic for Approximate Inference: Symmetric Divergence Over Simulationscited by 3
- 2021Self-Supervised Inference in State-Space Modelscited by 3
- 2022Uphill Roads to Variational Tightness: Monotonicity and Monte Carlo Objectivescited by 3
- 2022Particle-Based Score Estimation for State Space Model Learning in Autonomous Drivingcited by 3
- 2023U-Statistics for Importance-Weighted Variational Inferencecited by 3
- 2023Variational Nonlinear Kalman Filtering with Unknown Process Noise Covariancecited by 3
- 2024Bayesian Multi-Task Transfer Learning for Soft Prompt Tuningcited by 3
50 most cited of 93 All 93 (JSON)
- 2026Learning to Bias: Machine Learning-Enhanced Particle Filters24 Sep 2026
- 2026PR-Smoother: Simulator-Preserving Non-Gaussian Smoothing for Data Assimilation22 Sep 2026
- 2026Operator Neural Jump ODEs: L2-optimal prediction in function spaces25 Jul 2026
- 2026GradInf: Gradient Estimation as Probabilistic Inference8 Jul 2026
- 2026Generative Model Proposal based Particle Filtering for Data Assimilation1 Jul 2026
- 2026Dynestyx: A Probabilistic Programming Library for Dynamical Systems15 Jun 2026
- 2026State-Coupled Volatility in Latent Dynamical Systems: Recovery Under Partial Observation1 Jun 2026
- 2026The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modeling29 May 2026
- 2026Deep ZakaiJ: Structured Filtering for Jump-Diffusion Time Series Forecasting23 May 2026
- 2026VariBASed: Variational Bayes-Adaptive Sequential Monte-Carlo Planning for Deep Reinforcement Learning21 Feb 2026
- 2026MDP Planning as Policy Inference19 Feb 2026
- 2026Neural Backward Filtering Forward Guiding30 Jan 2026
38 more
- 2025Diffusion differentiable resampling11 Dec 2025
- 2025PyDPF: A Python Package for Differentiable Particle Filtering29 Oct 2025
- 2025Efficient Inference for Coupled Hidden Markov Models in Continuous Time and Discrete Space14 Oct 2025
- 2025Double projection for reconstructing dynamical systems: between stochastic and deterministic regimes1 Oct 2025
- 2025DiffPF: Differentiable Particle Filtering with Generative Sampling via Conditional Diffusion Models21 Jul 2025
- 2025Asymptotically exact variational flows via involutive MCMC kernels2 Jun 2025
- 2025Sequential Monte Carlo for Policy Optimization in Continuous POMDPs22 May 2025
- 2025Trust-Region Twisted Policy Improvement8 Apr 2025
- 2025End-To-End Learning of Gaussian Mixture Priors for Diffusion Sampler1 Mar 2025
- 2025Deep Variational Sequential Monte Carlo for High-Dimensional Observations10 Jan 2025
- 2024Nonparametric Filtering, Estimation and Classification using Neural Jump ODEs4 Dec 2024
- 2024Learning state and proposal dynamics in state-space models using differentiable particle filters and neural networks23 Nov 2024
- 2024Recursive Learning of Asymptotic Variational Objectives4 Nov 2024
- 2024Meta-Dynamical State Space Models for Integrative Neural Data Analysis7 Oct 2024
- 2024Divide-and-Conquer Predictive Coding: a structured Bayesian inference algorithm11 Aug 2024
- 2024Inferring stochastic low-rank recurrent neural networks from neural data24 Jun 2024
- 2024Probabilistic Programming with Programmable Variational Inference22 Jun 2024
- 2024KalMamba: Towards Efficient Probabilistic State Space Models for RL under Uncertainty21 Jun 2024
- 2024Variational Pseudo Marginal Methods for Jet Reconstruction in Particle Physics5 Jun 2024
- 2024Regime Learning for Differentiable Particle Filters8 May 2024
- 2024Revisiting semi-supervised training objectives for differentiable particle filters2 May 2024
- 2024Sequential Monte Carlo for Inclusive KL Minimization in Amortized Variational Inference15 Mar 2024
- 2024Normalizing Flow-based Differentiable Particle Filters3 Mar 2024
- 2024Differentiable Particle Filtering using Optimal Placement Resampling26 Feb 2024
- 2024Bayesian Multi-Task Transfer Learning for Soft Prompt Tuning13 Feb 2024
- 2024Provably Scalable Black-Box Variational Inference with Structured Variational Families19 Jan 2024
- 2023Online Variational Sequential Monte Carlo19 Dec 2023
- 2023Learning Differentiable Particle Filter on the Fly10 Dec 2023
- 2023A Metalearned Neural Circuit for Nonparametric Bayesian Inference24 Nov 2023
- 2023On Feynman--Kac training of partial Bayesian neural networks30 Oct 2023
- 2023Variational autoencoder with weighted samples for high-dimensional non-parametric adaptive importance sampling13 Oct 2023
- 2023Reparameterized Variational Rejection Sampling26 Sep 2023
- 2023NAS-X: Neural Adaptive Smoothing via Twisting28 Aug 2023
- 2023Last layer state space model for representation learning and uncertainty quantification4 Jul 2023
- 2023Adaptive Annealed Importance Sampling with Constant Rate Progress27 Jun 2023
- 2023Score-based Data Assimilation18 Jun 2023
- 2023Massively Parallel Reweighted Wake-Sleep18 May 2023
- 2023Variational Nonlinear Kalman Filtering with Unknown Process Noise Covariance6 May 2023
50 newest of 93 All 93 (JSON)
- 2021Structured World Belief for Reinforcement Learning in POMDPcited by 21
- 2021Structured World Belief for Reinforcement Learning in POMDP19 Jul 2021
- 2021KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamicscited by 128
- 2023Score-based Data Assimilationcited by 91
- 2021Annealed Flow Transport Monte Carlocited by 90
- 2022Continual Repeated Annealed Flow Transport Monte Carlocited by 66
- 2021Differentiable Particle Filtering via Entropy-Regularized Optimal Transportcited by 59
- 2022A Variational Perspective on Generative Flow Networkscited by 39
- 2021Differentiable Annealed Importance Sampling and the Perils of Gradient Noisecited by 36
- 2021Auto-differentiable Ensemble Kalman Filterscited by 28
- 2023An overview of differentiable particle filters for data-adaptive sequential Bayesian inferencecited by 23
- 2022SIXO: Smoothing Inference with Twisted Objectivescited by 22
- 2021Improving Lossless Compression Rates via Monte Carlo Bits-Back Codingcited by 19
- 2021Online Variational Filtering and Parameter Learningcited by 19
12 most cited of 89 All 89 (JSON)
- 2026Learning to Bias: Machine Learning-Enhanced Particle Filters24 Sep 2026
- 2026PR-Smoother: Simulator-Preserving Non-Gaussian Smoothing for Data Assimilation22 Sep 2026
- 2026Operator Neural Jump ODEs: L2-optimal prediction in function spaces25 Jul 2026
- 2026GradInf: Gradient Estimation as Probabilistic Inference8 Jul 2026
- 2026Generative Model Proposal based Particle Filtering for Data Assimilation1 Jul 2026
- 2026Dynestyx: A Probabilistic Programming Library for Dynamical Systems15 Jun 2026
- 2026State-Coupled Volatility in Latent Dynamical Systems: Recovery Under Partial Observation1 Jun 2026
- 2026The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modeling29 May 2026
- 2026VariBASed: Variational Bayes-Adaptive Sequential Monte-Carlo Planning for Deep Reinforcement Learning21 Feb 2026
- 2026MDP Planning as Policy Inference19 Feb 2026
- 2026Neural Backward Filtering Forward Guiding30 Jan 2026
- 2025Diffusion differentiable resampling11 Dec 2025
12 newest of 89 All 89 (JSON)