Auto-Encoding Sequential Monte Carlo
Not on the map. Why?
Abstract (arXiv)
We build on auto-encoding sequential Monte Carlo (AESMC): a method for model and proposal learning based on maximizing the lower bound to the log marginal likelihood in a broad family of structured probabilistic models. Our approach relies on the efficiency of sequential Monte Carlo (SMC) for performing inference in structured probabilistic models and the flexibility of deep neural networks to model complex conditional probability distributions. We develop additional theoretical insights and introduce a new training procedure which improves both model and proposal learning. We demonstrate that our approach provides a fast, easy-to-implement and scalable means for simultaneous model learning and proposal adaptation in deep generative models.
Key facts. Cited by 65 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 21; 2022: 9; 2023: 13; 2024: 10; 2025: 5; 2026: 6.
65 papers.
Sort:
By area:
- 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 178
- 2021Annealed Flow Transport Monte Carlocited by 90
- 2022Continual Repeated Annealed Flow Transport Monte Carlocited by 66
- 2021Differentiable Particle Filtering via Entropy-Regularized Optimal Transportcited by 59
- 2022A Variational Perspective on Generative Flow Networkscited by 39
- 2021Differentiable Annealed Importance Sampling and the Perils of Gradient Noisecited by 36
- 2021Auto-differentiable Ensemble Kalman Filterscited by 28
- 2023An overview of differentiable particle filters for data-adaptive sequential Bayesian inferencecited by 23
- 2022SIXO: Smoothing Inference with Twisted Objectivescited by 22
- 2021Structured World Belief for Reinforcement Learning in POMDPcited by 21
- 2021Improving Lossless Compression Rates via Monte Carlo Bits-Back Codingcited by 19
- 2021Online Variational Filtering and Parameter Learningcited by 19
38 more
- 2021Differentiable Particle Filtering without Modifying the Forward Passcited by 18
- 2021RNN with Particle Flow for Probabilistic Spatio-temporal Forecastingcited by 16
- 2023Efficient Training of Energy-Based Models Using Jarzynski Equalitycited by 15
- 2024Inferring stochastic low-rank recurrent neural networks from neural datacited by 15
- 2021Nested Variational Inferencecited by 14
- 2021Surrogate Likelihoods for Variational Annealed Importance Samplingcited by 14
- 2023Reduced-Order Autodifferentiable Ensemble Kalman Filterscited by 14
- 2022A General Learning Framework for Open Ad Hoc Teamwork Using Graph-based Policy Learningcited by 12
- 2021Variational Combinatorial Sequential Monte Carlo Methods for Bayesian Phylogenetic Inferencecited by 11
- 2021On Incorporating Inductive Biases into VAEscited by 11
- 2021Learning to Assimilate in Chaotic Dynamical Systemscited by 10
- 2024Normalizing Flow-based Differentiable Particle Filterscited by 10
- 2024Sequential Monte Carlo for Inclusive KL Minimization in Amortized Variational Inferencecited by 7
- 2021Learning Proposals for Probabilistic Programs with Inference Combinatorscited by 6
- 2021Variational Marginal Particle Filterscited by 6
- 2023Extending Path-Dependent NJ-ODEs to Noisy Observations and a Dependent Observation Frameworkcited by 6
- 2023Cheap and Deterministic Inference for Deep State-Space Models of Interacting Dynamical Systemscited by 5
- 2023Online Variational Sequential Monte Carlocited by 5
- 2023NAS-X: Neural Adaptive Smoothing via Twistingcited by 4
- 2021An Easy to Interpret Diagnostic for Approximate Inference: Symmetric Divergence Over Simulationscited by 3
- 2022Uphill Roads to Variational Tightness: Monotonicity and Monte Carlo Objectivescited by 3
- 2022Particle-Based Score Estimation for State Space Model Learning in Autonomous Drivingcited by 3
- 2023U-Statistics for Importance-Weighted Variational Inferencecited by 3
- 2023Variational autoencoder with weighted samples for high-dimensional non-parametric adaptive importance samplingcited by 3
- 2025Twice Sequential Monte Carlo for Tree Searchcited by 3
- 2022De-Sequentialized Monte Carlo: a parallel-in-time particle smoothercited by 2
- 2023Resampling Gradients Vanish in Differentiable Sequential Monte Carlo Samplerscited by 2
- 2023Reparameterized Variational Rejection Samplingcited by 2
- 2023Learning Differentiable Particle Filter on the Flycited by 2
- 2024Revisiting semi-supervised training objectives for differentiable particle filterscited by 2
- 2024Regime Learning for Differentiable Particle Filterscited by 2
- 2025Deep Variational Sequential Monte Carlo for High-Dimensional Observationscited by 2
- 2025DiffPF: Differentiable Particle Filtering with Generative Sampling via Conditional Diffusion Modelscited by 2
- 2025PyDPF: A Python Package for Differentiable Particle Filteringcited by 2
- 2021Monte Carlo Filtering Objectives: A New Family of Variational Objectives to Learn Generative Model and Neural Adaptive Proposal for Time Seriescited by 1
- 2022Optimization of Annealed Importance Sampling Hyperparameterscited by 1
- 2022Multi-Task Dynamical Systemscited by 1
- 2023Massively Parallel Reweighted Wake-Sleepcited by 1
50 most cited of 65 All 65 (JSON)
- 2026Amortised adaptive importance sampling12 Oct 2026
- 2026Learning to Bias: Machine Learning-Enhanced Particle Filters24 Sep 2026
- 2026Generative Model Proposal based Particle Filtering for Data Assimilation1 Jul 2026
- 2026Diffusion-Driven State Space Models19 Jun 2026
- 2026The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modeling29 May 2026
- 2026Efficient Learning of Deep State Space Models via Importance Smoothing20 May 2026
- 2025Twice Sequential Monte Carlo for Tree Search18 Nov 2025
- 2025PyDPF: A Python Package for Differentiable Particle Filtering29 Oct 2025
- 2025DiffPF: Differentiable Particle Filtering with Generative Sampling via Conditional Diffusion Models21 Jul 2025
- 2025Jarzynski Reweighting and Sampling Dynamics for Training Energy-Based Models: Theoretical Analysis of Different Transition Kernels9 Jun 2025
- 2025Deep Variational Sequential Monte Carlo for High-Dimensional Observations10 Jan 2025
- 2024Nonparametric Filtering, Estimation and Classification using Neural Jump ODEs4 Dec 2024
38 more
- 2024Recursive Learning of Asymptotic Variational Objectives4 Nov 2024
- 2024Inverse Particle Filter23 Jul 2024
- 2024Inferring stochastic low-rank recurrent neural networks from neural data24 Jun 2024
- 2024Variational Pseudo Marginal Methods for Jet Reconstruction in Particle Physics5 Jun 2024
- 2024Regime Learning for Differentiable Particle Filters8 May 2024
- 2024Revisiting semi-supervised training objectives for differentiable particle filters2 May 2024
- 2024Sequential Monte Carlo for Inclusive KL Minimization in Amortized Variational Inference15 Mar 2024
- 2024Normalizing Flow-based Differentiable Particle Filters3 Mar 2024
- 2024Differentiable Particle Filtering using Optimal Placement Resampling26 Feb 2024
- 2023Online Variational Sequential Monte Carlo19 Dec 2023
- 2023Learning Differentiable Particle Filter on the Fly10 Dec 2023
- 2023Variational autoencoder with weighted samples for high-dimensional non-parametric adaptive importance sampling13 Oct 2023
- 2023Reparameterized Variational Rejection Sampling26 Sep 2023
- 2023NAS-X: Neural Adaptive Smoothing via Twisting28 Aug 2023
- 2023Extending Path-Dependent NJ-ODEs to Noisy Observations and a Dependent Observation Framework24 Jul 2023
- 2023Efficient Training of Energy-Based Models Using Jarzynski Equality30 May 2023
- 2023Massively Parallel Reweighted Wake-Sleep18 May 2023
- 2023Cheap and Deterministic Inference for Deep State-Space Models of Interacting Dynamical Systems2 May 2023
- 2023Resampling Gradients Vanish in Differentiable Sequential Monte Carlo Samplers27 Apr 2023
- 2023U-Statistics for Importance-Weighted Variational Inference27 Feb 2023
- 2023An overview of differentiable particle filters for data-adaptive sequential Bayesian inference19 Feb 2023
- 2023Reduced-Order Autodifferentiable Ensemble Kalman Filters27 Jan 2023
- 2022Particle-Based Score Estimation for State Space Model Learning in Autonomous Driving14 Dec 2022
- 2022A Variational Perspective on Generative Flow Networks14 Oct 2022
- 2022A General Learning Framework for Open Ad Hoc Teamwork Using Graph-based Policy Learning11 Oct 2022
- 2022Multi-Task Dynamical Systems8 Oct 2022
- 2022Optimization of Annealed Importance Sampling Hyperparameters27 Sep 2022
- 2022SIXO: Smoothing Inference with Twisted Objectives13 Jun 2022
- 2022De-Sequentialized Monte Carlo: a parallel-in-time particle smoother4 Feb 2022
- 2022Continual Repeated Annealed Flow Transport Monte Carlo31 Jan 2022
- 2022Uphill Roads to Variational Tightness: Monotonicity and Monte Carlo Objectives26 Jan 2022
- 2021Surrogate Likelihoods for Variational Annealed Importance Sampling22 Dec 2021
- 2021Blockwise Sequential Model Learning for Partially Observable Reinforcement Learning10 Dec 2021
- 2021Learning to Assimilate in Chaotic Dynamical Systems1 Nov 2021
- 2021Online Variational Filtering and Parameter Learning26 Oct 2021
- 2021Variational Marginal Particle Filters30 Sep 2021
- 2021Differentiable Annealed Importance Sampling and the Perils of Gradient Noise21 Jul 2021
- 2021Structured World Belief for Reinforcement Learning in POMDP19 Jul 2021
50 newest of 65 All 65 (JSON)
- 2025Twice Sequential Monte Carlo for Tree Searchcited by 3
- 2025Twice Sequential Monte Carlo for Tree Search18 Nov 2025
- 2021Structured World Belief for Reinforcement Learning in POMDPcited by 21
- 2021Structured World Belief for Reinforcement Learning in POMDP19 Jul 2021
- 2021Annealed Flow Transport Monte Carlocited by 90
- 2022Continual Repeated Annealed Flow Transport Monte Carlocited by 66
- 2021Differentiable Particle Filtering via Entropy-Regularized Optimal Transportcited by 59
- 2022A Variational Perspective on Generative Flow Networkscited by 39
- 2021Differentiable Annealed Importance Sampling and the Perils of Gradient Noisecited by 36
- 2021Auto-differentiable Ensemble Kalman Filterscited by 28
- 2023An overview of differentiable particle filters for data-adaptive sequential Bayesian inferencecited by 23
- 2022SIXO: Smoothing Inference with Twisted Objectivescited by 22
- 2021Improving Lossless Compression Rates via Monte Carlo Bits-Back Codingcited by 19
- 2021Online Variational Filtering and Parameter Learningcited by 19
- 2021Differentiable Particle Filtering without Modifying the Forward Passcited by 18
- 2021RNN with Particle Flow for Probabilistic Spatio-temporal Forecastingcited by 16
12 most cited of 60 All 60 (JSON)
- 2026Amortised adaptive importance sampling12 Oct 2026
- 2026Learning to Bias: Machine Learning-Enhanced Particle Filters24 Sep 2026
- 2026Generative Model Proposal based Particle Filtering for Data Assimilation1 Jul 2026
- 2026The Dynamic-Probabilistic Consistency Gap in Chaotic Surrogate Modeling29 May 2026
- 2026Efficient Learning of Deep State Space Models via Importance Smoothing20 May 2026
- 2025PyDPF: A Python Package for Differentiable Particle Filtering29 Oct 2025
- 2025Jarzynski Reweighting and Sampling Dynamics for Training Energy-Based Models: Theoretical Analysis of Different Transition Kernels9 Jun 2025
- 2025Deep Variational Sequential Monte Carlo for High-Dimensional Observations10 Jan 2025
- 2024Nonparametric Filtering, Estimation and Classification using Neural Jump ODEs4 Dec 2024
- 2024Recursive Learning of Asymptotic Variational Objectives4 Nov 2024
- 2024Inverse Particle Filter23 Jul 2024
- 2024Inferring stochastic low-rank recurrent neural networks from neural data24 Jun 2024
12 newest of 60 All 60 (JSON)