Coupling techniques for nonlinear ensemble filtering
Not on the map. Why?
Abstract (arXiv)
We consider filtering in high-dimensional non-Gaussian state-space models with intractable transition kernels, nonlinear and possibly chaotic dynamics, and sparse observations in space and time. We propose a novel filtering methodology that harnesses transportation of measures, convex optimization, and ideas from probabilistic graphical models to yield robust ensemble approximations of the filtering distribution in high dimensions. Our approach can be understood as the natural generalization of the ensemble Kalman filter (EnKF) to nonlinear updates, using stochastic or deterministic couplings. The use of nonlinear updates can reduce the intrinsic bias of the EnKF at a marginal increase in computational cost. We avoid any form of importance sampling and introduce non-Gaussian localization approaches for dimension scalability. Our framework achieves state-of-the-art tracking performance on challenging configurations of the Lorenz-96 model in the chaotic regime.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 6; 2023: 11; 2024: 9; 2025: 7; 2026: 10.
48 papers.
Sort:
By area:
- 2022Conditional Simulation Using Diffusion Schr"odinger Bridgescited by 58
- 2023An Ensemble Score Filter for Tracking High-Dimensional Nonlinear Dynamical Systemscited by 33
- 2024Sampling in Unit Time with Kernel Fisher-Rao Flowcited by 27
- 2023Conditional Optimal Transport on Function Spacescited by 26
- 2024Dynamic Conditional Optimal Transport through Simulation-Free Flowscited by 24
- 2023Efficient Neural Network Approaches for Conditional Optimal Transport with Applications in Bayesian Inferencecited by 19
- 2022On minimax density estimation via measure transportcited by 18
- 2021Learning non-Gaussian graphical models via Hessian scores and triangular transportcited by 16
- 2022An Optimal Transport Formulation of Bayes' Law for Nonlinear Filtering Algorithmscited by 11
- 2025Learning Enhanced Ensemble Filterscited by 11
- 2025Flow Matching for Efficient and Scalable Data Assimilationcited by 11
- 2023Nonlinear Filtering with Brenier Optimal Transport Mapscited by 10
36 more
- 2021Scalable conditional deep inverse Rosenblatt transports using tensor-trains and gradient-based dimension reductioncited by 9
- 2022Ensemble transport smoothing. Part II: Nonlinear updatescited by 8
- 2023A generative flow for conditional sampling via optimal transportcited by 7
- 2024Learning Optimal Filters Using Variational Inferencecited by 7
- 2024Nonlinear Assimilation via Score-based Sequential Langevin Samplingcited by 7
- 2022A low-rank ensemble Kalman filter for elliptic observationscited by 6
- 2022Ensemble transport smoothing. Part I: Unified frameworkcited by 5
- 2024BI-EqNO: Generalized Approximate Bayesian Inference with an Equivariant Neural Operator Frameworkcited by 5
- 2023Exact nonlinear state estimationcited by 4
- 2025Fast filtering of non-Gaussian models using Amortized Optimal Transport Mapscited by 4
- 2025A friendly introduction to triangular transportcited by 4
- 2025Flow-based Bayesian filtering for high-dimensional nonlinear stochastic dynamical systemscited by 3
- 2026Latent Autoencoder Ensemble Kalman Filter for Nonlinear Data assimilationcited by 3
- 2026Closed-form conditional diffusion models for data assimilationcited by 3
- 2021Machine learning-based conditional mean filter: a generalization of the ensemble Kalman filter for nonlinear data assimilationcited by 2
- 2023A transport approach to sequential simulation-based inferencecited by 2
- 2023Density Estimation via Measure Transport: Outlook for Applications in the Biological Sciencescited by 2
- 2024Ensemble Transport Filter via Optimized Maximum Mean Discrepancycited by 2
- 2024Recurrent Interpolants for Probabilistic Time Series Predictioncited by 2
- 2025Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systemscited by 2
- 2026Amortized Filtering and Smoothing with Conditional Normalizing Flowscited by 2
- 2021Incremental Non-Gaussian Inference for SLAM Using Normalizing Flowscited by 1
- 2023Progressive Bayesian Particle Flows based on Optimal Transport Map Sequencescited by 1
- 2023Leveraging joint sparsity in hierarchical Bayesian learningcited by 1
- 2023An adaptive ensemble filter for heavy-tailed distributions: tuning-free inflation and localizationcited by 1
- 2024Sequential transport maps using SoS density estimation and α-divergencescited by 1
- 2026Pathwise Learning of Stochastic Dynamical Systems with Partial Observationscited by 1
- 2026Adaptive Nonlinear Data Assimilation through P-Spline Triangular Measure Transportcited by 1
- 2021Affine-Mapping based Variational Ensemble Kalman Filtercited by 0
- 2024Preserving linear invariants in ensemble filtering methodscited by 0
- 2025The Ensemble Kalman Update is an Empirical Matheron Updatecited by 0
- 2026Conditional Normalizing Flows for Forward and Backward Joint State and Parameter Estimationcited by 0
- 2026Coupling-Informed Transport Maps for Bayesian Filtering in Nonlinear Dynamical Systemscited by 0
- 2026Generative models for simulation based filtering: Formulations and Empirical Comparisonscited by 0
- 2026One-Step Generative Surrogate Models via Block-Triangular Joint Driftingcited by 0
- 2026Learning the Structure of Triangular Transport Mapscited by 0
- 2026Learning the Structure of Triangular Transport Maps29 Sep 2026
- 2026One-Step Generative Surrogate Models via Block-Triangular Joint Drifting22 Sep 2026
- 2026Generative models for simulation based filtering: Formulations and Empirical Comparisons14 Sep 2026
- 2026Coupling-Informed Transport Maps for Bayesian Filtering in Nonlinear Dynamical Systems13 May 2026
- 2026Amortized Filtering and Smoothing with Conditional Normalizing Flows8 Apr 2026
- 2026Closed-form conditional diffusion models for data assimilation22 Mar 2026
- 2026Adaptive Nonlinear Data Assimilation through P-Spline Triangular Measure Transport19 Mar 2026
- 2026Latent Autoencoder Ensemble Kalman Filter for Nonlinear Data assimilation6 Mar 2026
- 2026Pathwise Learning of Stochastic Dynamical Systems with Partial Observations29 Jan 2026
- 2026Conditional Normalizing Flows for Forward and Backward Joint State and Parameter Estimation11 Jan 2026
- 2025Flow Matching for Efficient and Scalable Data Assimilation18 Aug 2025
- 2025Learning Enhanced Ensemble Filters24 Apr 2025
36 more
- 2025A friendly introduction to triangular transport27 Mar 2025
- 2025Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systems24 Mar 2025
- 2025Fast filtering of non-Gaussian models using Amortized Optimal Transport Maps16 Mar 2025
- 2025Flow-based Bayesian filtering for high-dimensional nonlinear stochastic dynamical systems22 Feb 2025
- 2025The Ensemble Kalman Update is an Empirical Matheron Update5 Feb 2025
- 2024Nonlinear Assimilation via Score-based Sequential Langevin Sampling20 Nov 2024
- 2024BI-EqNO: Generalized Approximate Bayesian Inference with an Equivariant Neural Operator Framework21 Oct 2024
- 2024Recurrent Interpolants for Probabilistic Time Series Prediction18 Sep 2024
- 2024Ensemble Transport Filter via Optimized Maximum Mean Discrepancy16 Jul 2024
- 2024Learning Optimal Filters Using Variational Inference26 Jun 2024
- 2024Preserving linear invariants in ensemble filtering methods22 Apr 2024
- 2024Dynamic Conditional Optimal Transport through Simulation-Free Flows5 Apr 2024
- 2024Sequential transport maps using SoS density estimation and α-divergences27 Feb 2024
- 2024Sampling in Unit Time with Kernel Fisher-Rao Flow8 Jan 2024
- 2023Conditional Optimal Transport on Function Spaces9 Nov 2023
- 2023Efficient Neural Network Approaches for Conditional Optimal Transport with Applications in Bayesian Inference25 Oct 2023
- 2023Nonlinear Filtering with Brenier Optimal Transport Maps21 Oct 2023
- 2023Exact nonlinear state estimation17 Oct 2023
- 2023An adaptive ensemble filter for heavy-tailed distributions: tuning-free inflation and localization12 Oct 2023
- 2023Density Estimation via Measure Transport: Outlook for Applications in the Biological Sciences27 Sep 2023
- 2023An Ensemble Score Filter for Tracking High-Dimensional Nonlinear Dynamical Systems2 Sep 2023
- 2023A transport approach to sequential simulation-based inference26 Aug 2023
- 2023A generative flow for conditional sampling via optimal transport9 Jul 2023
- 2023Leveraging joint sparsity in hierarchical Bayesian learning29 Mar 2023
- 2023Progressive Bayesian Particle Flows based on Optimal Transport Map Sequences4 Mar 2023
- 2022Ensemble transport smoothing. Part II: Nonlinear updates31 Oct 2022
- 2022Ensemble transport smoothing. Part I: Unified framework31 Oct 2022
- 2022On minimax density estimation via measure transport20 Jul 2022
- 2022An Optimal Transport Formulation of Bayes' Law for Nonlinear Filtering Algorithms22 Mar 2022
- 2022A low-rank ensemble Kalman filter for elliptic observations10 Mar 2022
- 2022Conditional Simulation Using Diffusion Schr"odinger Bridges27 Feb 2022
- 2021Incremental Non-Gaussian Inference for SLAM Using Normalizing Flows2 Oct 2021
- 2021Machine learning-based conditional mean filter: a generalization of the ensemble Kalman filter for nonlinear data assimilation15 Jun 2021
- 2021Scalable conditional deep inverse Rosenblatt transports using tensor-trains and gradient-based dimension reduction8 Jun 2021
- 2021Affine-Mapping based Variational Ensemble Kalman Filter10 Mar 2021
- 2021Learning non-Gaussian graphical models via Hessian scores and triangular transport8 Jan 2021
- 2022Conditional Simulation Using Diffusion Schr"odinger Bridgescited by 58
- 2023An Ensemble Score Filter for Tracking High-Dimensional Nonlinear Dynamical Systemscited by 33
- 2025Flow Matching for Efficient and Scalable Data Assimilationcited by 11
- 2026Closed-form conditional diffusion models for data assimilationcited by 3
- 2026Closed-form conditional diffusion models for data assimilation22 Mar 2026
- 2025Flow Matching for Efficient and Scalable Data Assimilation18 Aug 2025
- 2023An Ensemble Score Filter for Tracking High-Dimensional Nonlinear Dynamical Systems2 Sep 2023
- 2022Conditional Simulation Using Diffusion Schr"odinger Bridges27 Feb 2022
- 2024Sampling in Unit Time with Kernel Fisher-Rao Flowcited by 27
- 2023Conditional Optimal Transport on Function Spacescited by 26
- 2024Dynamic Conditional Optimal Transport through Simulation-Free Flowscited by 24
- 2023Efficient Neural Network Approaches for Conditional Optimal Transport with Applications in Bayesian Inferencecited by 19
- 2022On minimax density estimation via measure transportcited by 18
- 2021Learning non-Gaussian graphical models via Hessian scores and triangular transportcited by 16
- 2022An Optimal Transport Formulation of Bayes' Law for Nonlinear Filtering Algorithmscited by 11
- 2025Learning Enhanced Ensemble Filterscited by 11
- 2023Nonlinear Filtering with Brenier Optimal Transport Mapscited by 10
- 2021Scalable conditional deep inverse Rosenblatt transports using tensor-trains and gradient-based dimension reductioncited by 9
- 2022Ensemble transport smoothing. Part II: Nonlinear updatescited by 8
- 2023A generative flow for conditional sampling via optimal transportcited by 7
12 most cited of 44 All 44 (JSON)
- 2026Learning the Structure of Triangular Transport Maps29 Sep 2026
- 2026One-Step Generative Surrogate Models via Block-Triangular Joint Drifting22 Sep 2026
- 2026Generative models for simulation based filtering: Formulations and Empirical Comparisons14 Sep 2026
- 2026Coupling-Informed Transport Maps for Bayesian Filtering in Nonlinear Dynamical Systems13 May 2026
- 2026Amortized Filtering and Smoothing with Conditional Normalizing Flows8 Apr 2026
- 2026Adaptive Nonlinear Data Assimilation through P-Spline Triangular Measure Transport19 Mar 2026
- 2026Latent Autoencoder Ensemble Kalman Filter for Nonlinear Data assimilation6 Mar 2026
- 2026Pathwise Learning of Stochastic Dynamical Systems with Partial Observations29 Jan 2026
- 2026Conditional Normalizing Flows for Forward and Backward Joint State and Parameter Estimation11 Jan 2026
- 2025Learning Enhanced Ensemble Filters24 Apr 2025
- 2025A friendly introduction to triangular transport27 Mar 2025
- 2025Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systems24 Mar 2025
12 newest of 44 All 44 (JSON)