Deep Kalman Filters
Not on the map. Why?
Abstract (arXiv)
Kalman Filters are one of the most influential models of time-varying phenomena. They admit an intuitive probabilistic interpretation, have a simple functional form, and enjoy widespread adoption in a variety of disciplines. Motivated by recent variational methods for learning deep generative models, we introduce a unified algorithm to efficiently learn a broad spectrum of Kalman filters. Of particular interest is the use of temporal generative models for counterfactual inference. We investigate the efficacy of such models for counterfactual inference, and to that end we introduce the "Healing MNIST" dataset where long-term structure, noise and actions are applied to sequences of digits. We show the efficacy of our method for modeling this dataset. We further show how our model can be used for counterfactual inference for patients, based on electronic health record data of 8,000 patients over 4.5 years.
Key facts. Cited by 166 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 26; 2023: 26; 2024: 30; 2025: 17; 2026: 39.
166 papers.
Sort:
By area:
- 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 198
- 2021KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamicscited by 132
- 2021Modeling Irregular Time Series with Continuous Recurrent Unitscited by 103
- 2023Score-based Data Assimilationcited by 96
- 2022Criteria for Classifying Forecasting Methodscited by 48
- 2021Clockwork Variational Autoencoderscited by 42
- 2021Universal Approximation Theorems for Differentiable Geometric Deep Learningcited by 41
- 2021Contrastively Disentangled Sequential Variational Autoencodercited by 34
- 2023Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecastingcited by 34
- 2021Time Series Anomaly Detection for Cyber-Physical Systems via Neural System Identification and Bayesian Filteringcited by 31
- 2021Action-Sufficient State Representation Learning for Control with Structural Constraintscited by 31
- 2021Constructing Neural Network-Based Models for Simulating Dynamical Systemscited by 31
38 more
- 2021Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecastingcited by 29
- 2023Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time Seriescited by 29
- 2021Unsupervised Speech Enhancement using Dynamical Variational Auto-Encoderscited by 28
- 2021Roto-translated Local Coordinate Frames For Interacting Dynamical Systemscited by 24
- 2022Designing Universal Causal Deep Learning Models: The Case of Infinite-Dimensional Dynamical Systems from Stochastic Analysiscited by 22
- 2026Generative Recursive Reasoningcited by 20
- 2022Unsupervised Representation Learning in Deep Reinforcement Learning: A Reviewcited by 18
- 2024MADiff: Motion-Aware Mamba Diffusion Models for Hand Trajectory Prediction on Egocentric Videoscited by 18
- 2021Unsupervised Learned Kalman Filteringcited by 17
- 2021ACE-NODE: Attentive Co-Evolving Neural Ordinary Differential Equationscited by 15
- 2021SSDNet: State Space Decomposition Neural Network for Time Series Forecastingcited by 15
- 2022An Adaptive Deep RL Method for Non-Stationary Environments with Piecewise Stable Contextcited by 15
- 2021Mind the Gap when Conditioning Amortised Inference in Sequential Latent-Variable Modelscited by 14
- 2024Automatically Learning Hybrid Digital Twins of Dynamical Systemscited by 14
- 2022Latent State Marginalization as a Low-cost Approach for Improving Explorationcited by 13
- 2022On Uncertainty in Deep State Space Models for Model-Based Reinforcement Learningcited by 13
- 2021Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertaintycited by 11
- 2021Information is Power: Intrinsic Control via Information Capturecited by 11
- 2023Revisiting Structured Variational Autoencoderscited by 11
- 2021Improve Agents without Retraining: Parallel Tree Search with Off-Policy Correctioncited by 10
- 2021Learning to Assimilate in Chaotic Dynamical Systemscited by 10
- 2022Learning Robust Dynamics through Variational Sparse Gatingcited by 8
- 2022The future is different: Large pre-trained language models fail in prediction taskscited by 8
- 2023Neural Dynamic Focused Topic Modelcited by 8
- 2024State-observation augmented diffusion model for nonlinear assimilation with unknown dynamicscited by 8
- 2024Meta-Dynamical State Space Models for Integrative Neural Data Analysiscited by 8
- 2025BRAID: Input-Driven Nonlinear Dynamical Modeling of Neural-Behavioral Datacited by 8
- 2026Kalman Linear Attention: Parallel Bayesian Filtering For Efficient Language Modelling and State Trackingcited by 8
- 2024eXponential FAmily Dynamical Systems (XFADS): Large-scale nonlinear Gaussian state-space modelingcited by 7
- 2024Learning Action-based Representations Using Invariancecited by 7
- 2024Temporal Test-Time Adaptation with State-Space Modelscited by 7
- 2021VDSM: Unsupervised Video Disentanglement with State-Space Modeling and Deep Mixtures of Expertscited by 6
- 2021Learning Dynamical Systems from Noisy Sensor Measurements using Multiple Shootingcited by 6
- 2022Deep Kernel Learning of Dynamical Models from High-Dimensional Noisy Datacited by 6
- 2024Deep Bayesian Filter for Bayes-faithful Data Assimilationcited by 6
- 2022Hybrid Neural Network Augmented Physics-based Models for Nonlinear Filteringcited by 5
- 2022Neural modal ordinary differential equations: Integrating physics-based modeling with neural ordinary differential equations for modeling high-dimensional monitored structurescited by 5
- 2022Phi-DVAE: Physics-Informed Dynamical Variational Autoencoders for Unstructured Data Assimilationcited by 5
50 most cited of 166 All 166 (JSON)
- 2026AeroChem: Closed-loop Physics-Informed State Space Modeling for Long-term Chemically-Reactive Air Quality Forecasting--Extended Version12 Oct 2026
- 2026Voltic: Distinguishing Volatility from Stochasticity in Recurrent Memory5 Oct 2026
- 2026Markovian Dynamics Enforcer: Feasibility Preserving Correction on Learned Dynamics Manifolds30 Sep 2026
- 2026Learning Continuous Patient Trajectories from Electronic Health Records28 Sep 2026
- 2026Retracing Hodgkin and Huxley: State Recovery Does Not Certify Mechanism28 Sep 2026
- 2026PR-Smoother: Simulator-Preserving Non-Gaussian Smoothing for Data Assimilation22 Sep 2026
- 2026Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data16 Sep 2026
- 2026HAP: A Hand-Driven Active Perception Framework for Egocentric Head Motion Prediction16 Sep 2026
- 2026History-informed Lagrangian Neural Networks13 Aug 2026
- 2026Learning How the World Evolves: Extrapolative Video World Models via Latent Dynamics Reasoning10 Aug 2026
- 2026Operator Neural Jump ODEs: L2-optimal prediction in function spaces25 Jul 2026
- 2026Generative Bayesian Filtering for State Estimation9 Jul 2026
38 more
- 2026Liquid Latent State Dynamics for Interpretable Turbofan Degradation Modeling2 Jul 2026
- 2026Learning to Distributedly Estimate under Partially Known Dynamics: A Covariance-Agnostic Neural Kalman Consensus Filter26 Jun 2026
- 2026Diffusion-Driven State Space Models19 Jun 2026
- 2026A Deep Zero-Inflated Model of North Atlantic Right Whale Presence To Support Blue Economy Management in the U.S. East Coast12 Jun 2026
- 2026Deep Spectral Learning of Embedded Latent Transfer Operators for Stochastic Dynamical Systems12 Jun 2026
- 2026What Uncertainties Do We Need for Dynamical Systems?10 Jun 2026
- 2026Hybrid Adaptive Kalman Filtering for Data-Efficient Joint Tracking and Classification1 Jun 2026
- 2026State-Coupled Volatility in Latent Dynamical Systems: Recovery Under Partial Observation1 Jun 2026
- 2026FW-NKF: Frequency-Weighted Neural Kalman Filters1 Jun 2026
- 2026Deep ZakaiJ: Structured Filtering for Jump-Diffusion Time Series Forecasting23 May 2026
- 2026Efficient Learning of Deep State Space Models via Importance Smoothing20 May 2026
- 2026Generative Recursive Reasoning19 May 2026
- 2026Mechanism Learning: Prototype-Anchored Mechanism Inference for Scientific Forecasting16 May 2026
- 2026CognitiveTwin: Robust Multi-Modal Digital Twins for Predicting Cognitive Decline in Alzheimer's Disease24 Apr 2026
- 2026Optimizing Neurorobot Policy under Limited Demonstration Data through Preference Regret4 Apr 2026
- 2026Conditionally Identifiable Latent Representation for Multivariate Time Series with Structural Dynamics24 Mar 2026
- 2026KHMP: Frequency-Domain Kalman Refinement for High-Fidelity Human Motion Prediction22 Mar 2026
- 2026FILT3R: Latent State Adaptive Kalman Filter for Streaming 3D Reconstruction19 Mar 2026
- 2026Exploring the Dimensions of a Variational Neuron14 Mar 2026
- 2026From Gradients to Riccati Geometry: Kalman World Models for Single-Pass Learning13 Mar 2026
- 2026Latent Matters: Learning Deep State-Space Models26 Feb 2026
- 2026Federated Causal Representation Learning in State-Space Systems for Decentralized Counterfactual Reasoning23 Feb 2026
- 2026Variational Distributional Neuron20 Feb 2026
- 2026Geometry of Uncertainty: Learning Metric Spaces for Multimodal State Estimation in RL12 Feb 2026
- 2026Kalman Linear Attention: Parallel Bayesian Filtering For Efficient Language Modelling and State Tracking11 Feb 2026
- 2026LatentTrack: Sequential Weight Generation via Latent Filtering31 Jan 2026
- 2026Stabilizing autoregressive forecasts in chaotic systems via multi-rate latent recurrence20 Jan 2026
- 2025Probabilistic Hash Embeddings for Online Learning of Categorical Features25 Nov 2025
- 2025Sparse-to-Field Reconstruction via Stochastic Neural Dynamic Mode Decomposition25 Nov 2025
- 2025Filtering Jump Markov Systems with Partially Known Dynamics: A Model-Based Deep Learning Approach11 Nov 2025
- 2025Real-Time Performance Analysis of Multi-Fidelity Residual Physics-Informed Neural Process-Based State Estimation for Robotic Systems11 Nov 2025
- 2025pDANSE: Particle-based Data-driven Nonlinear State Estimation from Nonlinear Measurements31 Oct 2025
- 2025PyDPF: A Python Package for Differentiable Particle Filtering29 Oct 2025
- 2025LLM-Integrated Bayesian State Space Models for Multimodal Time-Series Forecasting23 Oct 2025
- 2025PAINT: Parallel-in-time Neural Twins for Dynamical System Reconstruction14 Oct 2025
- 2025Neural Bayesian Filtering4 Oct 2025
- 2025Double projection for reconstructing dynamical systems: between stochastic and deterministic regimes1 Oct 2025
- 2025BRAID: Input-Driven Nonlinear Dynamical Modeling of Neural-Behavioral Data23 Sep 2025
50 newest of 166 All 166 (JSON)
- 2022Learning Robust Dynamics through Variational Sparse Gatingcited by 8
- 2024Learning Abstract World Model for Value-preserving Planning with Optionscited by 4
- 2023KARNet: Kalman Filter Augmented Recurrent Neural Network for Learning World Models in Autonomous Driving Taskscited by 2
- 2024Boosting Efficiency in Task-Agnostic Exploration through Causal Knowledgecited by 1
- 2022PRISM: Probabilistic Real-Time Inference in Spatial World Modelscited by 0
- 2024Adaptive World Models: Learning Behaviors by Latent Imagination Under Non-Stationaritycited by 0
- 2026From Gradients to Riccati Geometry: Kalman World Models for Single-Pass Learningcited by 0
- 2026Learning How the World Evolves: Extrapolative Video World Models via Latent Dynamics Reasoningcited by 0
- 2026Learning How the World Evolves: Extrapolative Video World Models via Latent Dynamics Reasoning10 Aug 2026
- 2026From Gradients to Riccati Geometry: Kalman World Models for Single-Pass Learning13 Mar 2026
- 2024Adaptive World Models: Learning Behaviors by Latent Imagination Under Non-Stationarity2 Nov 2024
- 2024Boosting Efficiency in Task-Agnostic Exploration through Causal Knowledge30 Jul 2024
- 2024Learning Abstract World Model for Value-preserving Planning with Options22 Jun 2024
- 2023KARNet: Kalman Filter Augmented Recurrent Neural Network for Learning World Models in Autonomous Driving Tasks24 May 2023
- 2022PRISM: Probabilistic Real-Time Inference in Spatial World Models6 Dec 2022
- 2022Learning Robust Dynamics through Variational Sparse Gating21 Oct 2022
- 2024MADiff: Motion-Aware Mamba Diffusion Models for Hand Trajectory Prediction on Egocentric Videoscited by 18
- 2024State-observation augmented diffusion model for nonlinear assimilation with unknown dynamicscited by 8
- 2025Alternators With Noise Modelscited by 0
- 2026Deep ZakaiJ: Structured Filtering for Jump-Diffusion Time Series Forecastingcited by 0
- 2026Diffusion-Driven State Space Modelscited by 0
- 2026Learning Continuous Patient Trajectories from Electronic Health Recordscited by 0
- 2026Learning Continuous Patient Trajectories from Electronic Health Records28 Sep 2026
- 2026Diffusion-Driven State Space Models19 Jun 2026
- 2026Deep ZakaiJ: Structured Filtering for Jump-Diffusion Time Series Forecasting23 May 2026
- 2025Alternators With Noise Models18 May 2025
- 2024MADiff: Motion-Aware Mamba Diffusion Models for Hand Trajectory Prediction on Egocentric Videos4 Sep 2024
- 2024State-observation augmented diffusion model for nonlinear assimilation with unknown dynamics31 Jul 2024
- 2024Markovian Transformers for Informative Language Modelingcited by 4
- 2024Markovian Transformers for Informative Language Modeling29 Apr 2024
- 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 198
- 2021KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamicscited by 132
- 2021Modeling Irregular Time Series with Continuous Recurrent Unitscited by 103
- 2023Score-based Data Assimilationcited by 96
- 2022Criteria for Classifying Forecasting Methodscited by 48
- 2021Clockwork Variational Autoencoderscited by 42
- 2021Universal Approximation Theorems for Differentiable Geometric Deep Learningcited by 41
- 2021Contrastively Disentangled Sequential Variational Autoencodercited by 34
- 2023Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecastingcited by 34
- 2021Time Series Anomaly Detection for Cyber-Physical Systems via Neural System Identification and Bayesian Filteringcited by 31
- 2021Action-Sufficient State Representation Learning for Control with Structural Constraintscited by 31
- 2021Constructing Neural Network-Based Models for Simulating Dynamical Systemscited by 31
12 most cited of 143 All 143 (JSON)
- 2026AeroChem: Closed-loop Physics-Informed State Space Modeling for Long-term Chemically-Reactive Air Quality Forecasting--Extended Version12 Oct 2026
- 2026Voltic: Distinguishing Volatility from Stochasticity in Recurrent Memory5 Oct 2026
- 2026Markovian Dynamics Enforcer: Feasibility Preserving Correction on Learned Dynamics Manifolds30 Sep 2026
- 2026Retracing Hodgkin and Huxley: State Recovery Does Not Certify Mechanism28 Sep 2026
- 2026PR-Smoother: Simulator-Preserving Non-Gaussian Smoothing for Data Assimilation22 Sep 2026
- 2026HAP: A Hand-Driven Active Perception Framework for Egocentric Head Motion Prediction16 Sep 2026
- 2026History-informed Lagrangian Neural Networks13 Aug 2026
- 2026Operator Neural Jump ODEs: L2-optimal prediction in function spaces25 Jul 2026
- 2026Generative Bayesian Filtering for State Estimation9 Jul 2026
- 2026Liquid Latent State Dynamics for Interpretable Turbofan Degradation Modeling2 Jul 2026
- 2026Learning to Distributedly Estimate under Partially Known Dynamics: A Covariance-Agnostic Neural Kalman Consensus Filter26 Jun 2026
- 2026A Deep Zero-Inflated Model of North Atlantic Right Whale Presence To Support Blue Economy Management in the U.S. East Coast12 Jun 2026
12 newest of 143 All 143 (JSON)