Variational Gaussian Process State-Space Models
Not on the map. Why?
Abstract (arXiv)
State-space models have been successfully used for more than fifty years in different areas of science and engineering. We present a procedure for efficient variational Bayesian learning of nonlinear state-space models based on sparse Gaussian processes. The result of learning is a tractable posterior over nonlinear dynamical systems. In comparison to conventional parametric models, we offer the possibility to straightforwardly trade off model capacity and computational cost whilst avoiding overfitting. Our main algorithm uses a hybrid inference approach combining variational Bayes and sequential Monte Carlo. We also present stochastic variational inference and online learning approaches for fast learning with long time series.
Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Jun 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 4; 2023: 13; 2024: 5; 2025: 5; 2026: 5.
43 papers.
Sort:
- 2021A Framework for Machine Learning of Model Error in Dynamical Systemscited by 37
- 2023Deep networks for system identification: a Surveycited by 35
- 2021Variational multiple shooting for Bayesian ODEs with Gaussian processescited by 15
- 2021Scalable Inference in SDEs by Direct Matching of the Fokker-Planck-Kolmogorov Equationcited by 14
- 2024Modeling Latent Neural Dynamics with Gaussian Process Switching Linear Dynamical Systemscited by 11
- 2021Structure-preserving Gaussian Process Dynamicscited by 9
- 2021Inferring the Structure of Ordinary Differential Equationscited by 7
- 2023Free-Form Variational Inference for Gaussian Process State-Space Modelscited by 7
- 2022Output-Dependent Gaussian Process State-Space Modelcited by 6
- 2025Koopman-Equivariant Gaussian Processescited by 6
- 2025Data-Efficient Kernel Methods for Learning Differential Equations and Their Solution Operators: Algorithms and Error Analysiscited by 6
- 2022Recurrent Neural Networks and Universal Approximation of Bayesian Filterscited by 5
31 more
- 2023Sequential Estimation of Gaussian Process-based Deep State-Space Modelscited by 5
- 2023Linear Time GPs for Inferring Latent Trajectories from Neural Spike Trainscited by 5
- 2023Ensemble Kalman Filtering Meets Gaussian Process SSM for Non-Mean-Field and Online Inferencecited by 5
- 2021Probabilistic Robust Linear Quadratic Regulators with Gaussian Processescited by 4
- 2023Towards Flexibility and Interpretability of Gaussian Process State-Space Modelcited by 4
- 2023Variational sparse inverse Cholesky approximation for latent Gaussian processes via double Kullback-Leibler minimizationcited by 4
- 2023Variational Nonlinear Kalman Filtering with Unknown Process Noise Covariancecited by 3
- 2023Towards Efficient Modeling and Inference in Multi-Dimensional Gaussian Process State-Space Modelscited by 3
- 2023Out of Distribution Detection via Domain-Informed Gaussian Process State Space Modelscited by 3
- 2021Keep it Simple: Data-efficient Learning for Controlling Complex Systems with Simple Modelscited by 2
- 2021Active Learning in Gaussian Process State Space Modelcited by 2
- 2022Conditional Approximate Normalizing Flows for Joint Multi-Step Probabilistic Forecasting with Application to Electricity Demandcited by 2
- 2023The Bayesian Context Trees State Space Model for time series modelling and forecastingcited by 2
- 2023Multi-Response Heteroscedastic Gaussian Process Models and Their Inferencecited by 2
- 2024Hybrid Data-Driven SSM for Interpretable and Label-Free mmWave Channel Predictioncited by 2
- 2025Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systemscited by 2
- 2021Forecasting COVID-19 Counts At A Single Hospital: A Hierarchical Bayesian Approachcited by 1
- 2021Deep Probabilistic Time Series Forecasting using Augmented Recurrent Input for Dynamic Systemscited by 1
- 2021Likelihood-Free Inference in State-Space Models with Unknown Dynamicscited by 1
- 2022Continual Learning of Multi-modal Dynamics with External Memorycited by 1
- 2024Future Aware Safe Active Learning of Time Varying Systems using Gaussian Processescited by 1
- 2024Least Squares and Marginal Log-Likelihood Model Predictive Control using Normalizing Flowscited by 1
- 2026A Predictive View on Streaming Hidden Markov Modelscited by 1
- 2026LatentFlow: A General Framework for Conditioning Stochastic Processescited by 1
- 2023A projected nonlinear state-space model for forecasting time series signalscited by 0
- 2024Recursive Gaussian Process State Space Modelcited by 0
- 2025Bayesian Nonparametric Dynamical Clustering of Time Seriescited by 0
- 2025pDANSE: Particle-based Data-driven Nonlinear State Estimation from Nonlinear Measurementscited by 0
- 2026Dynestyx: A Probabilistic Programming Library for Dynamical Systemscited by 0
- 2026PR-Smoother: Simulator-Preserving Non-Gaussian Smoothing for Data Assimilationcited by 0
- 2026Simulation-Free Learning of GP-SDEs from Irregular Observationscited by 0
- 2026Simulation-Free Learning of GP-SDEs from Irregular Observations27 Sep 2026
- 2026PR-Smoother: Simulator-Preserving Non-Gaussian Smoothing for Data Assimilation22 Sep 2026
- 2026LatentFlow: A General Framework for Conditioning Stochastic Processes14 Jul 2026
- 2026Dynestyx: A Probabilistic Programming Library for Dynamical Systems15 Jun 2026
- 2026A Predictive View on Streaming Hidden Markov Models10 Apr 2026
- 2025pDANSE: Particle-based Data-driven Nonlinear State Estimation from Nonlinear Measurements31 Oct 2025
- 2025Bayesian Nonparametric Dynamical Clustering of Time Series8 Oct 2025
- 2025Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systems24 Mar 2025
- 2025Data-Efficient Kernel Methods for Learning Differential Equations and Their Solution Operators: Algorithms and Error Analysis2 Mar 2025
- 2025Koopman-Equivariant Gaussian Processes10 Feb 2025
- 2024Recursive Gaussian Process State Space Model22 Nov 2024
- 2024Hybrid Data-Driven SSM for Interpretable and Label-Free mmWave Channel Prediction18 Nov 2024
31 more
- 2024Least Squares and Marginal Log-Likelihood Model Predictive Control using Normalizing Flows26 Sep 2024
- 2024Modeling Latent Neural Dynamics with Gaussian Process Switching Linear Dynamical Systems19 Jul 2024
- 2024Future Aware Safe Active Learning of Time Varying Systems using Gaussian Processes17 May 2024
- 2023Ensemble Kalman Filtering Meets Gaussian Process SSM for Non-Mean-Field and Online Inference10 Dec 2023
- 2023A projected nonlinear state-space model for forecasting time series signals22 Nov 2023
- 2023Out of Distribution Detection via Domain-Informed Gaussian Process State Space Models13 Sep 2023
- 2023Towards Efficient Modeling and Inference in Multi-Dimensional Gaussian Process State-Space Models3 Sep 2023
- 2023Multi-Response Heteroscedastic Gaussian Process Models and Their Inference29 Aug 2023
- 2023The Bayesian Context Trees State Space Model for time series modelling and forecasting2 Aug 2023
- 2023Linear Time GPs for Inferring Latent Trajectories from Neural Spike Trains1 Jun 2023
- 2023Variational Nonlinear Kalman Filtering with Unknown Process Noise Covariance6 May 2023
- 2023Free-Form Variational Inference for Gaussian Process State-Space Models20 Feb 2023
- 2023Variational sparse inverse Cholesky approximation for latent Gaussian processes via double Kullback-Leibler minimization30 Jan 2023
- 2023Deep networks for system identification: a Survey30 Jan 2023
- 2023Sequential Estimation of Gaussian Process-based Deep State-Space Models29 Jan 2023
- 2023Towards Flexibility and Interpretability of Gaussian Process State-Space Model21 Jan 2023
- 2022Output-Dependent Gaussian Process State-Space Model15 Dec 2022
- 2022Recurrent Neural Networks and Universal Approximation of Bayesian Filters1 Nov 2022
- 2022Continual Learning of Multi-modal Dynamics with External Memory2 Mar 2022
- 2022Conditional Approximate Normalizing Flows for Joint Multi-Step Probabilistic Forecasting with Application to Electricity Demand8 Jan 2022
- 2021Likelihood-Free Inference in State-Space Models with Unknown Dynamics2 Nov 2021
- 2021Scalable Inference in SDEs by Direct Matching of the Fokker-Planck-Kolmogorov Equation29 Oct 2021
- 2021Active Learning in Gaussian Process State Space Model30 Jul 2021
- 2021A Framework for Machine Learning of Model Error in Dynamical Systems14 Jul 2021
- 2021Inferring the Structure of Ordinary Differential Equations5 Jul 2021
- 2021Variational multiple shooting for Bayesian ODEs with Gaussian processes21 Jun 2021
- 2021Deep Probabilistic Time Series Forecasting using Augmented Recurrent Input for Dynamic Systems3 Jun 2021
- 2021Probabilistic Robust Linear Quadratic Regulators with Gaussian Processes17 May 2021
- 2021Forecasting COVID-19 Counts At A Single Hospital: A Hierarchical Bayesian Approach14 Apr 2021
- 2021Keep it Simple: Data-efficient Learning for Controlling Complex Systems with Simple Models4 Feb 2021
- 2021Structure-preserving Gaussian Process Dynamics2 Feb 2021
- 2021A Framework for Machine Learning of Model Error in Dynamical Systemscited by 37
- 2023Deep networks for system identification: a Surveycited by 35
- 2021Variational multiple shooting for Bayesian ODEs with Gaussian processescited by 15
- 2021Scalable Inference in SDEs by Direct Matching of the Fokker-Planck-Kolmogorov Equationcited by 14
- 2024Modeling Latent Neural Dynamics with Gaussian Process Switching Linear Dynamical Systemscited by 11
- 2021Structure-preserving Gaussian Process Dynamicscited by 9
- 2021Inferring the Structure of Ordinary Differential Equationscited by 7
- 2023Free-Form Variational Inference for Gaussian Process State-Space Modelscited by 7
- 2022Output-Dependent Gaussian Process State-Space Modelcited by 6
- 2025Koopman-Equivariant Gaussian Processescited by 6
- 2025Data-Efficient Kernel Methods for Learning Differential Equations and Their Solution Operators: Algorithms and Error Analysiscited by 6
- 2022Recurrent Neural Networks and Universal Approximation of Bayesian Filterscited by 5
12 most cited of 43 All 43 (JSON)
- 2026Simulation-Free Learning of GP-SDEs from Irregular Observations27 Sep 2026
- 2026PR-Smoother: Simulator-Preserving Non-Gaussian Smoothing for Data Assimilation22 Sep 2026
- 2026LatentFlow: A General Framework for Conditioning Stochastic Processes14 Jul 2026
- 2026Dynestyx: A Probabilistic Programming Library for Dynamical Systems15 Jun 2026
- 2026A Predictive View on Streaming Hidden Markov Models10 Apr 2026
- 2025pDANSE: Particle-based Data-driven Nonlinear State Estimation from Nonlinear Measurements31 Oct 2025
- 2025Bayesian Nonparametric Dynamical Clustering of Time Series8 Oct 2025
- 2025Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systems24 Mar 2025
- 2025Data-Efficient Kernel Methods for Learning Differential Equations and Their Solution Operators: Algorithms and Error Analysis2 Mar 2025
- 2025Koopman-Equivariant Gaussian Processes10 Feb 2025
- 2024Recursive Gaussian Process State Space Model22 Nov 2024
- 2024Hybrid Data-Driven SSM for Interpretable and Label-Free mmWave Channel Prediction18 Nov 2024
12 newest of 43 All 43 (JSON)