Modeling Latent Neural Dynamics with Gaussian Process Switching Linear Dynamical Systems
Not on the map. Why?
Abstract (arXiv)
Understanding how the collective activity of neural populations relates to computation and ultimately behavior is a key goal in neuroscience. To this end, statistical methods which describe high-dimensional neural time series in terms of low-dimensional latent dynamics have played a fundamental role in characterizing neural systems. Yet, what constitutes a successful method involves two opposing criteria: (1) methods should be expressive enough to capture complex nonlinear dynamics, and (2) they should maintain a notion of interpretability often only warranted by simpler linear models. In this paper, we develop an approach that balances these two objectives: the Gaussian Process Switching Linear Dynamical System (gpSLDS). Our method builds on previous work modeling the latent state evolution via a stochastic differential equation whose nonlinear dynamics are described by a Gaussian process (GP-SDEs). We propose a novel kernel function which enforces smoothly interpolated locally linear dynamics, and therefore expresses flexible -- yet interpretable -- dynamics akin to those of recurrent switching linear dynamical systems (rSLDS). Our approach resolves key limitations of the rSLDS such as artifactual oscillations in dynamics near discrete state boundaries, while also providing posterior uncertainty estimates of the dynamics. To fit our models, we leverage a modified learning objective which improves the estimation accuracy of kernel hyperparameters compared to previous GP-SDE fitting approaches. We apply our method to synthetic data and data recorded in two neuroscience experiments and demonstrate favorable performance in comparison to the rSLDS.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 20 of its 69 references that are in the map. First posted on arXiv 19 Jul 2024.
Builds on
20 of 69 references.
References · 20
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2014Variational Gaussian Process State-Space Modelscited by 43
- 2015Black box variational inference for state space modelscited by 31
- 2017Identification of Gaussian Process State Space Modelscited by 31
- 2019Learning interpretable continuous-time models of latent stochastic dynamical systemscited by 29
- 2018Tree-Structured Recurrent Switching Linear Dynamical Systems for Multi-Scale Modelingcited by 27
- 2021Dual Parameterization of Sparse Variational Gaussian Processescited by 19
- 2021Reverse engineering recurrent neural networks with Jacobian switching linear dynamical systemscited by 17
- 2022Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamicscited by 16
- 2015On Simplicity and Complexity in the Brave New World of Large-Scale Neurosciencecited by 15
- 2023Amortized Reparametrization: Efficient and Scalable Variational Inference for Latent SDEscited by 15
8 more
- 2023Variational Gaussian Process Diffusion Processescited by 10
- 2021Variational Inference for Continuous-Time Switching Dynamical Systemscited by 9
- 2023Expressive dynamics models with nonlinear injective readouts enable reliable recovery of latent features from neural activitycited by 6
- 2015Expectation propagation for continuous time stochastic processescited by 4
- 2020Learning non-stationary Langevin dynamics from stochastic observations of latent trajectoriescited by 3
- 2022Markov Chain Monte Carlo for Continuous-Time Switching Dynamical Systemscited by 3
- 2023Trainability, Expressivity and Interpretability in Gated Neural ODEscited by 2
- 2018Empirical fixed point bifurcation analysiscited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 6; 2026: 4.
11 papers.
- 2024Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equationscited by 4
- 2025SING: SDE Inference via Natural Gradientscited by 4
- 2026Learning-to-Defer in Non-Stationary Time Series via Switching State-Space Modelscited by 4
- 2026ODEBrain: Continuous-Time EEG Graph for Modeling Dynamic Brain Networkscited by 3
- 2025Modeling Neural Activity with Conditionally Linear Dynamical Systemscited by 1
- 2025Finding separatrices of dynamical flows with Deep Koopman Eigenfunctionscited by 1
- 2025Interpretable time series analysis with Gumbel dynamicscited by 0
- 2025Coupled Transformer Autoencoder for Disentangling Multi-Region Neural Latent Dynamicscited by 0
- 2025Nonlinear Dynamical Modeling of Human Intracranial Brain Activity with Flexible Inferencecited by 0
- 2026Machine Learning Methods for Studying Latent Neural Activity Dynamicscited by 0
- 2026Simulation-Free Learning of GP-SDEs from Irregular Observationscited by 0
- 2026Simulation-Free Learning of GP-SDEs from Irregular Observations27 Sep 2026
- 2026Machine Learning Methods for Studying Latent Neural Activity Dynamics9 Jun 2026
- 2026ODEBrain: Continuous-Time EEG Graph for Modeling Dynamic Brain Networks26 Feb 2026
- 2026Learning-to-Defer in Non-Stationary Time Series via Switching State-Space Models30 Jan 2026
- 2025Nonlinear Dynamical Modeling of Human Intracranial Brain Activity with Flexible Inference28 Dec 2025
- 2025Coupled Transformer Autoencoder for Disentangling Multi-Region Neural Latent Dynamics22 Oct 2025
- 2025Interpretable time series analysis with Gumbel dynamics25 Sep 2025
- 2025SING: SDE Inference via Natural Gradients21 Jun 2025
- 2025Finding separatrices of dynamical flows with Deep Koopman Eigenfunctions21 May 2025
- 2025Modeling Neural Activity with Conditionally Linear Dynamical Systems25 Feb 2025
- 2024Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equations1 Dec 2024