mlsanityData to 7 Oct 2026

Modeling Latent Neural Dynamics with Gaussian Process Switching Linear Dynamical Systems

arXiv 2408.03330 ↗First posted 19 Jul 2024q-bio.NC cs.LG stat.MLcited by 11

Not on the map. Why?

Abstract (arXiv)

Understanding how the collective activity of neural populations relates to computation and ultimately behavior is a key goal in neuroscience. To this end, statistical methods which describe high-dimensional neural time series in terms of low-dimensional latent dynamics have played a fundamental role in characterizing neural systems. Yet, what constitutes a successful method involves two opposing criteria: (1) methods should be expressive enough to capture complex nonlinear dynamics, and (2) they should maintain a notion of interpretability often only warranted by simpler linear models. In this paper, we develop an approach that balances these two objectives: the Gaussian Process Switching Linear Dynamical System (gpSLDS). Our method builds on previous work modeling the latent state evolution via a stochastic differential equation whose nonlinear dynamics are described by a Gaussian process (GP-SDEs). We propose a novel kernel function which enforces smoothly interpolated locally linear dynamics, and therefore expresses flexible -- yet interpretable -- dynamics akin to those of recurrent switching linear dynamical systems (rSLDS). Our approach resolves key limitations of the rSLDS such as artifactual oscillations in dynamics near discrete state boundaries, while also providing posterior uncertainty estimates of the dynamics. To fit our models, we leverage a modified learning objective which improves the estimation accuracy of kernel hyperparameters compared to previous GP-SDE fitting approaches. We apply our method to synthetic data and data recorded in two neuroscience experiments and demonstrate favorable performance in comparison to the rSLDS.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 20 of its 69 references that are in the map. First posted on arXiv 19 Jul 2024.

Builds on

20 of 69 references.

References · 20

  1. 2018Neural Ordinary Differential Equationscited by 3,733
  2. 2016Variational Inference: A Review for Statisticianscited by 1,466
  3. 2014Variational Gaussian Process State-Space Modelscited by 43
  4. 2015Black box variational inference for state space modelscited by 31
  5. 2017Identification of Gaussian Process State Space Modelscited by 31
  6. 2019Learning interpretable continuous-time models of latent stochastic dynamical systemscited by 29
  7. 2018Tree-Structured Recurrent Switching Linear Dynamical Systems for Multi-Scale Modelingcited by 27
  8. 2021Dual Parameterization of Sparse Variational Gaussian Processescited by 19
  9. 2021Reverse engineering recurrent neural networks with Jacobian switching linear dynamical systemscited by 17
  10. 2022Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamicscited by 16
  11. 2015On Simplicity and Complexity in the Brave New World of Large-Scale Neurosciencecited by 15
  12. 2023Amortized Reparametrization: Efficient and Scalable Variational Inference for Latent SDEscited by 15
8 more
  1. 2023Variational Gaussian Process Diffusion Processescited by 10
  2. 2021Variational Inference for Continuous-Time Switching Dynamical Systemscited by 9
  3. 2023Expressive dynamics models with nonlinear injective readouts enable reliable recovery of latent features from neural activitycited by 6
  4. 2015Expectation propagation for continuous time stochastic processescited by 4
  5. 2020Learning non-stationary Langevin dynamics from stochastic observations of latent trajectoriescited by 3
  6. 2022Markov Chain Monte Carlo for Continuous-Time Switching Dynamical Systemscited by 3
  7. 2023Trainability, Expressivity and Interpretability in Gated Neural ODEscited by 2
  8. 2018Empirical fixed point bifurcation analysiscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 6; 2026: 4.

11 papers.