mlsanityData to 7 Oct 2026

Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equations

arXiv 2412.12112 ↗First posted 1 Dec 2024q-bio.NC cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

We propose a probabilistic framework for developing computational models of biological neural systems. In this framework, physiological recordings are viewed as discrete-time partial observations of an underlying continuous-time stochastic dynamical system which implements computations through its state evolution. To model this dynamical system, we employ a system of coupled stochastic differential equations with differentiable drift and diffusion functions and use variational inference to infer its states and parameters. This formulation enables seamless integration of existing mathematical models in the literature, neural networks, or a hybrid of both to learn and compare different models. We demonstrate this in our framework by developing a generative model that combines coupled oscillators with neural networks to capture latent population dynamics from single-cell recordings. Evaluation across three neuroscience datasets spanning different species, brain regions, and behavioral tasks show that these hybrid models achieve competitive performance in predicting stimulus-evoked neural and behavioral responses compared to sophisticated black-box approaches while requiring an order of magnitude fewer parameters, providing uncertainty estimates, and offering a natural language for interpretation.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 29 of its 87 references that are in the map. First posted on arXiv 1 Dec 2024.

Builds on

29 of 87 references.

References · 29

  1. 2018Neural Ordinary Differential Equationscited by 3,733
  2. 2016Variational Inference: A Review for Statisticianscited by 1,466
  3. 2020Universal Differential Equations for Scientific Machine Learningcited by 345
  4. 2020Scalable Gradients for Stochastic Differential Equationscited by 264
  5. 2022On Neural Differential Equationscited by 264
  6. 2019Neural Stochastic Differential Equations: Deep Latent Gaussian Models in the Diffusion Limitcited by 168
  7. 2019Theoretical guarantees for sampling and inference in generative models with latent diffusionscited by 97
  8. 2020Coupled Oscillatory Recurrent Neural Network (coRNN): An accurate and (gradient) stable architecture for learning long time dependenciescited by 81
  9. 2021Attractor and integrator networks in the braincited by 60
  10. 2021Neural Latents Benchmark '21: Evaluating latent variable models of neural population activitycited by 57
  11. 2014Variational Recurrent Auto-Encoderscited by 53
  12. 2020Learning identifiable and interpretable latent models of high-dimensional neural activity using pi-VAEcited by 48
17 more
  1. 2024Stable Neural Stochastic Differential Equations in Analyzing Irregular Time Series Datacited by 35
  2. 2024Oscillatory State-Space Modelscited by 35
  3. 2019Learning interpretable continuous-time models of latent stochastic dynamical systemscited by 29
  4. 2021Large-scale neural recordings call for new insights to link brain and behaviorcited by 28
  5. 2020Identifying Latent Stochastic Differential Equationscited by 21
  6. 2024Trajectory Flow Matching with Applications to Clinical Time Series Modelingcited by 21
  7. 2021Targeted Neural Dynamical Modelingcited by 18
  8. 2023Latent SDEs on Homogeneous Spacescited by 16
  9. 2015On Simplicity and Complexity in the Brave New World of Large-Scale Neurosciencecited by 15
  10. 2023Amortized Reparametrization: Efficient and Scalable Variational Inference for Latent SDEscited by 15
  11. 2024Inferring stochastic low-rank recurrent neural networks from neural datacited by 15
  12. 2024Modeling Latent Neural Dynamics with Gaussian Process Switching Linear Dynamical Systemscited by 11
  13. 2021Building population models for large-scale neural recordings: opportunities and pitfallscited by 9
  14. 2023Expressive dynamics models with nonlinear injective readouts enable reliable recovery of latent features from neural activitycited by 6
  15. 2024Universal Differential Equations as a Common Modeling Language for Neurosciencecited by 4
  16. 2023Effective Latent Differential Equation Models via Attention and Multiple Shootingcited by 2
  17. 2021Simulations Approaching Data: Cortical Slow Waves in Inferred Models of the Whole Hemisphere of Mousecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.