Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equations
Not on the map. Why?
Abstract (arXiv)
We propose a probabilistic framework for developing computational models of biological neural systems. In this framework, physiological recordings are viewed as discrete-time partial observations of an underlying continuous-time stochastic dynamical system which implements computations through its state evolution. To model this dynamical system, we employ a system of coupled stochastic differential equations with differentiable drift and diffusion functions and use variational inference to infer its states and parameters. This formulation enables seamless integration of existing mathematical models in the literature, neural networks, or a hybrid of both to learn and compare different models. We demonstrate this in our framework by developing a generative model that combines coupled oscillators with neural networks to capture latent population dynamics from single-cell recordings. Evaluation across three neuroscience datasets spanning different species, brain regions, and behavioral tasks show that these hybrid models achieve competitive performance in predicting stimulus-evoked neural and behavioral responses compared to sophisticated black-box approaches while requiring an order of magnitude fewer parameters, providing uncertainty estimates, and offering a natural language for interpretation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 29 of its 87 references that are in the map. First posted on arXiv 1 Dec 2024.
Builds on
29 of 87 references.
References · 29
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2020Universal Differential Equations for Scientific Machine Learningcited by 345
- 2020Scalable Gradients for Stochastic Differential Equationscited by 264
- 2022On Neural Differential Equationscited by 264
- 2019Neural Stochastic Differential Equations: Deep Latent Gaussian Models in the Diffusion Limitcited by 168
- 2019Theoretical guarantees for sampling and inference in generative models with latent diffusionscited by 97
- 2020Coupled Oscillatory Recurrent Neural Network (coRNN): An accurate and (gradient) stable architecture for learning long time dependenciescited by 81
- 2021Attractor and integrator networks in the braincited by 60
- 2021Neural Latents Benchmark '21: Evaluating latent variable models of neural population activitycited by 57
- 2014Variational Recurrent Auto-Encoderscited by 53
- 2020Learning identifiable and interpretable latent models of high-dimensional neural activity using pi-VAEcited by 48
17 more
- 2024Stable Neural Stochastic Differential Equations in Analyzing Irregular Time Series Datacited by 35
- 2024Oscillatory State-Space Modelscited by 35
- 2019Learning interpretable continuous-time models of latent stochastic dynamical systemscited by 29
- 2021Large-scale neural recordings call for new insights to link brain and behaviorcited by 28
- 2020Identifying Latent Stochastic Differential Equationscited by 21
- 2024Trajectory Flow Matching with Applications to Clinical Time Series Modelingcited by 21
- 2021Targeted Neural Dynamical Modelingcited by 18
- 2023Latent SDEs on Homogeneous Spacescited by 16
- 2015On Simplicity and Complexity in the Brave New World of Large-Scale Neurosciencecited by 15
- 2023Amortized Reparametrization: Efficient and Scalable Variational Inference for Latent SDEscited by 15
- 2024Inferring stochastic low-rank recurrent neural networks from neural datacited by 15
- 2024Modeling Latent Neural Dynamics with Gaussian Process Switching Linear Dynamical Systemscited by 11
- 2021Building population models for large-scale neural recordings: opportunities and pitfallscited by 9
- 2023Expressive dynamics models with nonlinear injective readouts enable reliable recovery of latent features from neural activitycited by 6
- 2024Universal Differential Equations as a Common Modeling Language for Neurosciencecited by 4
- 2023Effective Latent Differential Equation Models via Attention and Multiple Shootingcited by 2
- 2021Simulations Approaching Data: Cortical Slow Waves in Inferred Models of the Whole Hemisphere of Mousecited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025SDE Matching: Scalable and Simulation-Free Training of Latent Stochastic Differential Equationscited by 19
- 2025Generative Modeling of Clinical Time Series via Latent Stochastic Differential Equationscited by 0
- 2026Probabilistic Prediction of Neural Dynamics via Autoregressive Flow Matchingcited by 0
- 2026Learning Implicit Causal World Models from Multi-Agent Demonstrationscited by 0
- 2026Learning Implicit Causal World Models from Multi-Agent Demonstrations28 Jul 2026
- 2026Probabilistic Prediction of Neural Dynamics via Autoregressive Flow Matching13 Apr 2026
- 2025Generative Modeling of Clinical Time Series via Latent Stochastic Differential Equations20 Nov 2025
- 2025SDE Matching: Scalable and Simulation-Free Training of Latent Stochastic Differential Equations4 Feb 2025