mlsanityData to 7 Oct 2026

Deep learning and differential equations for modeling changes in individual-level latent dynamics between observation periods

arXiv 2202.07403 ↗First posted 15 Feb 2022stat.ML cs.LG stat.APcited by 1

Not on the map. Why?

Abstract (arXiv)

When modeling longitudinal biomedical data, often dimensionality reduction as well as dynamic modeling in the resulting latent representation is needed. This can be achieved by artificial neural networks for dimension reduction, and differential equations for dynamic modeling of individual-level trajectories. However, such approaches so far assume that parameters of individual-level dynamics are constant throughout the observation period. Motivated by an application from psychological resilience research, we propose an extension where different sets of differential equation parameters are allowed for observation sub-periods. Still, estimation for intra-individual sub-periods is coupled for being able to fit the model also with a relatively small dataset. We subsequently derive prediction targets from individual dynamic models of resilience in the application. These serve as interpretable resilience-related outcomes, to be predicted from characteristics of individuals, measured at baseline and a follow-up time point, and selecting a small set of important predictors. Our approach is seen to successfully identify individual-level parameters of dynamic models that allows us to stably select predictors, i.e., resilience factors. Furthermore, we can identify those characteristics of individuals that are the most promising for updates at follow-up, which might inform future study design. This underlines the usefulness of our proposed deep dynamic modeling approach with changes in parameters between observation sub-periods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 71 references that are in the map. First posted on arXiv 15 Feb 2022.

Builds on

19 of 71 references.

References · 19

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2013Auto-Encoding Variational Bayescited by 3,980
  3. 2018Neural Ordinary Differential Equationscited by 3,733
  4. 2016Variational Inference: A Review for Statisticianscited by 1,466
  5. 2019An Introduction to Variational Autoencoderscited by 997
  6. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
  7. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
  8. 2020Universal Differential Equations for Scientific Machine Learningcited by 345
  9. 2020Scalable Gradients for Stochastic Differential Equationscited by 264
  10. 2019Latent ODEs for Irregularly-Sampled Time Seriescited by 182
  11. 2018Handling Incomplete Heterogeneous Data using VAEscited by 148
  12. 2019Neural Jump Stochastic Differential Equationscited by 147
7 more
  1. 2020Dynamical Variational Autoencoders: A Comprehensive Reviewcited by 127
  2. 2019A Differentiable Programming System to Bridge Machine Learning and Scientific Computingcited by 81
  3. 2018Fashionable Modelling with Fluxcited by 53
  4. 2021Anomaly Detection of Time Series with Smoothness-Inducing Sequential Variational Auto-Encodercited by 39
  5. 2019DiffEqFlux.jl - A Julia Library for Neural Differential Equationscited by 33
  6. 2020Deep dynamic modeling with just two time points: Can we still allow for individual trajectories?cited by 6
  7. 2020Using Differentiable Programming for Flexible Statistical Modelingcited by 3

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.