mlsanityData to 7 Oct 2026

Integrating Expert ODEs into Neural ODEs: Pharmacology and Disease Progression

arXiv 2106.02875 ↗First posted 5 Jun 2021cs.LG stat.MLcited by 48

Not on the map. Why?

Abstract (arXiv)

Modeling a system's temporal behaviour in reaction to external stimuli is a fundamental problem in many areas. Pure Machine Learning (ML) approaches often fail in the small sample regime and cannot provide actionable insights beyond predictions. A promising modification has been to incorporate expert domain knowledge into ML models. The application we consider is predicting the progression of disease under medications, where a plethora of domain knowledge is available from pharmacology. Pharmacological models describe the dynamics of carefully-chosen medically meaningful variables in terms of systems of Ordinary Differential Equations (ODEs). However, these models only describe a limited collection of variables, and these variables are often not observable in clinical environments. To close this gap, we propose the latent hybridisation model (LHM) that integrates a system of expert-designed ODEs with machine-learned Neural ODEs to fully describe the dynamics of the system and to link the expert and latent variables to observable quantities. We evaluated LHM on synthetic data as well as real-world intensive care data of COVID-19 patients. LHM consistently outperforms previous works, especially when few training samples are available such as at the beginning of the pandemic.

Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 27 of its 104 references that are in the map. First posted on arXiv 5 Jun 2021.

Builds on

27 of 104 references.

References · 27

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  3. 2013Auto-Encoding Variational Bayescited by 3,980
  4. 2018Neural Ordinary Differential Equationscited by 3,733
  5. 2015Variational Inference with Normalizing Flowscited by 2,161
  6. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
  7. 2019Hamiltonian Neural Networkscited by 702
  8. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  9. 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
  10. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  11. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
  12. 2019Augmented Neural ODEscited by 396
15 more
  1. 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 344
  2. 2017Advances in Variational Inferencecited by 236
  3. 2019GRU-ODE-Bayes: Continuous modeling of sporadically-observed time seriescited by 230
  4. 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 192
  5. 2019Symplectic ODE-Net: Learning Hamiltonian Dynamics with Controlcited by 183
  6. 2017Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modelingcited by 130
  7. 2017Learning Independent Causal Mechanismscited by 104
  8. 2019Predicting AC Optimal Power Flows: Combining Deep Learning and Lagrangian Dual Methodscited by 93
  9. 2020Augmenting Physical Models with Deep Networks for Complex Dynamics Forecastingcited by 93
  10. 2021Neural ODE Processescited by 57
  11. 2020Generative ODE Modeling with Known Unknownscited by 24
  12. 2017Learning from Clinical Judgments: Semi-Markov-Modulated Marked Hawkes Processes for Risk Prognosiscited by 18
  13. 2020Learning Insulin-Glucose Dynamics in the Wildcited by 15
  14. 2021Neural Pharmacodynamic State Space Modelingcited by 12
  15. 2019Deep Density: circumventing the Kohn-Sham equations via symmetry preserving neural networkscited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 6; 2023: 11; 2024: 9; 2025: 11; 2026: 10.

48 papers.

Sort:

By area:

  1. 2021A Framework for Machine Learning of Model Error in Dynamical Systemscited by 37
  2. 2022Predicting the impact of treatments over time with uncertainty aware neural differential equationscited by 23
  3. 2023Generalization bounds for neural ordinary differential equations and deep residual networkscited by 21
  4. 2022Fully probabilistic deep models for forward and inverse problems in parametric PDEscited by 19
  5. 2022Robust Hybrid Learning With Expert Augmentationcited by 17
  6. 2023CF-GODE: Continuous-Time Causal Inference for Multi-Agent Dynamical Systemscited by 16
  7. 2024Hybrid2 Neural ODE Causal Modeling and an Application to Glycemic Responsecited by 13
  8. 2024Automatically Learning Hybrid Digital Twins of Dynamical Systemscited by 13
  9. 2022Learning Differential Operators for Interpretable Time Series Modelingcited by 7
  10. 2022Deep Grey-Box Modeling With Adaptive Data-Driven Models Toward Trustworthy Estimation of Theory-Driven Modelscited by 6
  11. 2022Learning Interacting Dynamical Systems with Latent Gaussian Process ODEscited by 5
  12. 2024LaTiM: Longitudinal representation learning in continuous-time models to predict disease progressioncited by 5
36 more
  1. 2025Structured Kolmogorov-Arnold Neural ODEs for Interpretable Learning and Symbolic Discovery of Nonlinear Dynamicscited by 4
  2. 2025Counterfactual Probabilistic Diffusion with Expert Modelscited by 4
  3. 2025Physics-Informed Machine Learning in Biomedical Science and Engineeringcited by 4
  4. 2025Position: Biology is the Challenge Physics-Informed ML Needs to Evolvecited by 4
  5. 2023On the Generalization and Approximation Capacities of Neural Controlled Differential Equationscited by 3
  6. 2023Longitudinal Self-supervised Learning Using Neural Ordinary Differential Equationcited by 3
  7. 2024Uncertainty-Aware Optimal Treatment Selection for Clinical Time Seriescited by 3
  8. 2023Benchmarking Continuous Time Models for Predicting Multiple Sclerosis Progressioncited by 2
  9. 2023Combining Slow and Fast: Complementary Filtering for Dynamics Learningcited by 2
  10. 2023Hybrid additive modeling with partial dependence for supervised regression and dynamical systems forecastingcited by 2
  11. 2023Global Deep Forecasting with Patient-Specific Pharmacokineticscited by 2
  12. 2024Towards Automated Knowledge Integration From Human-Interpretable Representationscited by 2
  13. 2026Variational Grey-Box Dynamics Matchingcited by 2
  14. 2023Learning Hybrid Dynamics Models With Simulator-Informed Latent Statescited by 1
  15. 2024Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencodercited by 1
  16. 2024Probabilistic Temporal Prediction of Continuous Disease Trajectories and Treatment Effects Using Neural SDEscited by 1
  17. 2024Learning and Current Prediction of PMSM Drive via Differential Neural Networkscited by 1
  18. 2025Exploring Neural Ordinary Differential Equations as Interpretable Healthcare classifierscited by 1
  19. 2026LASS-ODE: Scaling ODE Computations to Connect Foundation Models with Dynamical Physical Systemscited by 1
  20. 2026Conservative Continuous-Time Treatment Optimizationcited by 1
  21. 2026TNODEV: Toolbox for Neural ODE Verificationcited by 1
  22. 2023Interpretable Mechanistic Representations for Meal-level Glycemic Control in the Wildcited by 0
  23. 2023Deep Learning with Physics Priors as Generalized Regularizerscited by 0
  24. 2024Evaluating Machine Learning Models against Clinical Protocols for Enhanced Interpretability and Continuity of Carecited by 0
  25. 2025Genetics-Driven Personalized Disease Progression Modelcited by 0
  26. 2025Continuous Temporal Learning of Probability Distributions via Neural ODEs with Applications in Continuous Glucose Monitoring Datacited by 0
  27. 2025Automatic and Structure-Aware Sparsification of Hybrid Neural ODEscited by 0
  28. 2025Temporally Detailed Hypergraph Neural ODEs for Disease Progression Modelingcited by 0
  29. 2025Generative Modeling of Clinical Time Series via Latent Stochastic Differential Equationscited by 0
  30. 2025Capturing reduced-order quantum many-body dynamics out of equilibrium via neural ordinary differential equationscited by 0
  31. 2026Robust SDE Parameter Estimation Under Missing Time Information Settingcited by 0
  32. 2026Knowledge-Informed Kernel State Reconstruction from Heterogeneous Partial Observationscited by 0
  33. 2026Sharpness-Aware Hybrid Model Learning for Architecture-Agnostic Parameter Estimationcited by 0
  34. 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structurecited by 0
  35. 2026DT2: Decision-Targeted Digital Twinscited by 0
  36. 2026Steering Neural Network Training through Interpretable Constraints Based on Partial Dependencecited by 0