Integrating Expert ODEs into Neural ODEs: Pharmacology and Disease Progression
Not on the map. Why?
Abstract (arXiv)
Modeling a system's temporal behaviour in reaction to external stimuli is a fundamental problem in many areas. Pure Machine Learning (ML) approaches often fail in the small sample regime and cannot provide actionable insights beyond predictions. A promising modification has been to incorporate expert domain knowledge into ML models. The application we consider is predicting the progression of disease under medications, where a plethora of domain knowledge is available from pharmacology. Pharmacological models describe the dynamics of carefully-chosen medically meaningful variables in terms of systems of Ordinary Differential Equations (ODEs). However, these models only describe a limited collection of variables, and these variables are often not observable in clinical environments. To close this gap, we propose the latent hybridisation model (LHM) that integrates a system of expert-designed ODEs with machine-learned Neural ODEs to fully describe the dynamics of the system and to link the expert and latent variables to observable quantities. We evaluated LHM on synthetic data as well as real-world intensive care data of COVID-19 patients. LHM consistently outperforms previous works, especially when few training samples are available such as at the beginning of the pandemic.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 27 of its 104 references that are in the map. First posted on arXiv 5 Jun 2021.
Builds on
27 of 104 references.
References · 27
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2019Hamiltonian Neural Networkscited by 702
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
- 2017Solving high-dimensional partial differential equations using deep learningcited by 549
- 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 501
- 2019Augmented Neural ODEscited by 396
15 more
- 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 344
- 2017Advances in Variational Inferencecited by 236
- 2019GRU-ODE-Bayes: Continuous modeling of sporadically-observed time seriescited by 230
- 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 192
- 2019Symplectic ODE-Net: Learning Hamiltonian Dynamics with Controlcited by 183
- 2017Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modelingcited by 130
- 2017Learning Independent Causal Mechanismscited by 104
- 2019Predicting AC Optimal Power Flows: Combining Deep Learning and Lagrangian Dual Methodscited by 93
- 2020Augmenting Physical Models with Deep Networks for Complex Dynamics Forecastingcited by 93
- 2021Neural ODE Processescited by 57
- 2020Generative ODE Modeling with Known Unknownscited by 24
- 2017Learning from Clinical Judgments: Semi-Markov-Modulated Marked Hawkes Processes for Risk Prognosiscited by 18
- 2020Learning Insulin-Glucose Dynamics in the Wildcited by 15
- 2021Neural Pharmacodynamic State Space Modelingcited by 12
- 2019Deep Density: circumventing the Kohn-Sham equations via symmetry preserving neural networkscited by 10
Built on by
Citing papers per year: 2021: 1; 2022: 6; 2023: 11; 2024: 9; 2025: 11; 2026: 10.
48 papers.
Sort:
By area:
- 2021A Framework for Machine Learning of Model Error in Dynamical Systemscited by 37
- 2022Predicting the impact of treatments over time with uncertainty aware neural differential equationscited by 23
- 2023Generalization bounds for neural ordinary differential equations and deep residual networkscited by 21
- 2022Fully probabilistic deep models for forward and inverse problems in parametric PDEscited by 19
- 2022Robust Hybrid Learning With Expert Augmentationcited by 17
- 2023CF-GODE: Continuous-Time Causal Inference for Multi-Agent Dynamical Systemscited by 16
- 2024Hybrid2 Neural ODE Causal Modeling and an Application to Glycemic Responsecited by 13
- 2024Automatically Learning Hybrid Digital Twins of Dynamical Systemscited by 13
- 2022Learning Differential Operators for Interpretable Time Series Modelingcited by 7
- 2022Deep Grey-Box Modeling With Adaptive Data-Driven Models Toward Trustworthy Estimation of Theory-Driven Modelscited by 6
- 2022Learning Interacting Dynamical Systems with Latent Gaussian Process ODEscited by 5
- 2024LaTiM: Longitudinal representation learning in continuous-time models to predict disease progressioncited by 5
36 more
- 2025Structured Kolmogorov-Arnold Neural ODEs for Interpretable Learning and Symbolic Discovery of Nonlinear Dynamicscited by 4
- 2025Counterfactual Probabilistic Diffusion with Expert Modelscited by 4
- 2025Physics-Informed Machine Learning in Biomedical Science and Engineeringcited by 4
- 2025Position: Biology is the Challenge Physics-Informed ML Needs to Evolvecited by 4
- 2023On the Generalization and Approximation Capacities of Neural Controlled Differential Equationscited by 3
- 2023Longitudinal Self-supervised Learning Using Neural Ordinary Differential Equationcited by 3
- 2024Uncertainty-Aware Optimal Treatment Selection for Clinical Time Seriescited by 3
- 2023Benchmarking Continuous Time Models for Predicting Multiple Sclerosis Progressioncited by 2
- 2023Combining Slow and Fast: Complementary Filtering for Dynamics Learningcited by 2
- 2023Hybrid additive modeling with partial dependence for supervised regression and dynamical systems forecastingcited by 2
- 2023Global Deep Forecasting with Patient-Specific Pharmacokineticscited by 2
- 2024Towards Automated Knowledge Integration From Human-Interpretable Representationscited by 2
- 2026Variational Grey-Box Dynamics Matchingcited by 2
- 2023Learning Hybrid Dynamics Models With Simulator-Informed Latent Statescited by 1
- 2024Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencodercited by 1
- 2024Probabilistic Temporal Prediction of Continuous Disease Trajectories and Treatment Effects Using Neural SDEscited by 1
- 2024Learning and Current Prediction of PMSM Drive via Differential Neural Networkscited by 1
- 2025Exploring Neural Ordinary Differential Equations as Interpretable Healthcare classifierscited by 1
- 2026LASS-ODE: Scaling ODE Computations to Connect Foundation Models with Dynamical Physical Systemscited by 1
- 2026Conservative Continuous-Time Treatment Optimizationcited by 1
- 2026TNODEV: Toolbox for Neural ODE Verificationcited by 1
- 2023Interpretable Mechanistic Representations for Meal-level Glycemic Control in the Wildcited by 0
- 2023Deep Learning with Physics Priors as Generalized Regularizerscited by 0
- 2024Evaluating Machine Learning Models against Clinical Protocols for Enhanced Interpretability and Continuity of Carecited by 0
- 2025Genetics-Driven Personalized Disease Progression Modelcited by 0
- 2025Continuous Temporal Learning of Probability Distributions via Neural ODEs with Applications in Continuous Glucose Monitoring Datacited by 0
- 2025Automatic and Structure-Aware Sparsification of Hybrid Neural ODEscited by 0
- 2025Temporally Detailed Hypergraph Neural ODEs for Disease Progression Modelingcited by 0
- 2025Generative Modeling of Clinical Time Series via Latent Stochastic Differential Equationscited by 0
- 2025Capturing reduced-order quantum many-body dynamics out of equilibrium via neural ordinary differential equationscited by 0
- 2026Robust SDE Parameter Estimation Under Missing Time Information Settingcited by 0
- 2026Knowledge-Informed Kernel State Reconstruction from Heterogeneous Partial Observationscited by 0
- 2026Sharpness-Aware Hybrid Model Learning for Architecture-Agnostic Parameter Estimationcited by 0
- 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structurecited by 0
- 2026DT2: Decision-Targeted Digital Twinscited by 0
- 2026Steering Neural Network Training through Interpretable Constraints Based on Partial Dependencecited by 0
- 2026Steering Neural Network Training through Interpretable Constraints Based on Partial Dependence9 Jul 2026
- 2026DT2: Decision-Targeted Digital Twins24 Jun 2026
- 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structure16 Jun 2026
- 2026TNODEV: Toolbox for Neural ODE Verification15 Jun 2026
- 2026Conservative Continuous-Time Treatment Optimization17 Mar 2026
- 2026Variational Grey-Box Dynamics Matching19 Feb 2026
- 2026Sharpness-Aware Hybrid Model Learning for Architecture-Agnostic Parameter Estimation6 Feb 2026
- 2026LASS-ODE: Scaling ODE Computations to Connect Foundation Models with Dynamical Physical Systems1 Feb 2026
- 2026Knowledge-Informed Kernel State Reconstruction from Heterogeneous Partial Observations29 Jan 2026
- 2026Robust SDE Parameter Estimation Under Missing Time Information Setting28 Jan 2026
- 2025Capturing reduced-order quantum many-body dynamics out of equilibrium via neural ordinary differential equations15 Dec 2025
- 2025Generative Modeling of Clinical Time Series via Latent Stochastic Differential Equations20 Nov 2025
36 more
- 2025Position: Biology is the Challenge Physics-Informed ML Needs to Evolve29 Oct 2025
- 2025Temporally Detailed Hypergraph Neural ODEs for Disease Progression Modeling20 Oct 2025
- 2025Physics-Informed Machine Learning in Biomedical Science and Engineering6 Oct 2025
- 2025Counterfactual Probabilistic Diffusion with Expert Models18 Aug 2025
- 2025Structured Kolmogorov-Arnold Neural ODEs for Interpretable Learning and Symbolic Discovery of Nonlinear Dynamics23 Jun 2025
- 2025Automatic and Structure-Aware Sparsification of Hybrid Neural ODEs25 May 2025
- 2025Continuous Temporal Learning of Probability Distributions via Neural ODEs with Applications in Continuous Glucose Monitoring Data13 May 2025
- 2025Exploring Neural Ordinary Differential Equations as Interpretable Healthcare classifiers5 Mar 2025
- 2025Genetics-Driven Personalized Disease Progression Model24 Feb 2025
- 2024Learning and Current Prediction of PMSM Drive via Differential Neural Networks12 Dec 2024
- 2024Evaluating Machine Learning Models against Clinical Protocols for Enhanced Interpretability and Continuity of Care5 Nov 2024
- 2024Automatically Learning Hybrid Digital Twins of Dynamical Systems31 Oct 2024
- 2024Uncertainty-Aware Optimal Treatment Selection for Clinical Time Series11 Oct 2024
- 2024Probabilistic Temporal Prediction of Continuous Disease Trajectories and Treatment Effects Using Neural SDEs18 Jun 2024
- 2024Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencoder18 Apr 2024
- 2024LaTiM: Longitudinal representation learning in continuous-time models to predict disease progression10 Apr 2024
- 2024Hybrid2 Neural ODE Causal Modeling and an Application to Glycemic Response27 Feb 2024
- 2024Towards Automated Knowledge Integration From Human-Interpretable Representations25 Feb 2024
- 2023Deep Learning with Physics Priors as Generalized Regularizers14 Dec 2023
- 2023Interpretable Mechanistic Representations for Meal-level Glycemic Control in the Wild6 Dec 2023
- 2023Longitudinal Self-supervised Learning Using Neural Ordinary Differential Equation16 Oct 2023
- 2023Global Deep Forecasting with Patient-Specific Pharmacokinetics22 Sep 2023
- 2023Learning Hybrid Dynamics Models With Simulator-Informed Latent States6 Sep 2023
- 2023Hybrid additive modeling with partial dependence for supervised regression and dynamical systems forecasting5 Jul 2023
- 2023CF-GODE: Continuous-Time Causal Inference for Multi-Agent Dynamical Systems20 Jun 2023
- 2023On the Generalization and Approximation Capacities of Neural Controlled Differential Equations26 May 2023
- 2023Generalization bounds for neural ordinary differential equations and deep residual networks11 May 2023
- 2023Combining Slow and Fast: Complementary Filtering for Dynamics Learning27 Feb 2023
- 2023Benchmarking Continuous Time Models for Predicting Multiple Sclerosis Progression15 Feb 2023
- 2022Deep Grey-Box Modeling With Adaptive Data-Driven Models Toward Trustworthy Estimation of Theory-Driven Models24 Oct 2022
- 2022Learning Differential Operators for Interpretable Time Series Modeling3 Sep 2022
- 2022Fully probabilistic deep models for forward and inverse problems in parametric PDEs9 Aug 2022
- 2022Learning Interacting Dynamical Systems with Latent Gaussian Process ODEs24 May 2022
- 2022Predicting the impact of treatments over time with uncertainty aware neural differential equations24 Feb 2022
- 2022Robust Hybrid Learning With Expert Augmentation8 Feb 2022
- 2021A Framework for Machine Learning of Model Error in Dynamical Systems14 Jul 2021
- 2026Variational Grey-Box Dynamics Matchingcited by 2
- 2026Variational Grey-Box Dynamics Matching19 Feb 2026
- 2021A Framework for Machine Learning of Model Error in Dynamical Systemscited by 37
- 2022Predicting the impact of treatments over time with uncertainty aware neural differential equationscited by 23
- 2023Generalization bounds for neural ordinary differential equations and deep residual networkscited by 21
- 2022Fully probabilistic deep models for forward and inverse problems in parametric PDEscited by 19
- 2022Robust Hybrid Learning With Expert Augmentationcited by 17
- 2023CF-GODE: Continuous-Time Causal Inference for Multi-Agent Dynamical Systemscited by 16
- 2024Hybrid2 Neural ODE Causal Modeling and an Application to Glycemic Responsecited by 13
- 2024Automatically Learning Hybrid Digital Twins of Dynamical Systemscited by 13
- 2022Learning Differential Operators for Interpretable Time Series Modelingcited by 7
- 2022Deep Grey-Box Modeling With Adaptive Data-Driven Models Toward Trustworthy Estimation of Theory-Driven Modelscited by 6
- 2022Learning Interacting Dynamical Systems with Latent Gaussian Process ODEscited by 5
- 2024LaTiM: Longitudinal representation learning in continuous-time models to predict disease progressioncited by 5
12 most cited of 47 All 47 (JSON)
- 2026Steering Neural Network Training through Interpretable Constraints Based on Partial Dependence9 Jul 2026
- 2026DT2: Decision-Targeted Digital Twins24 Jun 2026
- 2026Learning Cardiac Electrophysiology Digital Twins Through Agentic Discovery of Hybrid Structure16 Jun 2026
- 2026TNODEV: Toolbox for Neural ODE Verification15 Jun 2026
- 2026Conservative Continuous-Time Treatment Optimization17 Mar 2026
- 2026Sharpness-Aware Hybrid Model Learning for Architecture-Agnostic Parameter Estimation6 Feb 2026
- 2026LASS-ODE: Scaling ODE Computations to Connect Foundation Models with Dynamical Physical Systems1 Feb 2026
- 2026Knowledge-Informed Kernel State Reconstruction from Heterogeneous Partial Observations29 Jan 2026
- 2026Robust SDE Parameter Estimation Under Missing Time Information Setting28 Jan 2026
- 2025Capturing reduced-order quantum many-body dynamics out of equilibrium via neural ordinary differential equations15 Dec 2025
- 2025Generative Modeling of Clinical Time Series via Latent Stochastic Differential Equations20 Nov 2025
- 2025Position: Biology is the Challenge Physics-Informed ML Needs to Evolve29 Oct 2025
12 newest of 47 All 47 (JSON)