Causal hybrid modeling with double machine learning
Not on the map. Why?
Abstract (arXiv)
Hybrid modeling integrates machine learning with scientific knowledge to enhance interpretability, generalization, and adherence to natural laws. Nevertheless, equifinality and regularization biases pose challenges in hybrid modeling to achieve these purposes. This paper introduces a novel approach to estimating hybrid models via a causal inference framework, specifically employing Double Machine Learning (DML) to estimate causal effects. We showcase its use for the Earth sciences on two problems related to carbon dioxide fluxes. In the Q10 model, we demonstrate that DML-based hybrid modeling is superior in estimating causal parameters over end-to-end deep neural network (DNN) approaches, proving efficiency, robustness to bias from regularization methods, and circumventing equifinality. Our approach, applied to carbon flux partitioning, exhibits flexibility in accommodating heterogeneous causal effects. The study emphasizes the necessity of explicitly defining causal graphs and relationships, advocating for this as a general best practice. We encourage the continued exploration of causality in hybrid models for more interpretable and trustworthy results in knowledge-guided machine learning.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 96 references that are in the map. First posted on arXiv 20 Feb 2024.
Builds on
25 of 96 references.
References · 25
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023Segment Anythingcited by 8,158
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2016The Mythos of Model Interpretabilitycited by 716
- 2017Exploring Generalization in Deep Learningcited by 595
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2017Quasi-Oracle Estimation of Heterogeneous Treatment Effectscited by 328
- 2016Generalized Random Forestscited by 309
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 307
13 more
- 2018Deep Learning: A Critical Appraisalcited by 214
- 2020Pushing the Limits of Semi-Supervised Learning for Automatic Speech Recognitioncited by 185
- 2019Explainable Machine Learning for Scientific Insights and Discoveriescited by 165
- 2022Respecting causality is all you need for training physics-informed neural networkscited by 154
- 2019Orthogonal Statistical Learningcited by 150
- 2020Explainable Deep Learning: A Field Guide for the Uninitiatedcited by 127
- 2020Augmenting Physical Models with Deep Networks for Complex Dynamics Forecastingcited by 93
- 2019When Explanations Lie: Why Many Modified BP Attributions Failcited by 92
- 2022On the Implicit Bias in Deep-Learning Algorithmscited by 84
- 2023Dear XAI Community, We Need to Talk! Fundamental Misconceptions in Current XAI Researchcited by 22
- 2020Physics Guided Machine Learning Methods for Hydrologycited by 17
- 2020Physics-Aware Gaussian Processes in Remote Sensingcited by 14
- 2018Regularized Orthogonal Machine Learning for Nonlinear Semiparametric Modelscited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.