Enhancing Causal Estimation through Unlabeled Offline Data
Not on the map. Why?
Abstract (arXiv)
Consider a situation where a new patient arrives in the Intensive Care Unit (ICU) and is monitored by multiple sensors. We wish to assess relevant unmeasured physiological variables (e.g., cardiac contractility and output and vascular resistance) that have a strong effect on the patients diagnosis and treatment. We do not have any information about this specific patient, but, extensive offline information is available about previous patients, that may only be partially related to the present patient (a case of dataset shift). This information constitutes our prior knowledge, and is both partial and approximate. The basic question is how to best use this prior knowledge, combined with online patient data, to assist in diagnosing the current patient most effectively. Our proposed approach consists of three stages: (i) Use the abundant offline data in order to create both a non-causal and a causal estimator for the relevant unmeasured physiological variables. (ii) Based on the non-causal estimator constructed, and a set of measurements from a new group of patients, we construct a causal filter that provides higher accuracy in the prediction of the hidden physiological variables for this new set of patients. (iii) For any new patient arriving in the ICU, we use the constructed filter in order to predict relevant internal variables. Overall, this strategy allows us to make use of the abundantly available offline data in order to enhance causal estimation for newly arriving patients. We demonstrate the effectiveness of this methodology on a (non-medical) real-world task, in situations where the offline data is only partially related to the new observations. We provide a mathematical analysis of the merits of the approach in a linear setting of Kalman filtering and smoothing, demonstrating its utility.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 42 references that are in the map. First posted on arXiv 16 Feb 2022.
Builds on
11 of 42 references.
References · 11
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Convex optimizationcited by 2,479
- 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 374
- 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
- 2015Deep Kalman Filterscited by 163
- 2016Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Datacited by 154
- 2021Dive into Deep Learningcited by 111
- 2017A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learningcited by 107
- 2021Improving Deep Learning for HAR with shallow LSTMscited by 30
- 2021Reliable and Trustworthy Machine Learning for Health Using Dataset Shift Detectioncited by 21
- 2017Estimating Nonlinear Dynamics with the ConvNet Smoothercited by 1
Built on by
Not cited yet.