Learning to Select the Best Forecasting Tasks for Clinical Outcome Prediction
Not on the map. Why?
Abstract (arXiv)
We propose to meta-learn an a self-supervised patient trajectory forecast learning rule by meta-training on a meta-objective that directly optimizes the utility of the patient representation over the subsequent clinical outcome prediction. This meta-objective directly targets the usefulness of a representation generated from unlabeled clinical measurement forecast for later supervised tasks. The meta-learned can then be directly used in target risk prediction, and the limited available samples can be used for further fine-tuning the model performance. The effectiveness of our approach is tested on a real open source patient EHR dataset MIMIC-III. We are able to demonstrate that our attention-based patient state representation approach can achieve much better performance for predicting target risk with low resources comparing with both direct supervised learning and pretraining with all-observation trajectory forecast.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 39 references that are in the map. First posted on arXiv 28 Jul 2024.
Builds on
28 of 39 references.
References · 28
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2018On First-Order Meta-Learning Algorithmscited by 1,003
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
- 2017A Survey on Multi-Task Learningcited by 838
- 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 403
- 2018Scalable and accurate deep learning for electronic health recordscited by 275
- 2017Forward and Reverse Gradient-Based Hyperparameter Optimizationcited by 232
- 2019Pareto Multi-Task Learningcited by 224
- 2017Multi-task Self-Supervised Visual Learningcited by 200
- 2015Semi-supervised Sequence Learningcited by 198
- 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
16 more
- 2015Deep Kalman Filterscited by 163
- 2016Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Datacited by 154
- 2019Unsupervised State Representation Learning in Ataricited by 144
- 2019Fast and Flexible Multi-Task Classification Using Conditional Neural Adaptive Processescited by 131
- 2016Sequential Neural Models with Stochastic Layerscited by 115
- 2017A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learningcited by 107
- 2018Unsupervised Learning via Meta-Learningcited by 81
- 2018Meta-Learning Update Rules for Unsupervised Representation Learningcited by 37
- 2019MetaPred: Meta-Learning for Clinical Risk Prediction with Limited Patient Electronic Health Recordscited by 33
- 2019Unsupervised Curricula for Visual Meta-Reinforcement Learningcited by 33
- 2018Improving Clinical Predictions through Unsupervised Time Series Representation Learningcited by 24
- 2018DeepSOFA: A Continuous Acuity Score for Critically Ill Patients using Clinically Interpretable Deep Learningcited by 22
- 2019AutoSeM: Automatic Task Selection and Mixing in Multi-Task Learningcited by 22
- 2018Learning to Multitaskcited by 11
- 2019Deep Physiological State Space Model for Clinical Forecastingcited by 2
- 2020Learning to Multi-Task Learn for Better Neural Machine Translationcited by 1
Built on by
Not cited yet.