mlsanityData to 7 Oct 2026

Learning to Select the Best Forecasting Tasks for Clinical Outcome Prediction

arXiv 2407.19359 ↗First posted 28 Jul 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose to meta-learn an a self-supervised patient trajectory forecast learning rule by meta-training on a meta-objective that directly optimizes the utility of the patient representation over the subsequent clinical outcome prediction. This meta-objective directly targets the usefulness of a representation generated from unlabeled clinical measurement forecast for later supervised tasks. The meta-learned can then be directly used in target risk prediction, and the limited available samples can be used for further fine-tuning the model performance. The effectiveness of our approach is tested on a real open source patient EHR dataset MIMIC-III. We are able to demonstrate that our attention-based patient state representation approach can achieve much better performance for predicting target risk with low resources comparing with both direct supervised learning and pretraining with all-observation trajectory forecast.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 39 references that are in the map. First posted on arXiv 28 Jul 2024.

Builds on

28 of 39 references.

References · 28

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  3. 2018On First-Order Meta-Learning Algorithmscited by 1,003
  4. 2020Meta-Learning in Neural Networks: A Surveycited by 944
  5. 2017A Survey on Multi-Task Learningcited by 838
  6. 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 403
  7. 2018Scalable and accurate deep learning for electronic health recordscited by 275
  8. 2017Forward and Reverse Gradient-Based Hyperparameter Optimizationcited by 232
  9. 2019Pareto Multi-Task Learningcited by 224
  10. 2017Multi-task Self-Supervised Visual Learningcited by 200
  11. 2015Semi-supervised Sequence Learningcited by 198
  12. 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
16 more
  1. 2015Deep Kalman Filterscited by 163
  2. 2016Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Datacited by 154
  3. 2019Unsupervised State Representation Learning in Ataricited by 144
  4. 2019Fast and Flexible Multi-Task Classification Using Conditional Neural Adaptive Processescited by 131
  5. 2016Sequential Neural Models with Stochastic Layerscited by 115
  6. 2017A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learningcited by 107
  7. 2018Unsupervised Learning via Meta-Learningcited by 81
  8. 2018Meta-Learning Update Rules for Unsupervised Representation Learningcited by 37
  9. 2019MetaPred: Meta-Learning for Clinical Risk Prediction with Limited Patient Electronic Health Recordscited by 33
  10. 2019Unsupervised Curricula for Visual Meta-Reinforcement Learningcited by 33
  11. 2018Improving Clinical Predictions through Unsupervised Time Series Representation Learningcited by 24
  12. 2018DeepSOFA: A Continuous Acuity Score for Critically Ill Patients using Clinically Interpretable Deep Learningcited by 22
  13. 2019AutoSeM: Automatic Task Selection and Mixing in Multi-Task Learningcited by 22
  14. 2018Learning to Multitaskcited by 11
  15. 2019Deep Physiological State Space Model for Clinical Forecastingcited by 2
  16. 2020Learning to Multi-Task Learn for Better Neural Machine Translationcited by 1

Built on by

Not cited yet.