Deep Normed Embeddings for Patient Representation
Not on the map. Why?
Abstract (arXiv)
We introduce a novel contrastive representation learning objective and a training scheme for clinical time series. Specifically, we project high dimensional EHR. data to a closed unit ball of low dimension, encoding geometric priors so that the origin represents an idealized perfect health state and the Euclidean norm is associated with the patient's mortality risk. Moreover, using septic patients as an example, we show how we could learn to associate the angle between two vectors with the different organ system failures, thereby, learning a compact representation which is indicative of both mortality risk and specific organ failure. We show how the learned embedding can be used for online patient monitoring, can supplement clinicians and improve performance of downstream machine learning tasks. This work was partially motivated from the desire and the need to introduce a systematic way of defining intermediate rewards for Reinforcement Learning in critical care medicine. Hence, we also show how such a design in terms of the learned embedding can result in qualitatively different policies and value distributions, as compared with using only terminal rewards.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 12 Apr 2022.
Builds on
23 of 37 references.
References · 23
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2020Supervised Contrastive Learningcited by 2,803
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2017A Distributional Perspective on Reinforcement Learningcited by 743
- 2017SphereFace: Deep Hypersphere Embedding for Face Recognitioncited by 733
- 2014Deep metric learning using Triplet networkcited by 421
- 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 374
11 more
- 2020Provable Benefit of Orthogonal Initialization in Optimizing Deep Linear Networkscited by 73
- 2017Deep Reinforcement Learning for Sepsis Treatmentcited by 71
- 2018Evaluating Reinforcement Learning Algorithms in Observational Health Settingscited by 60
- 2020Deep Representation Learning of Electronic Health Records to Unlock Patient Stratification at Scalecited by 39
- 2020An Empirical Study of Representation Learning for Reinforcement Learning in Healthcarecited by 34
- 2021Neighborhood Contrastive Learning Applied to Online Patient Monitoringcited by 32
- 2018Improving Clinical Predictions through Unsupervised Time Series Representation Learningcited by 24
- 2021Unifying Cardiovascular Modelling with Deep Reinforcement Learning for Uncertainty Aware Control of Sepsis Treatmentcited by 16
- 2019Optimizing Sequential Medical Treatments with Auto-Encoding Heuristic Search in POMDPscited by 12
- 2021Contrastive Semi-supervised Learning for ASRcited by 11
- 2019Defining Admissible Rewards for High Confidence Policy Evaluationcited by 3
Built on by
Citing papers per year: 2022: 1.
1 paper.