Self-supervision for health insurance claims data: a Covid-19 use case
Not on the map. Why?
Abstract (arXiv)
In this work, we modify and apply self-supervision techniques to the domain of medical health insurance claims. We model patients' healthcare claims history analogous to free-text narratives, and introduce pre-trained `prior knowledge', later utilized for patient outcome predictions on a challenging task: predicting Covid-19 hospitalization, given a patient's pre-Covid-19 insurance claims history. Results suggest that pre-training on insurance claims not only produces better prediction performance, but, more importantly, improves the model's `clinical trustworthiness' and model stability/reliability.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 40 references that are in the map. First posted on arXiv 19 Jul 2021.
Builds on
13 of 40 references.
References · 13
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2018Deep contextualized word representationscited by 2,285
- 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
- 2019BEHRT: Transformer for Electronic Health Recordscited by 258
- 2016GRAM: Graph-based Attention Model for Healthcare Representation Learningcited by 152
- 2019Pre-training of Graph Augmented Transformers for Medication Recommendationcited by 124
- 2016Multi-layer Representation Learning for Medical Conceptscited by 68
- 2016Deepr: A Convolutional Net for Medical Recordscited by 59
- 2020A Comprehensive Evaluation of Multi-task Learning and Multi-task Pre-training on EHR Time-series Datacited by 8
Built on by
Not cited yet.