mlsanityData to 7 Oct 2026

Predicting Visit Cost of Obstructive Sleep Apnea using Electronic Healthcare Records with Transformer

arXiv 2301.12289 ↗First posted 28 Jan 2023cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Background: Obstructive sleep apnea (OSA) is growing increasingly prevalent in many countries as obesity rises. Sufficient, effective treatment of OSA entails high social and financial costs for healthcare. Objective: For treatment purposes, predicting OSA patients' visit expenses for the coming year is crucial. Reliable estimates enable healthcare decision-makers to perform careful fiscal management and budget well for effective distribution of resources to hospitals. The challenges created by scarcity of high-quality patient data are exacerbated by the fact that just a third of those data from OSA patients can be used to train analytics models: only OSA patients with more than 365 days of follow-up are relevant for predicting a year's expenditures. Methods and procedures: The authors propose a method applying two Transformer models, one for augmenting the input via data from shorter visit histories and the other predicting the costs by considering both the material thus enriched and cases with more than a year's follow-up. Results: The two-model solution permits putting the limited body of OSA patient data to productive use. Relative to a single-Transformer solution using only a third of the high-quality patient data, the solution with two models improved the prediction performance's R2 from 88.8% to 97.5%. Even using baseline models with the model-augmented data improved the R2 considerably, from 61.6% to 81.9%. Conclusion: The proposed method makes prediction with the most of the available high-quality data by carefully exploiting details, which are not directly relevant for answering the question of the next year's likely expenditure.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 43 of its 84 references that are in the map. First posted on arXiv 28 Jan 2023.

Builds on

43 of 84 references.

References · 43

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2022Generative Adversarial Networkscited by 5,603
  4. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  5. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  6. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  7. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  8. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  9. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  10. 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,057
  11. 2019An Introduction to Variational Autoencoderscited by 997
  12. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 800
31 more
  1. 2020Efficient Transformers: A Surveycited by 784
  2. 2015Generating Sentences from a Continuous Spacecited by 607
  3. 2021A Survey of Data Augmentation Approaches for NLPcited by 408
  4. 2021A Survey of Transformerscited by 399
  5. 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 344
  6. 2016Deep Reinforcement Learning for Dialogue Generationcited by 286
  7. 2018Scalable and accurate deep learning for electronic health recordscited by 275
  8. 2019BEHRT: Transformer for Electronic Health Recordscited by 258
  9. 2015Doctor AI: Predicting Clinical Events via Recurrent Neural Networkscited by 205
  10. 2019Leveraging Pre-trained Checkpoints for Sequence Generation Taskscited by 182
  11. 2016GRAM: Graph-based Attention Model for Healthcare Representation Learningcited by 152
  12. 2017Deep EHR: A Survey of Recent Advances in Deep Learning Techniques for Electronic Health Record (EHR) Analysiscited by 145
  13. 2018A Kernel Theory of Modern Data Augmentationcited by 106
  14. 2017Adversarial Learning for Neural Dialogue Generationcited by 103
  15. 2017Recent Advances in Recurrent Neural Networkscited by 89
  16. 2017Improved Variational Autoencoders for Text Modeling using Dilated Convolutionscited by 81
  17. 2020HEBO Pushing The Limits of Sample-Efficient Hyperparameter Optimisationcited by 81
  18. 2016Multi-layer Representation Learning for Medical Conceptscited by 68
  19. 2016Deepr: A Convolutional Net for Medical Recordscited by 59
  20. 2019Data Augmentation via Dependency Tree Morphing for Low-Resource Languagescited by 45
  21. 2018Toward Diverse Text Generation with Inverse Reinforcement Learningcited by 41
  22. 2018Performance Metrics (Error Measures) in Machine Learning Regression, Forecasting and Prognostics: Properties and Typologycited by 35
  23. 2017A Hybrid Convolutional Variational Autoencoder for Text Generationcited by 33
  24. 2016DeepCare: A Deep Dynamic Memory Model for Predictive Medicinecited by 32
  25. 2018Data Augmentation for Skin Lesion Analysiscited by 27
  26. 2020Named Entity Recognition for Social Media Texts with Semantic Augmentationcited by 23
  27. 2015Distilling Knowledge from Deep Networks with Applications to Healthcare Domaincited by 16
  28. 2019Obesity Prediction with EHR Data: A deep learning approach with interpretable elementscited by 15
  29. 2020Secondary Use of Electronic Health Record: Opportunities and Challengescited by 14
  30. 2022Textual Data Augmentation for Patient Outcomes Predictioncited by 6
  31. 2021Bootstrapping Your Own Positive Sample: Contrastive Learning With Electronic Health Record Datacited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.