Predicting Opioid Use Disorder from Longitudinal Healthcare Data using Multi-stream Transformer
Not on the map. Why?
Abstract (arXiv)
Opioid Use Disorder (OUD) is a public health crisis costing the US billions of dollars annually in healthcare, lost workplace productivity, and crime. Analyzing longitudinal healthcare data is critical in addressing many real-world problems in healthcare. Leveraging the real-world longitudinal healthcare data, we propose a novel multi-stream transformer model called MUPOD for OUD identification. MUPOD is designed to simultaneously analyze multiple types of healthcare data streams, such as medications and diagnoses, by attending to segments within and across these data streams. Our model tested on the data from 392,492 patients with long-term back pain problems showed significantly better performance than the traditional models and recently developed deep learning models.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 45 references that are in the map. First posted on arXiv 16 Mar 2021.
Builds on
22 of 45 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,291
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
- 2019Attention is not Explanationcited by 916
- 2019Attention is not not Explanationcited by 629
- 2013Generating Sequences With Recurrent Neural Networkscited by 549
- 2019Is Attention Interpretable?cited by 387
- 2016RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanismcited by 344
- 2019BEHRT: Transformer for Electronic Health Recordscited by 258
- 2015Doctor AI: Predicting Clinical Events via Recurrent Neural Networkscited by 205
10 more
- 2014Recurrent Neural Network Regularizationcited by 189
- 2019Pre-training of Graph Augmented Transformers for Medication Recommendationcited by 124
- 2017Dipole: Diagnosis Prediction in Healthcare via Attention-based Bidirectional Recurrent Neural Networkscited by 114
- 2017Attend and Diagnose: Clinical Time Series Analysis using Attention Modelscited by 105
- 2019Learning the Graphical Structure of Electronic Health Records with Graph Convolutional Transformercited by 88
- 2020Multi-channel Transformers for Multi-articulatory Sign Language Translationcited by 71
- 2016DeepCare: A Deep Dynamic Memory Model for Predictive Medicinecited by 32
- 2018Input Combination Strategies for Multi-Source Transformer Decodercited by 22
- 2019State-of-the-Art Speech Recognition Using Multi-Stream Self-Attention With Dilated 1D Convolutionscited by 11
- 2019Inpatient2Vec: Medical Representation Learning for Inpatientscited by 7
Built on by
Citing papers per year: 2022: 1.
1 paper.