Deep Learning-Based Noninvasive Screening of Type 2 Diabetes with Chest X-ray Images and Electronic Health Records
Not on the map. Why?
Abstract (arXiv)
The imperative for early detection of type 2 diabetes mellitus (T2DM) is challenged by its asymptomatic onset and dependence on suboptimal clinical diagnostic tests, contributing to its widespread global prevalence. While research into noninvasive T2DM screening tools has advanced, conventional machine learning approaches remain limited to unimodal inputs due to extensive feature engineering requirements. In contrast, deep learning models can leverage multimodal data for a more holistic understanding of patients' health conditions. However, the potential of chest X-ray (CXR) imaging, one of the most commonly performed medical procedures, remains underexplored. This study evaluates the integration of CXR images with other noninvasive data sources, including electronic health records (EHRs) and electrocardiography signals, for T2DM detection. Utilising datasets meticulously compiled from the MIMIC-IV databases, we investigated two deep fusion paradigms: an early fusion-based multimodal transformer and a modular joint fusion ResNet-LSTM architecture. The end-to-end trained ResNet-LSTM model achieved an AUROC of 0.86, surpassing the CXR-only baseline by 2.3% with just 9863 training samples. These findings demonstrate the diagnostic value of CXRs within multimodal frameworks for identifying at-risk individuals early. Additionally, the dataset preprocessing pipeline has also been released to support further research in this domain.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 69 references that are in the map. First posted on arXiv 14 Dec 2024.
Builds on
12 of 69 references.
References · 12
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
- 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 597
- 2022Multimodal Learning with Transformers: A Surveycited by 400
- 2017Multitask learning and benchmarking with clinical time series datacited by 290
- 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Reviewcited by 125
- 2017Predicting Cardiovascular Risk Factors from Retinal Fundus Photographs using Deep Learningcited by 63
- 2022MedFuse: Multi-modal fusion with clinical time-series data and chest X-ray imagescited by 54
- 2021Imbalanced Big Data Oversampling: Taxonomy, Algorithms, Software, Guidelines and Future Directionscited by 21
- 2023SACDNet: Towards Early Type 2 Diabetes Prediction with Uncertainty for Electronic Health Recordscited by 1
- 2023Machine Learning-Based Diabetes Detection Using Photoplethysmography Signal Featurescited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.