Integration of Large Language Models and Traditional Deep Learning for Social Determinants of Health Prediction
Not on the map. Why?
Abstract (arXiv)
Social Determinants of Health (SDoH) are economic, social and personal circumstances that affect or influence an individual's health status. SDoHs have shown to be correlated to wellness outcomes, and therefore, are useful to physicians in diagnosing diseases and in decision-making. In this work, we automatically extract SDoHs from clinical text using traditional deep learning and Large Language Models (LLMs) to find the advantages and disadvantages of each on an existing publicly available dataset. Our models outperform a previous reference point on a multilabel SDoH classification by 10 points, and we present a method and model to drastically speed up classification (12X execution time) by eliminating expensive LLM processing. The method we present combines a more nimble and efficient solution that leverages the power of the LLM for precision and traditional deep learning methods for efficiency. We also show highly performant results on a dataset supplemented with synthetic data and several traditional deep learning models that outperform LLMs. Our models and methods offer the next iteration of automatic prediction of SDoHs that impact at-risk patients.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 10 of its 25 references that are in the map. First posted on arXiv 6 May 2025.
Builds on
10 of 25 references.
References · 10
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
- 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
- 2020Multi-domain Clinical Natural Language Processing with MedCAT: the Medical Concept Annotation Toolkitcited by 66
- 2023Large Language Models to Identify Social Determinants of Health in Electronic Health Recordscited by 55
- 2018Clinical Concept Embeddings Learned from Massive Sources of Multimodal Medical Datacited by 35
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2026EPPCMinerBen: A Novel Benchmark for Evaluating Large Language Models on Electronic Patient-Provider Communication via the Patient Portalcited by 4
- 2026PyHealth 2.0: A Comprehensive Open-Source Toolkit for Accessible and Reproducible Clinical Deep Learningcited by 2
- 2025Social Determinants of Health Prediction for ICD-9 Code with Reasoning Modelscited by 0
- 2026EPPCMinerBen: A Novel Benchmark for Evaluating Large Language Models on Electronic Patient-Provider Communication via the Patient Portal4 Feb 2026
- 2026PyHealth 2.0: A Comprehensive Open-Source Toolkit for Accessible and Reproducible Clinical Deep Learning23 Jan 2026
- 2025Social Determinants of Health Prediction for ICD-9 Code with Reasoning Models14 Dec 2025