mlsanityData to 7 Oct 2026

Improving Social Determinants of Health Documentation in French EHRs Using Large Language Models

arXiv 2507.03433 ↗First posted 4 Jul 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Social determinants of health (SDoH) significantly influence health outcomes, shaping disease progression, treatment adherence, and health disparities. However, their documentation in structured electronic health records (EHRs) is often incomplete or missing. This study presents an approach based on large language models (LLMs) for extracting 13 SDoH categories from French clinical notes. We trained Flan-T5-Large on annotated social history sections from clinical notes at Nantes University Hospital, France. We evaluated the model at two levels: (i) identification of SDoH categories and associated values, and (ii) extraction of detailed SDoH with associated temporal and quantitative information. The model performance was assessed across four datasets, including two that we publicly release as open resources. The model achieved strong performance for identifying well-documented categories such as living condition, marital status, descendants, job, tobacco, and alcohol use (F1 score > 0.80). Performance was lower for categories with limited training data or highly variable expressions, such as employment status, housing, physical activity, income, and education. Our model identified 95.8% of patients with at least one SDoH, compared to 2.8% for ICD-10 codes from structured EHR data. Our error analysis showed that performance limitations were linked to annotation inconsistencies, reliance on English-centric tokenizer, and reduced generalizability due to the model being trained on social history sections only. These results demonstrate the effectiveness of NLP in improving the completeness of real-world SDoH data in a non-English EHR system.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 58 references that are in the map. First posted on arXiv 4 Jul 2025.

Builds on

12 of 58 references.

References · 12

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  3. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  4. 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 275
  5. 2023Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMscited by 103
  6. 2023Large Language Models to Identify Social Determinants of Health in Electronic Health Recordscited by 55
  7. 2020Annotating Social Determinants of Health Using Active Learning, and Characterizing Determinants Using Neural Event Extractioncited by 32
  8. 2022Geographic and Geopolitical Biases of Language Modelscited by 29
  9. 2023The 2022 n2c2/UW Shared Task on Extracting Social Determinants of Healthcited by 21
  10. 2021A Study of Social and Behavioral Determinants of Health in Lung Cancer Patients Using Transformers-based Natural Language Processing Modelscited by 11
  11. 2022Associations Between Natural Language Processing (NLP) Enriched Social Determinants of Health and Suicide Death among US Veteranscited by 5
  12. 2024Extracting Social Support and Social Isolation Information from Clinical Psychiatry Notes: Comparing a Rule-based NLP System and a Large Language Modelcited by 2

Built on by

Not cited yet.