Multi-lingual Multi-institutional Electronic Health Record based Predictive Model
Not on the map. Why?
Abstract (arXiv)
Large-scale EHR prediction across institutions is hindered by substantial heterogeneity in schemas and code systems. Although Common Data Models (CDMs) can standardize records for multi-institutional learning, the manual harmonization and vocabulary mapping are costly and difficult to scale. Text-based harmonization provides an alternative by converting raw EHR into a unified textual form, enabling pooled learning without explicit standardization. However, applying this paradigm to multi-national datasets introduces an additional layer of heterogeneity, which is "language" that must be addressed for truly scalable EHRs learning. In this work, we investigate multilingual multi-institutional learning for EHR prediction, aiming to enable pooled training across multinational ICU datasets without manual standardization. We compare two practical strategies for handling language barriers: (i) directly modeling multilingual records with multilingual encoders, and (ii) translating non-English records into English via LLM-based word-level translation. Across seven public ICU datasets, ten clinical tasks with multiple prediction windows, translation-based lingual alignment yields more reliable cross-dataset performance than multilingual encoders. The multi-institutional learning model consistently outperforms strong baselines that require manual feature selection and harmonization, and also surpasses single-dataset training. We further demonstrate that text-based framework with lingual alignment effectively performs transfer learning via few-shot fine-tuning, with additional gains. To our knowledge, this is the first study to aggregate multilingual multinational ICU EHR datasets into one predictive model, providing a scalable path toward language-agnostic clinical prediction and future global multi-institutional EHR research.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 42 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
17 of 42 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2019Publicly Available Clinical BERT Embeddingscited by 1,002
- 2019How multilingual is Multilingual BERT?cited by 645
- 2018Scalable and accurate deep learning for electronic health recordscited by 280
- 2015Doctor AI: Predicting Clinical Events via Recurrent Neural Networkscited by 208
- 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 105
- 2018GAMENet: Graph Augmented MEmory Networks for Recommending Medication Combinationcited by 83
- 2021HiRID-ICU-Benchmark -- A Comprehensive Machine Learning Benchmark on High-resolution ICU Datacited by 39
- 2022GenHPF: General Healthcare Predictive Framework with Multi-task Multi-source Learningcited by 36
5 more
- 2023A Multi-Center Study on the Adaptability of a Shared Foundation Model for Electronic Health Recordscited by 31
- 2021Unifying Heterogeneous Electronic Health Records Systems via Text-Based Code Embeddingcited by 24
- 2023General-Purpose Retrieval-Enhanced Medical Prediction Model Using Near-Infinite Historycited by 12
- 2021CLIN-X: pre-trained language models and a study on cross-task transfer for concept extraction in the clinical domaincited by 7
- 2023KBioXLM: A Knowledge-anchored Biomedical Multilingual Pretrained Language Modelcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.