mlsanityData to 14 Oct 2026

Bridging the EHR Divide: Asymmetric Contrastive Learning for Cross-National Medical Representation Transfer

arXiv 2610.04946 ↗First posted 4 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Cross-system transfer of longitudinal Electronic Health Record (EHR) representations is challenging because clinical coding, patient populations, and healthcare workflows differ substantially across institutions and countries. We introduce Asymmetric Supervised Contrastive Learning (Asymmetric SupCon), a task-specific pre-training objective motivated by the heterogeneity of negative clinical outcomes. The objective clusters patients sharing a target positive outcome without explicitly attracting negative trajectories toward one another. We pre-train temporal Transformer encoders on longitudinal records from 3.98 million patients in the Taiwanese National Health Insurance Research Database (NHIRD) and transfer them to two U.S. EHR datasets, MIMIC-IV and EHRSHOT. A hybrid semantic mapping pipeline combining direct mappings with embedding-based retrieval enables transfer across heterogeneous clinical vocabularies. On MIMIC-IV, NHIRD pre-training consistently improves over random initialization while substantially narrowing the performance gap to task-specific in-domain pre-training. On EHRSHOT, the transferred models show particularly strong few-shot performance for incident disease prediction. A controlled objective ablation under a matched pre-training scale shows that Asymmetric SupCon achieves higher mean AUPRC than direct supervised BCE transfer on all four evaluated tasks and Standard SupCon on three of four, with a 0.003 AUPRC deficit on readmission. These results support asymmetric contrastive pre-training as an effective approach for task-specific cross-national EHR representation transfer. Code is available at https://github.com/qingYzhang/Asymmetric_SupCon.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 4 Oct 2026.

Builds on

19 of 30 references.

References · 19

  1. 2020Supervised Contrastive Learningcited by 2,829
  2. 2017Billion-scale similarity search with GPUscited by 2,497
  3. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  4. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
  5. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 372
  6. 2018Scalable and accurate deep learning for electronic health recordscited by 280
  7. 2019BEHRT: Transformer for Electronic Health Recordscited by 263
  8. 2021Co2L: Contrastive Continual Learningcited by 244
  9. 2020Self-Alignment Pretraining for Biomedical Entity Representationscited by 237
  10. 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 105
  11. 2020Language Models Are An Effective Patient Representation Learning Technique For Electronic Health Record Datacited by 87
  12. 2023MOTOR: A Time-To-Event Foundation Model For Structured Medical Recordscited by 78
7 more
  1. 2021CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction taskscited by 76
  2. 2020CODER: Knowledge infused cross-lingual medical term embedding for term normalizationcited by 55
  3. 2022GenHPF: General Healthcare Predictive Framework with Multi-task Multi-source Learningcited by 36
  4. 2023A Multi-Center Study on the Adaptability of a Shared Foundation Model for Electronic Health Recordscited by 31
  5. 2024Linq-Embed-Mistral Technical Reportcited by 20
  6. 2021SCEHR: Supervised Contrastive Learning for Clinical Risk Prediction using Electronic Health Recordscited by 10
  7. 2025MedRep: Medical Concept Representation for General Electronic Health Record Foundation Modelscited by 4

Built on by

Not cited yet.