mlsanityData to 7 Oct 2026

Contrastive Representation Learning Helps Cross-institutional Knowledge Transfer: A Study in Pediatric Ventilation Management

arXiv 2501.13587 ↗First posted 23 Jan 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Clinical machine learning deployment across institutions faces significant challenges when patient populations and clinical practices differ substantially. We present a systematic framework for cross-institutional knowledge transfer in clinical time series, demonstrated through pediatric ventilation management between a general pediatric intensive care unit (PICU) and a cardiac-focused unit. Using contrastive predictive coding (CPC) for representation learning, we investigate how different data regimes and fine-tuning strategies affect knowledge transfer across institutional boundaries. Our results show that while direct model transfer performs poorly, CPC with appropriate fine-tuning enables effective knowledge sharing between institutions, with benefits particularly evident in limited data scenarios. Analysis of transfer patterns reveals an important asymmetry: temporal progression patterns transfer more readily than point-of-care decisions, suggesting practical pathways for cross-institutional deployment. Through a systematic evaluation of fine-tuning approaches and transfer patterns, our work provides insights for developing more generalizable clinical decision support systems while enabling smaller specialized units to leverage knowledge from larger centers.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 20 references that are in the map. First posted on arXiv 23 Jan 2025.

Builds on

11 of 20 references.

References · 11

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  4. 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
  5. 2023Towards Generalist Biomedical AIcited by 286
  6. 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
  7. 2019MIMIC-Extract: A Data Extraction, Preprocessing, and Representation Pipeline for MIMIC-IIIcited by 121
  8. 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 101
  9. 2023Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospectscited by 97
  10. 2024Causal Contrastive Learning for Counterfactual Regression Over Timecited by 7
  11. 2022SOM-CPC: Unsupervised Contrastive Learning with Self-Organizing Maps for Structured Representations of High-Rate Time Seriescited by 4

Built on by

Not cited yet.