MedGate-Fusion: Integrating First-Encounter Semantic Narratives and Physiological Biomarkers for Prospective Stroke Risk Stratification
Not on the map. Why?
Abstract (arXiv)
Prospective stroke risk stratification in primary care is challenging because early risk signals are distributed across routine biomarkers and unstructured clinical narratives. We propose MedGate-Fusion, a multi-modal gated architecture that integrates transformer-based embeddings of first-encounter narratives with ten routinely recorded risk markers. We used electronic medical record data from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN). Starting from 808,921 encounter-level observations, we constructed a first-encounter cohort and retained 102,736 unique patient records with non-empty narratives and sufficient data to evaluate a five-year stroke outcome. To reduce explicit target leakage from diagnostic mentions in notes, we applied dictionary-based redaction of stroke-related terms prior to semantic encoding.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 43 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
17 of 43 references.
References · 17
- 2017Attention Is All You Needcited by 60,361
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2019Publicly Available Clinical BERT Embeddingscited by 1,002
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
- 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 373
- 2018Scalable and accurate deep learning for electronic health recordscited by 280
- 2019BEHRT: Transformer for Electronic Health Recordscited by 263
- 2022GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Recordscited by 238
- 2024FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusioncited by 68
- 2021Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health recordscited by 54
5 more
- 2022A Multimodal Transformer: Fusing Clinical Notes with Structured EHR Data for Interpretable In-Hospital Mortality Predictioncited by 48
- 2019Natural Language Processing of Clinical Notes on Chronic Diseases: Systematic Reviewcited by 36
- 2023Transformers in Healthcare: A Surveycited by 17
- 2023On Leakage in Machine Learning Pipelinescited by 7
- 2025MoE-Health: A Mixture of Experts Framework for Robust Multimodal Healthcare Predictioncited by 7
Built on by
Not cited yet.