Semantic Analysis of SNOMED CT Concept Co-occurrences in Clinical Documentation using MIMIC-IV
Not on the map. Why?
Abstract (arXiv)
Clinical notes contain rich clinical narratives but their unstructured format poses challenges for large-scale analysis. Standardized terminologies such as SNOMED CT improve interoperability, yet understanding how concepts relate through co-occurrence and semantic similarity remains underexplored. In this study, we leverage the MIMIC-IV database to investigate the relationship between SNOMED CT concept co-occurrence patterns and embedding-based semantic similarity. Using Normalized Pointwise Mutual Information (NPMI) and pretrained embeddings (e.g., ClinicalBERT, BioBERT), we examine whether frequently co-occurring concepts are also semantically close, whether embeddings can suggest missing concepts, and how these relationships evolve temporally and across specialties. Our analyses reveal that while co-occurrence and semantic similarity are weakly correlated, embeddings capture clinically meaningful associations not always reflected in documentation frequency. Embedding-based suggestions frequently matched concepts later documented, supporting their utility for augmenting clinical annotations. Clustering of concept embeddings yielded coherent clinical themes (symptoms, labs, diagnoses, cardiovascular conditions) that map to patient phenotypes and care patterns. Finally, co-occurrence patterns linked to outcomes such as mortality and readmission demonstrate the practical utility of this approach. Collectively, our findings highlight the complementary value of co-occurrence statistics and semantic embeddings in improving documentation completeness, uncovering latent clinical relationships, and informing decision support and phenotyping applications.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 9 of its 35 references that are in the map. First posted on arXiv 3 Sep 2025.
Builds on
9 of 35 references.
References · 9
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2019Publicly Available Clinical BERT Embeddingscited by 1,002
- 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
- 2017Multitask learning and benchmarking with clinical time series datacited by 290
- 2020Self-Alignment Pretraining for Biomedical Entity Representationscited by 237
- 2016GRAM: Graph-based Attention Model for Healthcare Representation Learningcited by 156
- 2020Multi-domain Clinical Natural Language Processing with MedCAT: the Medical Concept Annotation Toolkitcited by 66
- 2025Automated SNOMED CT Concept Annotation in Clinical Text Using Bi-GRU Neural Networkscited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.