# CODER: Knowledge infused cross-lingual medical term embedding for term normalization

arXiv: https://arxiv.org/abs/2011.02947 · HTML: https://mlsanity.com/paper/2011.02947/

## Key facts

- Cited by 55 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Nov 2020.

## Built on by (most cited first, 30 of 55)

- [A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics](https://mlsanity.com/paper/2310.05694/) (2023)
- [AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing](https://mlsanity.com/paper/2108.05542/) (2021)
- [A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery](https://mlsanity.com/paper/2406.10833/) (2024)
- [Pre-trained Language Models in Biomedical Domain: A Systematic Survey](https://mlsanity.com/paper/2110.05006/) (2021)
- [BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model](https://mlsanity.com/paper/2204.03905/) (2022)
- [Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding](https://mlsanity.com/paper/2203.01515/) (2022)
- [Biomedical Question Answering: A Survey of Approaches and Challenges](https://mlsanity.com/paper/2102.05281/) (2021)
- [Improving Biomedical Pretrained Language Models with Knowledge](https://mlsanity.com/paper/2104.10344/) (2021)
- [Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning](https://mlsanity.com/paper/2204.05164/) (2022)
- [AMMU : A Survey of Transformer-based Biomedical Pretrained Language Models](https://mlsanity.com/paper/2105.00827/) (2021)
- [Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models](https://mlsanity.com/paper/2110.08173/) (2021)
- [Multi-source Learning via Completion of Block-wise Overlapping Noisy Matrices](https://mlsanity.com/paper/2105.10360/) (2021)
- [BIOS: An Algorithmically Generated Biomedical Knowledge Graph](https://mlsanity.com/paper/2203.09975/) (2022)
- [Generalizing over Long Tail Concepts for Medical Term Normalization](https://mlsanity.com/paper/2210.11947/) (2022)
- [An Accurate Unsupervised Method for Joint Entity Alignment and Dangling Entity Detection](https://mlsanity.com/paper/2203.05147/) (2022)
- [A Hybrid Approach to Measure Semantic Relatedness in Biomedical Concepts](https://mlsanity.com/paper/2101.10196/) (2021)
- [Coreference Resolution for the Biomedical Domain: A Survey](https://mlsanity.com/paper/2109.12424/) (2021)
- [Automatic Biomedical Term Clustering by Learning Fine-grained Term Representations](https://mlsanity.com/paper/2204.00391/) (2022)
- [CoRTEx: Contrastive Learning for Representing Terms via Explanations with Applications on Constructing Biomedical Knowledge Graphs](https://mlsanity.com/paper/2312.08036/) (2023)
- [Representation learning to advance multi-institutional studies with electronic health record data from US and France](https://mlsanity.com/paper/2502.08547/) (2025)
- [Review of Natural Language Processing in Pharmacology](https://mlsanity.com/paper/2208.10228/) (2022)
- [xMEN: A Modular Toolkit for Cross-Lingual Medical Entity Normalization](https://mlsanity.com/paper/2310.11275/) (2023)
- [Disease Entity Recognition and Normalization is Improved with Large Language Model Derived Synthetic Normalized Mentions](https://mlsanity.com/paper/2410.07951/) (2024)
- [CliniQ: A Multi-faceted Benchmark for Electronic Health Record Retrieval with Semantic Match Assessment](https://mlsanity.com/paper/2502.06252/) (2025)
- [Semi-constraint Optimal Transport for Entity Alignment with Dangling Cases](https://mlsanity.com/paper/2203.05744/) (2022)
- [Exploring Partial Knowledge Base Inference in Biomedical Entity Linking](https://mlsanity.com/paper/2303.10330/) (2023)
- [Boosting Adverse Drug Event Normalization on Social Media: General-Purpose Model Initialization and Biomedical Semantic Text Similarity Benefit Zero-Shot Linking in Informal Contexts](https://mlsanity.com/paper/2308.00157/) (2023)
- [Automated SNOMED CT Concept Annotation in Clinical Text Using Bi-GRU Neural Networks](https://mlsanity.com/paper/2508.02556/) (2025)
- [DermINO: Hybrid Pretraining for a Versatile Dermatology Foundation Model](https://mlsanity.com/paper/2508.12190/) (2025)
- [BALI: Enhancing Biomedical Language Representations through Knowledge Graph and Language Model Alignment](https://mlsanity.com/paper/2509.07588/) (2025)

## Abstract (arXiv)

This paper proposes CODER: contrastive learning on knowledge graphs for cross-lingual medical term representation. CODER is designed for medical term normalization by providing close vector representations for different terms that represent the same or similar medical concepts with cross-lingual support. We train CODER via contrastive learning on a medical knowledge graph (KG) named the Unified Medical Language System, where similarities are calculated utilizing both terms and relation triplets from KG. Training with relations injects medical knowledge into embeddings and aims to provide potentially better machine learning features. We evaluate CODER in zero-shot term normalization, semantic similarity, and relation classification benchmarks, which show that CODERoutperforms various state-of-the-art biomedical word embedding, concept embeddings, and contextual embeddings. Our codes and models are available at https://github.com/GanjinZero/CODER.
