CODER: Knowledge infused cross-lingual medical term embedding for term normalization
Not on the map. Why?
Abstract (arXiv)
This paper proposes CODER: contrastive learning on knowledge graphs for cross-lingual medical term representation. CODER is designed for medical term normalization by providing close vector representations for different terms that represent the same or similar medical concepts with cross-lingual support. We train CODER via contrastive learning on a medical knowledge graph (KG) named the Unified Medical Language System, where similarities are calculated utilizing both terms and relation triplets from KG. Training with relations injects medical knowledge into embeddings and aims to provide potentially better machine learning features. We evaluate CODER in zero-shot term normalization, semantic similarity, and relation classification benchmarks, which show that CODERoutperforms various state-of-the-art biomedical word embedding, concept embeddings, and contextual embeddings. Our codes and models are available at https://github.com/GanjinZero/CODER.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 10; 2023: 11; 2024: 5; 2025: 13; 2026: 5.
53 papers.
Sort:
By area:
- 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 162
- 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
- 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
- 2022BioBART: Pretraining and Evaluation of A Biomedical Generative Language Modelcited by 83
- 2022Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Codingcited by 52
- 2021Biomedical Question Answering: A Survey of Approaches and Challengescited by 46
- 2021Improving Biomedical Pretrained Language Models with Knowledgecited by 36
- 2022Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuningcited by 34
- 2021AMMU : A Survey of Transformer-based Biomedical Pretrained Language Modelscited by 32
- 2021Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Modelscited by 21
- 2021Multi-source Learning via Completion of Block-wise Overlapping Noisy Matricescited by 10
38 more
- 2022BIOS: An Algorithmically Generated Biomedical Knowledge Graphcited by 9
- 2022Generalizing over Long Tail Concepts for Medical Term Normalizationcited by 8
- 2022An Accurate Unsupervised Method for Joint Entity Alignment and Dangling Entity Detectioncited by 7
- 2021A Hybrid Approach to Measure Semantic Relatedness in Biomedical Conceptscited by 5
- 2021Coreference Resolution for the Biomedical Domain: A Surveycited by 5
- 2022Automatic Biomedical Term Clustering by Learning Fine-grained Term Representationscited by 5
- 2023CoRTEx: Contrastive Learning for Representing Terms via Explanations with Applications on Constructing Biomedical Knowledge Graphscited by 5
- 2025Representation learning to advance multi-institutional studies with electronic health record data from US and Francecited by 5
- 2022Review of Natural Language Processing in Pharmacologycited by 3
- 2023xMEN: A Modular Toolkit for Cross-Lingual Medical Entity Normalizationcited by 3
- 2024Disease Entity Recognition and Normalization is Improved with Large Language Model Derived Synthetic Normalized Mentionscited by 3
- 2025CliniQ: A Multi-faceted Benchmark for Electronic Health Record Retrieval with Semantic Match Assessmentcited by 3
- 2022Semi-constraint Optimal Transport for Entity Alignment with Dangling Casescited by 2
- 2023Exploring Partial Knowledge Base Inference in Biomedical Entity Linkingcited by 2
- 2023Boosting Adverse Drug Event Normalization on Social Media: General-Purpose Model Initialization and Biomedical Semantic Text Similarity Benefit Zero-Shot Linking in Informal Contextscited by 2
- 2025Automated SNOMED CT Concept Annotation in Clinical Text Using Bi-GRU Neural Networkscited by 2
- 2025DermINO: Hybrid Pretraining for a Versatile Dermatology Foundation Modelcited by 2
- 2025BALI: Enhancing Biomedical Language Representations through Knowledge Graph and Language Model Alignmentcited by 2
- 2023Impact of translation on biomedical information extraction from real-life clinical notescited by 1
- 2023UMLS-KGI-BERT: Data-Centric Knowledge Integration in Transformers for Biomedical Entity Recognitioncited by 1
- 2024Assessing biomedical knowledge robustness in large language models by query-efficient sampling attackscited by 1
- 2025RuCCoD: Towards Automated ICD Coding in Russiancited by 1
- 2025Semi-supervised Clustering Through Representation Learning of Large-scale EHR Datacited by 1
- 2025A Weakly Supervised Transformer for Rare Disease Diagnosis and Subphenotyping from EHRs with Pulmonary Case Studiescited by 1
- 2025KEEP: Integrating Medical Ontologies with Clinical Data for Robust Code Embeddingscited by 1
- 2026SynCABEL: Synthetic Contextualized Augmentation for Biomedical Entity Linkingcited by 1
- 2022Combining Contrastive Learning and Knowledge Graph Embeddings to develop medical word embeddings for the Italian languagecited by 0
- 2023Detecting Idiomatic Multiword Expressions in Clinical Terminology using Definition-Based Representation Learningcited by 0
- 2023LATTE: Label-efficient Incident Phenotyping from Longitudinal Electronic Health Recordscited by 0
- 2023Hierarchical Pretraining for Biomedical Term Embeddingscited by 0
- 2023Solving the Right Problem is Key for Translational NLP: A Case Study in UMLS Vocabulary Insertioncited by 0
- 2024Towards Knowledge-Infused Automated Disease Diagnosis Assistantcited by 0
- 2024Unified Representation of Genomic and Biomedical Concepts through Multi-Task, Multi-Source Contrastive Learningcited by 0
- 2025Scaling Electronic Health Record Foundation Models for Population Health Managementcited by 0
- 2025DR.EHR: Dense Retrieval for Electronic Health Record with Knowledge Injection and Synthetic Datacited by 0
- 2025Automated Hierarchical Graph Construction for Multi-source Electronic Health Recordscited by 0
- 2025A Common Pipeline for Harmonizing Electronic Health Record Data for Translational Researchcited by 0
- 2026LongBEL: Long-Context and Document-Consistent Biomedical Entity Linkingcited by 0
50 most cited of 53 All 53 (JSON)
- 2026OntoBook: Ontology-Grounded Synthetic Textbooks for Medical Encoder Pretraining21 Jul 2026
- 2026MMed-Bench-IR: A Heterogeneous Benchmark for Multilingual Medical Information Retrieval23 Jun 2026
- 2026LongBEL: Long-Context and Document-Consistent Biomedical Entity Linking13 May 2026
- 2026BioELX: Context-Aware Cross-lingual Biomedical Entity Linking without Task-Specific Supervision9 Apr 2026
- 2026SynCABEL: Synthetic Contextualized Augmentation for Biomedical Entity Linking27 Jan 2026
- 2025KEEP: Integrating Medical Ontologies with Clinical Data for Robust Code Embeddings6 Oct 2025
- 2025A Common Pipeline for Harmonizing Electronic Health Record Data for Translational Research10 Sep 2025
- 2025BALI: Enhancing Biomedical Language Representations through Knowledge Graph and Language Model Alignment9 Sep 2025
- 2025Automated Hierarchical Graph Construction for Multi-source Electronic Health Records8 Sep 2025
- 2025DermINO: Hybrid Pretraining for a Versatile Dermatology Foundation Model17 Aug 2025
- 2025Automated SNOMED CT Concept Annotation in Clinical Text Using Bi-GRU Neural Networks4 Aug 2025
- 2025DR.EHR: Dense Retrieval for Electronic Health Record with Knowledge Injection and Synthetic Data24 Jul 2025
38 more
- 2025A Weakly Supervised Transformer for Rare Disease Diagnosis and Subphenotyping from EHRs with Pulmonary Case Studies1 Jul 2025
- 2025Scaling Electronic Health Record Foundation Models for Population Health Management30 May 2025
- 2025Semi-supervised Clustering Through Representation Learning of Large-scale EHR Data27 May 2025
- 2025RuCCoD: Towards Automated ICD Coding in Russian28 Feb 2025
- 2025Representation learning to advance multi-institutional studies with electronic health record data from US and France12 Feb 2025
- 2025CliniQ: A Multi-faceted Benchmark for Electronic Health Record Retrieval with Semantic Match Assessment10 Feb 2025
- 2024Unified Representation of Genomic and Biomedical Concepts through Multi-Task, Multi-Source Contrastive Learning14 Oct 2024
- 2024Disease Entity Recognition and Normalization is Improved with Large Language Model Derived Synthetic Normalized Mentions10 Oct 2024
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery16 Jun 2024
- 2024Towards Knowledge-Infused Automated Disease Diagnosis Assistant18 May 2024
- 2024Assessing biomedical knowledge robustness in large language models by query-efficient sampling attacks16 Feb 2024
- 2023CoRTEx: Contrastive Learning for Representing Terms via Explanations with Applications on Constructing Biomedical Knowledge Graphs13 Dec 2023
- 2023Solving the Right Problem is Key for Translational NLP: A Case Study in UMLS Vocabulary Insertion25 Nov 2023
- 2023xMEN: A Modular Toolkit for Cross-Lingual Medical Entity Normalization17 Oct 2023
- 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics9 Oct 2023
- 2023Boosting Adverse Drug Event Normalization on Social Media: General-Purpose Model Initialization and Biomedical Semantic Text Similarity Benefit Zero-Shot Linking in Informal Contexts31 Jul 2023
- 2023UMLS-KGI-BERT: Data-Centric Knowledge Integration in Transformers for Biomedical Entity Recognition20 Jul 2023
- 2023Hierarchical Pretraining for Biomedical Term Embeddings1 Jul 2023
- 2023Impact of translation on biomedical information extraction from real-life clinical notes3 Jun 2023
- 2023LATTE: Label-efficient Incident Phenotyping from Longitudinal Electronic Health Records19 May 2023
- 2023Detecting Idiomatic Multiword Expressions in Clinical Terminology using Definition-Based Representation Learning11 May 2023
- 2023Exploring Partial Knowledge Base Inference in Biomedical Entity Linking18 Mar 2023
- 2022Combining Contrastive Learning and Knowledge Graph Embeddings to develop medical word embeddings for the Italian language9 Nov 2022
- 2022Generalizing over Long Tail Concepts for Medical Term Normalization21 Oct 2022
- 2022Review of Natural Language Processing in Pharmacology22 Aug 2022
- 2022Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning11 Apr 2022
- 2022BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model8 Apr 2022
- 2022Automatic Biomedical Term Clustering by Learning Fine-grained Term Representations1 Apr 2022
- 2022BIOS: An Algorithmically Generated Biomedical Knowledge Graph18 Mar 2022
- 2022Semi-constraint Optimal Transport for Entity Alignment with Dangling Cases11 Mar 2022
- 2022An Accurate Unsupervised Method for Joint Entity Alignment and Dangling Entity Detection10 Mar 2022
- 2022Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding3 Mar 2022
- 2021Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models15 Oct 2021
- 2021Pre-trained Language Models in Biomedical Domain: A Systematic Survey11 Oct 2021
- 2021Coreference Resolution for the Biomedical Domain: A Survey25 Sep 2021
- 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing12 Aug 2021
- 2021Multi-source Learning via Completion of Block-wise Overlapping Noisy Matrices21 May 2021
- 2021Improving Biomedical Pretrained Language Models with Knowledge21 Apr 2021
50 newest of 53 All 53 (JSON)
- 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 162
- 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
- 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
- 2022BioBART: Pretraining and Evaluation of A Biomedical Generative Language Modelcited by 83
- 2022Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Codingcited by 52
- 2021Biomedical Question Answering: A Survey of Approaches and Challengescited by 46
- 2021Improving Biomedical Pretrained Language Models with Knowledgecited by 36
- 2022Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuningcited by 34
- 2021AMMU : A Survey of Transformer-based Biomedical Pretrained Language Modelscited by 32
- 2021Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Modelscited by 21
- 2021Multi-source Learning via Completion of Block-wise Overlapping Noisy Matricescited by 10
12 most cited of 52 All 52 (JSON)
- 2026OntoBook: Ontology-Grounded Synthetic Textbooks for Medical Encoder Pretraining21 Jul 2026
- 2026LongBEL: Long-Context and Document-Consistent Biomedical Entity Linking13 May 2026
- 2026BioELX: Context-Aware Cross-lingual Biomedical Entity Linking without Task-Specific Supervision9 Apr 2026
- 2026SynCABEL: Synthetic Contextualized Augmentation for Biomedical Entity Linking27 Jan 2026
- 2025KEEP: Integrating Medical Ontologies with Clinical Data for Robust Code Embeddings6 Oct 2025
- 2025A Common Pipeline for Harmonizing Electronic Health Record Data for Translational Research10 Sep 2025
- 2025BALI: Enhancing Biomedical Language Representations through Knowledge Graph and Language Model Alignment9 Sep 2025
- 2025Automated Hierarchical Graph Construction for Multi-source Electronic Health Records8 Sep 2025
- 2025DermINO: Hybrid Pretraining for a Versatile Dermatology Foundation Model17 Aug 2025
- 2025Automated SNOMED CT Concept Annotation in Clinical Text Using Bi-GRU Neural Networks4 Aug 2025
- 2025DR.EHR: Dense Retrieval for Electronic Health Record with Knowledge Injection and Synthetic Data24 Jul 2025
- 2025A Weakly Supervised Transformer for Rare Disease Diagnosis and Subphenotyping from EHRs with Pulmonary Case Studies1 Jul 2025
12 newest of 52 All 52 (JSON)