mlsanityData to 7 Oct 2026

GraphPrompt: Graph-Based Prompt Templates for Biomedical Synonym Prediction

arXiv 2112.03002 ↗First posted 13 Nov 2021cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

In the expansion of biomedical dataset, the same category may be labeled with different terms, thus being tedious and onerous to curate these terms. Therefore, automatically mapping synonymous terms onto the ontologies is desirable, which we name as biomedical synonym prediction task. Unlike biomedical concept normalization (BCN), no clues from context can be used to enhance synonym prediction, making it essential to extract graph features from ontology. We introduce an expert-curated dataset OBO-syn encompassing 70 different types of concepts and 2 million curated concept-term pairs for evaluating synonym prediction methods. We find BCN methods perform weakly on this task for not making full use of graph information. Therefore, we propose GraphPrompt, a prompt-based learning approach that creates prompt templates according to the graphs. GraphPrompt obtained 37.2% and 28.5% improvement on zero-shot and few-shot settings respectively, indicating the effectiveness of these graph-based prompt templates. We envision that our method GraphPrompt and OBO-syn dataset can be broadly applied to graph-based NLP tasks, and serve as the basis for analyzing diverse and accumulating biomedical data. All the data and codes are avalible at: https://github.com/HanwenXuTHU/GraphPrompt

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 49 references that are in the map. First posted on arXiv 13 Nov 2021.

Builds on

23 of 49 references.

References · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  6. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  7. 2019Language Models as Knowledge Bases?cited by 1,922
  8. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  9. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
  10. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  11. 2019How Can We Know What Language Models Know?cited by 953
  12. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
11 more
  1. 2015LINE: Large-scale Information Network Embeddingcited by 582
  2. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
  3. 2019Revisiting Graph Neural Networks: All We Have is Low-Pass Filterscited by 260
  4. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  5. 2019Commonsense Knowledge Mining from Pretrained Modelscited by 189
  6. 2020Biomedical Entity Representations with Synonym Marginalizationcited by 59
  7. 2019BERT-based Ranking for Biomedical Entity Normalizationcited by 29
  8. 2021Enhancing Scientific Papers Summarization with Citation Graphcited by 14
  9. 2020Medical Entity Linking using Triplet Networkcited by 10
  10. 2020Disease Normalization with Graph Embeddingscited by 4
  11. 2019Embedding Biomedical Ontologies by Jointly Encoding Network Structure and Textual Node Descriptorscited by 2

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1.

2 papers.