mlsanityData to 7 Oct 2026

BERT-based Acronym Disambiguation with Multiple Training Strategies

arXiv 2103.00488 ↗First posted 25 Feb 2021cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Acronym disambiguation (AD) task aims to find the correct expansions of an ambiguous ancronym in a given sentence. Although it is convenient to use acronyms, sometimes they could be difficult to understand. Identifying the appropriate expansions of an acronym is a practical task in natural language processing. Since few works have been done for AD in scientific field, we propose a binary classification model incorporating BERT and several training strategies including dynamic negative sample selection, task adaptive pretraining, adversarial training and pseudo labeling in this paper. Experiments on SciAD show the effectiveness of our proposed model and our score ranks 1st in SDU@AAAI-21 shared task 2: Acronym Disambiguation.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 13 of its 30 references that are in the map. First posted on arXiv 25 Feb 2021.

Builds on

13 of 30 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  4. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  5. 2018Deep contextualized word representationscited by 2,285
  6. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  7. 2019Label Propagation for Deep Semi-supervised Learningcited by 287
  8. 2016Adversarial Training Methods for Semi-Supervised Text Classificationcited by 280
  9. 2017Data Noising as Smoothing in Neural Network Language Modelscited by 78
  10. 2020Moving Down the Long Tail of Word Sense Disambiguation with Gloss-Informed Biencoderscited by 61
  11. 2020What Does This Acronym Mean? Introducing a New Dataset for Acronym Identification and Disambiguationcited by 26
  12. 2019Deep Contextualized Biomedical Abbreviation Expansioncited by 14
1 more
  1. 2020Acronym Identification and Disambiguation Shared Tasks for Scientific Document Understandingcited by 12

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 3; 2023: 1; 2024: 1; 2025: 1.

8 papers.

  1. 2022LingYi: Medical Conversational Question Answering System based on Multi-modal Knowledge Graphscited by 15
  2. 2023GLADIS: A General and Large Acronym Disambiguation Benchmarkcited by 5
  3. 2021SimCLAD: A Simple Framework for Contrastive Learning of Acronym Disambiguationcited by 3
  4. 2021ADBCMM : Acronym Disambiguation by Building Counterfactuals and Multilingual Mixingcited by 2
  5. 2022Detecting Generated Scientific Papers using an Ensemble of Transformer Modelscited by 1
  6. 2022ABB-BERT: A BERT model for disambiguating abbreviations and contractionscited by 0
  7. 2024Automated Extraction of Acronym-Expansion Pairs from Scientific Paperscited by 0
  8. 2025DACE For Railway Acronym Disambiguationcited by 0