PSG: Prompt-based Sequence Generation for Acronym Extraction
Not on the map. Why?
Abstract (arXiv)
Acronym extraction aims to find acronyms (i.e., short-forms) and their meanings (i.e., long-forms) from the documents, which is important for scientific document understanding (SDU@AAAI-22) tasks. Previous works are devoted to modeling this task as a paragraph-level sequence labeling problem. However, it lacks the effective use of the external knowledge, especially when the datasets are in a low-resource setting. Recently, the prompt-based method with the vast pre-trained language model can significantly enhance the performance of the low-resourced downstream tasks. In this paper, we propose a Prompt-based Sequence Generation (PSG) method for the acronym extraction task. Specifically, we design a template for prompting the extracted acronym texts with auto-regression. A position extraction algorithm is designed for extracting the position of the generated answers. The results on the acronym extraction of Vietnamese and Persian in a low-resource setting show that the proposed method outperforms all other competitive state-of-the-art (SOTA) methods.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 29 Nov 2021.
Builds on
14 of 22 references.
References · 14
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2019How Language-Neutral is Multilingual BERT?cited by 51
- 2020A Survey of Deep Learning Techniques for Neural Machine Translationcited by 50
- 2021More but Correct: Generating Diversified and Entity-revised Medical Responsecited by 31
- 2017Empower Sequence Labeling with Task-Aware Neural Language Modelcited by 28
- 2020What Does This Acronym Mean? Introducing a New Dataset for Acronym Identification and Disambiguationcited by 26
- 2021Exploring Prompt-based Few-shot Learning for Grounded Dialog Generationcited by 20
2 more
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.