Exploring Motivations for Algorithm Mention in the Domain of Natural Language Processing: A Deep Learning Approach
Not on the map. Why?
Abstract (arXiv)
With the rise of data-intensive science, algorithms have become central to scientific research. In academic papers, algorithms are mentioned for different purposes, such as describing, using, comparing, or improving methods for specific research tasks. Identifying these purposes can reveal relationships among algorithms and help assess their roles and value. Taking natural language processing (NLP) as an example, this study proposes a sentence-level framework for identifying, analyzing, and tracing the evolution of motivations for mentioning algorithms. We first identify algorithm entities and algorithm-related sentences from full-text papers through manual annotation and machine learning. We then classify mention motivations using pretrained models and data augmentation, and analyze their distribution and temporal evolution. The results show that deep learning models trained with augmented data outperform traditional machine learning models in motivation classification. In NLP papers, more than half of algorithm-related sentences express direct use, whereas improvement is the least frequent motivation. The diversity of motivations has increased over time. For specific algorithm categories, grammar-based algorithms are more often mentioned for description, while machine learning algorithms are more often mentioned for use. Over time, use motivations have gradually replaced description motivations across different algorithms, and the number of motivation types associated with individual algorithms has declined significantly. This study reveals how authors mention algorithm entities in academic writing and provides a basis for future research on algorithm relationship identification and algorithm impact evaluation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 54 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
11 of 54 references.
References · 11
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
- 2020Pre-trained Models for Natural Language Processing: A Surveycited by 505
- 2021A Survey of Data Augmentation Approaches for NLPcited by 409
- 2018Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relationscited by 201
- 2019Structural Scaffolds for Citation Intent Classification in Scientific Publicationscited by 130
- 2020Using the Full-text Content of Academic Articles to Identify and Evaluate Algorithm Entities in the Domain of Natural Language Processingcited by 6
- 2018Neural Multi-Task Learning for Citation Function and Provenancecited by 5
Built on by
Not cited yet.