# Stopwords in Technical Language Processing

arXiv: https://arxiv.org/abs/2006.02633 · HTML: https://mlsanity.com/paper/2006.02633/

## Key facts

- Cited by 29 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Jun 2020.

## Built on by (most cited first, 29 of 29)

- [Discrete Prompt Compression with Reinforcement Learning](https://mlsanity.com/paper/2308.08758/) (2023)
- [Semantic and sentiment analysis of selected Bhagavad Gita translations using BERT-based language framework](https://mlsanity.com/paper/2201.03115/) (2022)
- [Negation, Coordination, and Quantifiers in Contextualized Language Models](https://mlsanity.com/paper/2209.07836/) (2022)
- [Opportunities for Large Language Models and Discourse in Engineering Design](https://mlsanity.com/paper/2306.09169/) (2023)
- [The African Stopwords project: curating stopwords for African languages](https://mlsanity.com/paper/2304.12155/) (2023)
- [Detection of fake news on CoViD-19 on Web Search Engines](https://mlsanity.com/paper/2103.11804/) (2021)
- [Effects of Parametric and Non-Parametric Methods on High Dimensional Sparse Matrix Representations](https://mlsanity.com/paper/2202.02894/) (2022)
- [Identifying and Analyzing Performance-Critical Tokens in Large Language Models](https://mlsanity.com/paper/2401.11323/) (2024)
- [Helping Large Language Models Protect Themselves: An Enhanced Filtering and Summarization System](https://mlsanity.com/paper/2505.01315/) (2025)
- [ConceptGuard: Neuro-Symbolic Safety Guardrails via Sparse Interpretable Jailbreak Concepts](https://mlsanity.com/paper/2508.16325/) (2025)
- [Res-CNN-BiLSTM Network for overcoming Mental Health Disturbances caused due to Cyberbullying through Social Media](https://mlsanity.com/paper/2204.09738/) (2022)
- [Implementing Deep Learning-Based Approaches for Article Summarization in Indian Languages](https://mlsanity.com/paper/2212.05702/) (2022)
- [Text Categorization Can Enhance Domain-Agnostic Stopword Extraction](https://mlsanity.com/paper/2401.13398/) (2024)
- [Technical Language Processing for Telecommunications Specifications](https://mlsanity.com/paper/2406.02325/) (2024)
- [Enhancing Personalized Recipe Recommendation Through Multi-Class Classification](https://mlsanity.com/paper/2409.10267/) (2024)
- [Associative Knowledge Graphs for Efficient Sequence Storage and Retrieval](https://mlsanity.com/paper/2411.14480/) (2024)
- [Adapting A Vector-Symbolic Memory for Lisp ACT-R](https://mlsanity.com/paper/2508.15630/) (2025)
- [Investigating the Representation of Backchannels and Fillers in Fine-tuned Language Models](https://mlsanity.com/paper/2509.20237/) (2025)
- [Beyond Via: Analysis and Estimation of the Impact of Large Language Models in Academic Papers](https://mlsanity.com/paper/2603.25638/) (2026)
- [Technical Language Supervision for Intelligent Fault Diagnosis in Process Industry](https://mlsanity.com/paper/2112.07356/) (2021)
- [Social Media Personal Event Notifier Using NLP and Machine Learning](https://mlsanity.com/paper/2210.05001/) (2022)
- [Stop Words for Processing Software Engineering Documents: Do they Matter?](https://mlsanity.com/paper/2303.10439/) (2023)
- [Modeling offensive content detection for TikTok](https://mlsanity.com/paper/2408.16857/) (2024)
- [Nasdaq-100 Companies' Hiring Insights: A Topic-based Classification Approach to the Labor Market](https://mlsanity.com/paper/2409.00658/) (2024)
- [Outcome-Based Education: Evaluating Students' Perspectives Using Transformer](https://mlsanity.com/paper/2506.17223/) (2025)
- [A Linguistic Analysis of Spontaneous Thoughts: Investigating Experiences of D'ej`a Vu, Unexpected Thoughts, and Involuntary Autobiographical Memories](https://mlsanity.com/paper/2507.04439/) (2025)
- [Classification of Psychiatry Clinical Notes by Diagnosis: A Deep Learning and Machine Learning Approach](https://mlsanity.com/paper/2508.00695/) (2025)
- [Non-Zipfian Distribution of Stopwords or Function Words and Subset Selection Models](https://mlsanity.com/paper/2603.04691/) (2026)
- [RecallRisk-BERT: A Multi-Task Framework for Post-Report Medical Device Recall Triage](https://mlsanity.com/paper/2606.27174/) (2026)

## Abstract (arXiv)

There are increasingly applications of natural language processing techniques for information retrieval, indexing and topic modelling in the engineering contexts. A standard component of such tasks is the removal of stopwords, which are uninformative components of the data. While researchers use readily available stopword lists which are derived for general English language, the technical jargon of engineering fields contains their own highly frequent and uninformative words and there exists no standard stopword list for technical language processing applications. Here we address this gap by rigorously identifying generic, insignificant, uninformative stopwords in engineering texts beyond the stopwords in general texts, based on the synthesis of alternative data-driven approaches, and curating a stopword list ready for technical language processing applications.
