# Semantic Sensitive TF-IDF to Determine Word Relevance in Documents

arXiv: https://arxiv.org/abs/2001.09896 · HTML: https://mlsanity.com/paper/2001.09896/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 6 Jan 2020.

## Built on by (most cited first, 13 of 13)

- [DBAIOps: A Reasoning LLM-Enhanced Database Operation and Maintenance System using Knowledge Graphs](https://mlsanity.com/paper/2508.01136/) (2025)
- [Generative User-Experience Research for Developing Domain-specific Natural Language Processing Applications](https://mlsanity.com/paper/2306.16143/) (2023)
- [Comparative Study of Domain Driven Terms Extraction Using Large Language Models](https://mlsanity.com/paper/2404.02330/) (2024)
- [An Analysis of COVID-19 Knowledge Graph Construction and Applications](https://mlsanity.com/paper/2110.04932/) (2021)
- [Farmer-Bot: An Interactive Bot for Farmers](https://mlsanity.com/paper/2204.07032/) (2022)
- [Leveraging Translation For Optimal Recall: Tailoring LLM Personalization With User Profiles](https://mlsanity.com/paper/2402.13500/) (2024)
- [Insights Into the Nutritional Prevention of Macular Degeneration based on a Comparative Topic Modeling Approach](https://mlsanity.com/paper/2309.00312/) (2023)
- [Enhancing Readmission Prediction with Deep Learning: Extracting Biomedical Concepts from Clinical Texts](https://mlsanity.com/paper/2403.09722/) (2024)
- [TPLogAD: Unsupervised Log Anomaly Detection Based on Event Templates and Key Parameters](https://mlsanity.com/paper/2411.15250/) (2024)
- [Automatic essay scoring: leveraging Jaccard coefficient and Cosine similaritywith n-gram variation in vector space model approach](https://mlsanity.com/paper/2510.15311/) (2025)
- [Multilingual Lexical Feature Analysis of Spoken Language for Predicting Major Depression Symptom Severity](https://mlsanity.com/paper/2511.07011/) (2025)
- [Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward](https://mlsanity.com/paper/2601.13122/) (2026)
- [MAP4CS: A Multi-dimensional Data Pruning Framework for Efficient Code Retriever Fine-tuning](https://mlsanity.com/paper/2610.11727/) (2026)

## Abstract (arXiv)

Keyword extraction has received an increasing attention as an important research topic which can lead to have advancements in diverse applications such as document context categorization, text indexing and document classification. In this paper we propose STF-IDF, a novel semantic method based on TF-IDF, for scoring word importance of informal documents in a corpus. A set of nearly four million documents from health-care social media was collected and was trained in order to draw semantic model and to find the word embeddings. Then, the features of semantic space were utilized to rearrange the original TF-IDF scores through an iterative solution so as to improve the moderate performance of this algorithm on informal texts. After testing the proposed method with 200 randomly chosen documents, our method managed to decrease the TF-IDF mean error rate by a factor of 50% and reaching the mean error of 13.7%, as opposed to 27.2% of the original TF-IDF.