A Lightweight Approach to Detection of AI-Generated Texts Using Stylometric Features
Not on the map. Why?
Abstract (arXiv)
A growing number of AI-generated texts raise serious concerns. Most existing approaches to AI-generated text detection rely on fine-tuning large transformer models or building ensembles, which are computationally expensive and often provide limited generalization across domains. Existing lightweight alternatives achieved significantly lower accuracy on large datasets. We introduce NEULIF, a lightweight approach that achieves best performance in the lightweight detector class, that does not require extensive computational power and provides high detection accuracy. In our approach, a text is first decomposed into stylometric and readability features which are then used for classification by a compact Convolutional Neural Network (CNN) or Random Forest (RF). Evaluated and tested on the Kaggle AI vs. Human corpus, our models achieve 97% accuracy (~ 0.95 F1) for CNN and 95% accuracy (~ 0.94 F1) for the Random Forest, demonstrating high precision and recall, with ROC-AUC scores of 99.5% and 95%, respectively. The CNN (~ 25 MB) and Random Forest (~ 10.6 MB) models are orders of magnitude smaller than transformer-based ensembles and can be run efficiently on standard CPU devices, without sacrificing accuracy. This study also highlights the potential of such models for broader applications across languages, domains, and streaming contexts, showing that simplicity, when guided by structural insights, can rival complexity in AI-generated content detection.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 21 of its 33 references that are in the map. First posted on arXiv 22 Nov 2025.
Builds on
21 of 33 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
- 2015A Critical Review of Recurrent Neural Networks for Sequence Learningcited by 223
- 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directionscited by 101
- 2023Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Surveycited by 92
- 2024DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive Learningcited by 52
9 more
- 2023Overview of AuTexTification at IberLEF 2023: Detection and Attribution of Machine-Generated Text in Multiple Domainscited by 31
- 2023Towards a Robust Detection of Language Model Generated Text: Is ChatGPT that Easy to Detect?cited by 23
- 2024Robust AI-Generated Text Detection by Restricted Embeddingscited by 18
- 2024StyloAI: Distinguishing AI-Generated Content with Stylometric Analysiscited by 17
- 2023Distinguishing ChatGPT(-3.5, -4)-generated and human-written papers through Japanese stylometric analysiscited by 16
- 2023TextDescriptives: A Python package for calculating a large variety of metrics from textcited by 13
- 2024Deciphering Textual Authenticity: A Generalized Strategy through the Lens of Large Language Semantics for Detecting Human vs. Machine-Generated Textcited by 5
- 2025AI-generated Text Detection: A Multifaceted Approach to Binary and Multiclass Classificationcited by 3
- 2024Sentiment analysis and random forest to classify LLM versus human source applied to Scientific Textscited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Saying More Than They Know: A Framework for Quantifying Epistemic-Rhetorical Miscalibration in Large Language Modelscited by 0
- 2026How Human-Like Are Large Language Models? A Register-Aware Linguistic Evaluation Frameworkcited by 0
- 2026Relational Over-Regularization: Graph-Based AI-Generated Text Detection via Sentence Transition Deviationcited by 0
- 2026AuthBench: A Large-Scale Multilingual Benchmark for Authorship Representation across Genres and Lengthscited by 0
- 2026AuthBench: A Large-Scale Multilingual Benchmark for Authorship Representation across Genres and Lengths6 Sep 2026
- 2026Relational Over-Regularization: Graph-Based AI-Generated Text Detection via Sentence Transition Deviation27 Aug 2026
- 2026How Human-Like Are Large Language Models? A Register-Aware Linguistic Evaluation Framework22 May 2026
- 2026Saying More Than They Know: A Framework for Quantifying Epistemic-Rhetorical Miscalibration in Large Language Models27 Mar 2026