Adaptable and Reliable Text Classification using Large Language Models
Not on the map. Why?
Abstract (arXiv)
Text classification is fundamental in Natural Language Processing (NLP), and the advent of Large Language Models (LLMs) has revolutionized the field. This paper introduces an adaptable and reliable text classification paradigm, which leverages LLMs as the core component to address text classification tasks. Our system simplifies the traditional text classification workflows, reducing the need for extensive preprocessing and domain-specific expertise to deliver adaptable and reliable text classification results. We evaluated the performance of several LLMs, machine learning algorithms, and neural network-based architectures on four diverse datasets. Results demonstrate that certain LLMs surpass traditional methods in sentiment analysis, spam SMS detection, and multi-label classification. Furthermore, it is shown that the system's performance can be further enhanced through few-shot or fine-tuning strategies, making the fine-tuned model the top performer across all datasets. Source code and datasets are available in this GitHub repository: https://github.com/yeyimilk/llm-zero-shot-classifiers.
Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Builds on 17 of its 40 references that are in the map. First posted on arXiv 17 May 2024.
Builds on
17 of 40 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
- 2020Language Models are Few-Shot Learnerscited by 32,320
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,549
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,072
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,317
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,658
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,981
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,352
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,126
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 820
- 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
- 2020Deep Learning Based Text Classification: A Comprehensive Reviewcited by 141
5 more
- 2023Making LLMs Worth Every Penny: Resource-Limited Text Classification in Bankingcited by 37
- 2023Large Language Models Are Zero-Shot Text Classifierscited by 35
- 2023NBIAS: A Natural Language Processing Framework for Bias Identification in Textcited by 23
- 2023AutoCast++: Enhancing World Event Prediction with Zero-shot Ranking-based Context Retrievalcited by 18
- 2024DALLMi: Domain Adaption for LLM-based Multi-label Classifiercited by 7
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025Comparing energy consumption and accuracy in text classification inferencecited by 1
- 2025Multidimensional classification of posts for online course discussion forum curationcited by 0
- 2026A Multi-Dimensional Evaluation of Explainability in Media Bias Detectioncited by 0
- 2026Large Language Models for Automated Cross-Domain Machine Learning Task Type Identification: A Benchmark Dataset and Evaluationcited by 0
- 2026Large Language Models for Automated Cross-Domain Machine Learning Task Type Identification: A Benchmark Dataset and Evaluation28 Sep 2026
- 2026A Multi-Dimensional Evaluation of Explainability in Media Bias Detection22 Jul 2026
- 2025Comparing energy consumption and accuracy in text classification inference19 Aug 2025
- 2025Multidimensional classification of posts for online course discussion forum curation5 Aug 2025