mlsanityData to 7 Oct 2026

Pushing The Limit of LLM Capacity for Text Classification

arXiv 2402.07470 ↗First posted 12 Feb 2024cs.CLcited by 28

Not on the map. Why?

Abstract (arXiv)

The value of text classification's future research has encountered challenges and uncertainties, due to the extraordinary efficacy demonstrated by large language models (LLMs) across numerous downstream NLP tasks. In this era of open-ended language modeling, where task boundaries are gradually fading, an urgent question emerges: have we made significant advances in text classification under the full benefit of LLMs? To answer this question, we propose RGPT, an adaptive boosting framework tailored to produce a specialized text classification LLM by recurrently ensembling a pool of strong base learners. The base learners are constructed by adaptively adjusting the distribution of training samples and iteratively fine-tuning LLMs with them. Such base learners are then ensembled to be a specialized text classification LLM, by recurrently incorporating the historical predictions from the previous learners. Through a comprehensive empirical comparison, we show that RGPT significantly outperforms 8 SOTA PLMs and 7 SOTA LLMs on four benchmarks by 1.36% on average. Further evaluation experiments show a clear surpassing of RGPT over human classification.

Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 21 of its 53 references that are in the map. First posted on arXiv 12 Feb 2024.

Builds on

21 of 53 references.

References · 21

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  6. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  7. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  8. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  9. 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,038
  10. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  11. 2023BloombergGPT: A Large Language Model for Financecited by 923
  12. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
9 more
  1. 2018Graph Convolutional Networks for Text Classificationcited by 345
  2. 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 258
  3. 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
  4. 2016Recurrent Neural Network for Text Classification with Multi-Task Learningcited by 144
  5. 2023Text Classification via Large Language Modelscited by 104
  6. 2023HuatuoGPT-II, One-stage Training for Medical Adaption of LLMscited by 91
  7. 2021BertGCN: Transductive Text Classification by Combining GCN and BERTcited by 74
  8. 2015Explaining the Success of AdaBoost and Random Forests as Interpolating Classifierscited by 45
  9. 2022PromptBoosting: Black-Box Text Classification with Ten Forward Passescited by 36

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 11; 2025: 15; 2026: 2.

28 papers.

Sort:

By area:

  1. 2024A Survey on Large Language Models for Communication, Network, and Service Management: Application Insights, Challenges, and Future Directionscited by 25
  2. 2025TaxoAdapt: Aligning LLM-Based Multidimensional Taxonomy Construction to Evolving Research Corporacited by 23
  3. 2024SarcasmBench: Towards Evaluating Large Language Models on Sarcasm Understandingcited by 20
  4. 2025From Prompts to Power: Measuring the Energy Footprint of LLM Inferencecited by 12
  5. 2024RAMIE: Retrieval-Augmented Multi-task Information Extraction with Large Language Models on Dietary Supplementscited by 11
  6. 2025Improving LLM Reasoning through Interpretable Role-Playing Steeringcited by 11
  7. 2025Large Language Models for Subjective Language Understanding: A Surveycited by 9
  8. 2024Examining the Prevalence and Dynamics of AI-Generated Media in Art Subredditscited by 8
  9. 2025Do BERT-Like Bidirectional Models Still Perform Better on Text Classification in the Era of LLMs?cited by 8
  10. 2024LLMs' Classification Performance is Overclaimedcited by 6
  11. 2025CluCERT: Certifying LLM Robustness via Clustering-Guided Denoising Smoothingcited by 6
  12. 2024From An LLM Swarm To A PDDL-Empowered HIVE: Planning Self-Executed Instructions In A Multi-Modal Junglecited by 4
16 more
  1. 2024Performance Characterization of Expert Router for Scalable LLM Inferencecited by 2
  2. 2024Gen-AI for User Safety: A Surveycited by 2
  3. 2024Regulation of Language Models With Interpretability Will Likely Result In A Performance Trade-Offcited by 2
  4. 2024Data Quality Enhancement on the Basis of Diversity with Large Language Models for Text Classification: Uncovered, Difficult, and Noisycited by 1
  5. 2025QUAD-LLM-MLTC: Large Language Models Ensemble Learning for Healthcare Text Multi-Label Classificationcited by 1
  6. 2025Integrated ensemble of BERT- and features-based models for authorship attribution in Japanese literary workscited by 1
  7. 2025State of the Art in Text Classification for South Slavic Languages: Fine-Tuning or Prompting?cited by 1
  8. 2024Seventeenth-Century Spanish American Notary Records for Fine-Tuning Spanish Large Language Modelscited by 0
  9. 2025A Transformer-based Autoregressive Decoder Architecture for Hierarchical Text Classificationcited by 0
  10. 2025Improving Multi-turn Task Completion in Task-Oriented Dialog Systems via Prompt Chaining and Fine-Grained Feedbackcited by 0
  11. 2025Comparative Study on the Discourse Meaning of Chinese and English Media in the Paris Olympics Based on LDA Topic Modeling Technology and LLM Prompt Engineeringcited by 0
  12. 2025A Comparative Study of Task Adaptation Techniques of Large Language Models for Identifying Sustainable Development Goalscited by 0
  13. 2025From Description to Score: Can LLMs Quantify Vulnerabilities?cited by 0
  14. 2025Text2Graph: Combining Lightweight LLMs and GNNs for Efficient Text Classification in Label-Scarce Scenarioscited by 0
  15. 2026PerSoMed: A Large-Scale Balanced Dataset for Persian Social Media Text Classificationcited by 0
  16. 2026ProbPlug: A Plugin Uncertainty Network for Reliable Confidence in LLM Binary Classificationcited by 0