Deep Learning Based Text Classification: A Comprehensive Review
Not on the map. Why?
Abstract (arXiv)
Deep learning based models have surpassed classical machine learning based approaches in various text classification tasks, including sentiment analysis, news categorization, question answering, and natural language inference. In this paper, we provide a comprehensive review of more than 150 deep learning based models for text classification developed in recent years, and discuss their technical contributions, similarities, and strengths. We also provide a summary of more than 40 popular datasets widely used for text classification. Finally, we provide a quantitative analysis of the performance of different deep learning models on popular benchmarks, and discuss future research directions.
Key facts. Cited by 140 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 31; 2022: 42; 2023: 43; 2024: 18; 2025: 6.
140 papers.
Sort:
By area:
- 2023Dataset Distillation: A Comprehensive Reviewcited by 126
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2022Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environmentscited by 57
- 2023A Multi-Modal Neural Geometric Solver with Textual Clauses Parsed from Diagramcited by 55
- 2023Active Learning Principles for In-Context Learning with Large Language Modelscited by 53
- 2022LAMP: Extracting Text from Gradients with Language Model Priorscited by 52
- 2022Evaluating Unsupervised Text Classification: Zero-shot and Similarity-based Approachescited by 39
- 2023Large Language Models Are Zero-Shot Text Classifierscited by 35
- 2021UNIREX: A Unified Learning Framework for Language Model Rationale Extractioncited by 32
- 2022Efficient Classification of Long Documents Using Transformerscited by 30
- 2022Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languagescited by 30
38 more
- 2021The Surprising Performance of Simple Baselines for Misinformation Detectioncited by 27
- 2022One Model, Multiple Modalities: A Sparsely Activated Approach for Text, Sound, Image, Video and Codecited by 26
- 2023Rationalization for Explainable NLP: A Surveycited by 22
- 2023High-Throughput Vector Similarity Search in Knowledge Graphscited by 19
- 2022A Unified Understanding of Deep NLP Models for Text Classificationcited by 18
- 2021Bag-of-Words vs. Graph vs. Sequence in Text Classification: Questioning the Necessity of Text-Graphs and the Surprising Strength of a Wide MLPcited by 17
- 2021WikiContradiction: Detecting Self-Contradiction Articles on Wikipediacited by 17
- 2022Defending against the Label-flipping Attack in Federated Learningcited by 16
- 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluationscited by 16
- 2023Graph Neural Networks for Text Classification: A Surveycited by 15
- 2021Multimodal Fake News Detectioncited by 14
- 2024Evaluation of LLM Chatbots for OSINT-based Cyber Threat Awarenesscited by 14
- 2023Binary Code Summarization: Benchmarking ChatGPT/GPT-4 and Other Large Language Modelscited by 13
- 2022FL-Defender: Combating Targeted Attacks in Federated Learningcited by 12
- 2023A Review of the Trends and Challenges in Adopting Natural Language Processing Methods for Education Feedback Analysiscited by 12
- 2024CTINexus: Automatic Cyber Threat Intelligence Knowledge Graph Construction Using Large Language Modelscited by 12
- 2022Improving Short Text Classification With Augmented Data Using GPT-3cited by 11
- 2022MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusioncited by 10
- 2024Development of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Surveycited by 10
- 2022Automatic Analysis of Available Source Code of Top Artificial Intelligence Conference Paperscited by 9
- 2023Zero-Shot Learning for Requirements Classification: An Exploratory Studycited by 9
- 2022Extending Logic Explained Networks to Text Classificationcited by 8
- 2023Deep Prompt Tuning for Graph Transformerscited by 8
- 2021SupCL-Seq: Supervised Contrastive Learning for Downstream Optimized Sequence Representationscited by 7
- 2022Hierarchical Neural Network Approaches for Long Document Classificationcited by 7
- 2022Precise Single-stage Detectorcited by 7
- 2023Representation biases in sentence transformerscited by 7
- 2024An Empirical Study on Capability of Large Language Models in Understanding Code Semanticscited by 7
- 2024Political DEBATE: Efficient Zero-shot and Few-shot Classifiers for Political Textcited by 7
- 2021Natural Language Understanding for Argumentative Dialogue Systems in the Opinion Building Domaincited by 6
- 2021Personalized Benchmarking with the Ludwig Benchmarking Toolkitcited by 6
- 2022A Review on Text-Based Emotion Detection -- Techniques, Applications, Datasets, and Future Directionscited by 6
- 2023A Glimpse in ChatGPT Capabilities and its impact for AI researchcited by 6
- 2023Recent Advances in Hierarchical Multi-label Text Classification: A Surveycited by 6
- 2025MicroNN: An On-device Disk-resident Updatable Vector Databasecited by 6
- 2021Self-supervised Regularization for Text Classificationcited by 5
- 2021An Ensemble of Pre-trained Transformer Models For Imbalanced Multiclass Malware Classificationcited by 5
- 2022TextConvoNet:A Convolutional Neural Network based Architecture for Text Classificationcited by 5
50 most cited of 140 All 140 (JSON)
- 2025Convolutional Lie Operator for Sentence Classification18 Dec 2025
- 2025Evidence-Driven Decision Support for AI Model Selection in Research Software Engineering12 Dec 2025
- 2025Optimally Deep Networks -- Adapting Model Depth to Datasets for Superior Efficiency12 Oct 2025
- 2025Advancing Scientific Text Classification: Fine-Tuned Models with Dataset Expansion and Hard-Voting26 Apr 2025
- 2025MicroNN: An On-device Disk-resident Updatable Vector Database8 Apr 2025
- 2025Explainable identification of similarities between entities for discovery in large text22 Mar 2025
- 2024CTINexus: Automatic Cyber Threat Intelligence Knowledge Graph Construction Using Large Language Models28 Oct 2024
- 2024KisanQRS: A Deep Learning-based Automated Query-Response System for Agricultural Decision-Making26 Oct 2024
- 2024Text Classification using Graph Convolutional Networks: A Comprehensive Survey12 Oct 2024
- 2024Political DEBATE: Efficient Zero-shot and Few-shot Classifiers for Political Text3 Sep 2024
- 2024DeepDiveAI: Identifying AI Related Documents in Large Scale Literature Data23 Aug 2024
- 2024Steamroller Problems: An Evaluation of LLM Reasoning Capability with Automated Theorem Prover Strategies17 Jul 2024
38 more
- 2024An Empirical Study on Capability of Large Language Models in Understanding Code Semantics4 Jul 2024
- 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluations14 Jun 2024
- 2024Adaptable and Reliable Text Classification using Large Language Models17 May 2024
- 2024Development of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Survey2 May 2024
- 2024Extracting chemical food safety hazards from the scientific literature automatically using large language models1 May 2024
- 2024Comparative Analysis of XGBoost and Minirocket Algortihms for Human Activity Recognition28 Feb 2024
- 2024Evaluation of LLM Chatbots for OSINT-based Cyber Threat Awareness26 Jan 2024
- 2024APT-Pipe: A Prompt-Tuning Tool for Social Data Annotation using ChatGPT24 Jan 2024
- 2024Cascaded Cross-Modal Transformer for Audio-Textual Classification15 Jan 2024
- 2024A Comprehensive Survey of Text Classification Techniques and Their Research Applications: Observational and Experimental Insights11 Jan 2024
- 2024ROIC-DM: Robust Text Inference and Classification via Diffusion Model7 Jan 2024
- 2024MultiSiam: A Multiple Input Siamese Network For Social Media Text Classification And Duplicate Text Detection6 Jan 2024
- 2023Binary Code Summarization: Benchmarking ChatGPT/GPT-4 and Other Large Language Models15 Dec 2023
- 2023Automatic Scoring of Students' Science Writing Using Hybrid Neural Network2 Dec 2023
- 2023Large Language Models Are Zero-Shot Text Classifiers2 Dec 2023
- 2023Assessing the influence of attractor-verb distance on grammatical agreement in humans and language models28 Nov 2023
- 2023Recognizing Conditional Causal Relationships about Emotions and Their Corresponding Conditions28 Nov 2023
- 2023Semantic Representation Learning of Scientific Literature based on Adaptive Feature and Graph Neural Network1 Nov 2023
- 2023Two-Stage Classifier for Campaign Negativity Detection using Axis Embeddings: A Case Study on Tweets of Political Users during 2021 Presidential Election in Iran31 Oct 2023
- 2023Meta learning with language models: Challenges and opportunities in the classification of imbalanced text23 Oct 2023
- 2023Transformer-based Entity Legal Form Classification19 Oct 2023
- 2023CCAE: A Corpus of Chinese-based Asian Englishes9 Oct 2023
- 2023Analysis of the Reasoning with Redundant Information Provided Ability of Large Language Models6 Oct 2023
- 2023Construction contract risk identification based on knowledge-augmented language model22 Sep 2023
- 2023Deep Prompt Tuning for Graph Transformers18 Sep 2023
- 2023Design of Recognition and Evaluation System for Table Tennis Players' Motor Skills Based on Artificial Intelligence4 Sep 2023
- 2023TransPrompt v2: A Transferable Prompting Framework for Cross-task Text Classification29 Aug 2023
- 2023Label Denoising through Cross-Model Agreement27 Aug 2023
- 2023Explainable AI for clinical risk prediction: a survey of concepts, methods, and modalities16 Aug 2023
- 2023A Novel Ehanced Move Recognition Algorithm Based on Pre-trained Models with Positional Embeddings14 Aug 2023
- 2023Recent Advances in Hierarchical Multi-label Text Classification: A Survey30 Jul 2023
- 2023DDNAS: Discretized Differentiable Neural Architecture Search for Text Classification12 Jul 2023
- 2023A Cost-aware Study of Depression Language on Social Media using Topic and Affect Contextualization30 Jun 2023
- 2023Label Agnostic Pre-training for Zero-shot Text Classification25 May 2023
- 2023Active Learning Principles for In-Context Learning with Large Language Models23 May 2023
- 2023A Glimpse in ChatGPT Capabilities and its impact for AI research10 May 2023
- 2023Improving Cancer Hallmark Classification with BERT-based Deep Learning Approach2 May 2023
- 2023Graph Neural Networks for Text Classification: A Survey23 Apr 2023
50 newest of 140 All 140 (JSON)
- 2023A Multi-Modal Neural Geometric Solver with Textual Clauses Parsed from Diagramcited by 55
- 2023Analysis of the Reasoning with Redundant Information Provided Ability of Large Language Modelscited by 2
- 2024Steamroller Problems: An Evaluation of LLM Reasoning Capability with Automated Theorem Prover Strategiescited by 1
- 2024Steamroller Problems: An Evaluation of LLM Reasoning Capability with Automated Theorem Prover Strategies17 Jul 2024
- 2023Analysis of the Reasoning with Redundant Information Provided Ability of Large Language Models6 Oct 2023
- 2023A Multi-Modal Neural Geometric Solver with Textual Clauses Parsed from Diagram22 Feb 2023
- 2023Dataset Distillation: A Comprehensive Reviewcited by 126
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2022Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environmentscited by 57
- 2023Active Learning Principles for In-Context Learning with Large Language Modelscited by 53
- 2022LAMP: Extracting Text from Gradients with Language Model Priorscited by 52
- 2022Evaluating Unsupervised Text Classification: Zero-shot and Similarity-based Approachescited by 39
- 2023Large Language Models Are Zero-Shot Text Classifierscited by 35
- 2021UNIREX: A Unified Learning Framework for Language Model Rationale Extractioncited by 32
- 2022Efficient Classification of Long Documents Using Transformerscited by 30
- 2022Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languagescited by 30
- 2021The Surprising Performance of Simple Baselines for Misinformation Detectioncited by 27
12 most cited of 134 All 134 (JSON)
- 2025Convolutional Lie Operator for Sentence Classification18 Dec 2025
- 2025Evidence-Driven Decision Support for AI Model Selection in Research Software Engineering12 Dec 2025
- 2025Optimally Deep Networks -- Adapting Model Depth to Datasets for Superior Efficiency12 Oct 2025
- 2025Advancing Scientific Text Classification: Fine-Tuned Models with Dataset Expansion and Hard-Voting26 Apr 2025
- 2025Explainable identification of similarities between entities for discovery in large text22 Mar 2025
- 2024CTINexus: Automatic Cyber Threat Intelligence Knowledge Graph Construction Using Large Language Models28 Oct 2024
- 2024KisanQRS: A Deep Learning-based Automated Query-Response System for Agricultural Decision-Making26 Oct 2024
- 2024Text Classification using Graph Convolutional Networks: A Comprehensive Survey12 Oct 2024
- 2024Political DEBATE: Efficient Zero-shot and Few-shot Classifiers for Political Text3 Sep 2024
- 2024DeepDiveAI: Identifying AI Related Documents in Large Scale Literature Data23 Aug 2024
- 2024An Empirical Study on Capability of Large Language Models in Understanding Code Semantics4 Jul 2024
- 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluations14 Jun 2024
12 newest of 134 All 134 (JSON)