Effective Use of Word Order for Text Categorization with Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
Convolutional neural network (CNN) is a neural network that can make use of the internal structure of data such as the 2D structure of image data. This paper studies CNN on text categorization to exploit the 1D structure (namely, word order) of text data for accurate prediction. Instead of using low-dimensional word vectors as input as is often done, we directly apply CNN to high-dimensional text data, which leads to directly learning embedding of small text regions for use in classification. In addition to a straightforward adaptation of CNN from image to text, a simple but new variation which employs bag-of-word conversion in the convolution layer is proposed. An extension to combine multiple convolution layers is also explored for higher accuracy. The experiments demonstrate the effectiveness of our approach in comparison with state-of-the-art methods.
Key facts. Cited by 40 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Dec 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 12; 2023: 11; 2024: 1; 2025: 4; 2026: 1.
40 papers.
Sort:
- 2023Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarkscited by 142
- 2021Multi-Label Learning from Single Positive Labelscited by 81
- 2022Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classificationcited by 52
- 2022HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classificationcited by 31
- 2021HTCInfoMax: A Global Model for Hierarchical Text Classification via Information Maximizationcited by 25
- 2023SciReviewGen: A Large-scale Dataset for Automatic Literature Review Generationcited by 17
- 2022A Transformer-based Framework for POI-level Social Post Geolocationcited by 13
- 2021Joint Learning of Hyperbolic Label Embeddings for Hierarchical Multi-label Classificationcited by 8
- 2023Encoded Summarization: Summarizing Documents into Continuous Vector Space for Legal Case Retrievalcited by 6
- 2022TextConvoNet:A Convolutional Neural Network based Architecture for Text Classificationcited by 5
- 2021Hierarchical Text Classification of Urdu News using Deep Neural Networkcited by 4
- 2022Spam Review Detection Using Deep Learningcited by 4
28 more
- 2023Deep Learning-based Sentiment Classification: A Comparative Surveycited by 4
- 2022A Survey on Automated Sarcasm Detection on Twittercited by 3
- 2022Comparing Baseline Shapley and Integrated Gradients for Local Explanation: Some Additional Insightscited by 3
- 2024Utilizing Local Hierarchy with Adversarial Training for Hierarchical Text Classificationcited by 3
- 2021Literature review on vulnerability detection using NLP technologycited by 2
- 2022State-Regularized Recurrent Neural Networks to Extract Automata and Explain Predictionscited by 2
- 2023AE-smnsMLC: Multi-Label Classification with Semantic Matching and Negative Label Sampling for Product Attribute Value Extractioncited by 2
- 2021Preliminary Steps Towards Federated Sentiment Classificationcited by 1
- 2021Hierarchy-Aware T5 with Path-Adaptive Mask Mechanism for Hierarchical Text Classificationcited by 1
- 2021Solar cell patent classification method based on keyword extraction and deep neural networkcited by 1
- 2023Open Problems in Applied Deep Learningcited by 1
- 2023JPAVE: A Generation and Classification-based Model for Joint Product Attribute Prediction and Value Extractioncited by 1
- 2023SECNN: Squeeze-and-Excitation Convolutional Neural Network for Sentence Classificationcited by 1
- 2025Understanding Mental Health Content on Social Media and Its Effect Towards Suicidal Ideationcited by 1
- 2021Sent2Matrix: Folding Character Sequences in Serpentine Manifolds for Two-Dimensional Sentencecited by 0
- 2021Structural block driven - enhanced convolutional neural representation for relation extractioncited by 0
- 2021Automated Detection of GDPR Disclosure Requirements in Privacy Policies using Deep Active Learningcited by 0
- 2022TraceNet: Tracing and Locating the Key Elements in Sentiment Analysiscited by 0
- 2022Learning Sequence Representations by Non-local Recurrent Neural Memorycited by 0
- 2022A Machine Learning Approach to Classifying Construction Cost Documents into the International Construction Measurement Standardcited by 0
- 2022Classifying text using machine learning models and determining conversation driftcited by 0
- 2023FewShotTextGCN: K-hop neighborhood regularization for few-shot learning on graphscited by 0
- 2023SA-CNN: Application to text categorization issues using simulated annealing-based convolutional neural network optimizationcited by 0
- 2023Classification-Aware Neural Topic Model Combined With Interpretable Analysis -- For Conflict Classificationcited by 0
- 2025Hierarchical Text Classification Using Contrastive Learning Informed Path Guided Hierarchycited by 0
- 2025GTA: Supervised-Guided Reinforcement Learning for Text Classification with Large Language Modelscited by 0
- 2025Convolutional Lie Operator for Sentence Classificationcited by 0
- 2026Automatic Detection of Deaths from Social Networking Sitescited by 0
- 2026Automatic Detection of Deaths from Social Networking Sites1 Jul 2026
- 2025Convolutional Lie Operator for Sentence Classification18 Dec 2025
- 2025GTA: Supervised-Guided Reinforcement Learning for Text Classification with Large Language Models15 Sep 2025
- 2025Hierarchical Text Classification Using Contrastive Learning Informed Path Guided Hierarchy4 Jun 2025
- 2025Understanding Mental Health Content on Social Media and Its Effect Towards Suicidal Ideation16 Jan 2025
- 2024Utilizing Local Hierarchy with Adversarial Training for Hierarchical Text Classification29 Feb 2024
- 2023Deep Learning-based Sentiment Classification: A Comparative Survey12 Dec 2023
- 2023SECNN: Squeeze-and-Excitation Convolutional Neural Network for Sentence Classification11 Dec 2023
- 2023JPAVE: A Generation and Classification-based Model for Joint Product Attribute Prediction and Value Extraction7 Nov 2023
- 2023AE-smnsMLC: Multi-Label Classification with Semantic Matching and Negative Label Sampling for Product Attribute Value Extraction11 Oct 2023
- 2023Encoded Summarization: Summarizing Documents into Continuous Vector Space for Legal Case Retrieval15 Sep 2023
- 2023Classification-Aware Neural Topic Model Combined With Interpretable Analysis -- For Conflict Classification29 Aug 2023
28 more
- 2023SciReviewGen: A Large-scale Dataset for Automatic Literature Review Generation24 May 2023
- 2023Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarks17 May 2023
- 2023SA-CNN: Application to text categorization issues using simulated annealing-based convolutional neural network optimization13 Mar 2023
- 2023Open Problems in Applied Deep Learning26 Jan 2023
- 2023FewShotTextGCN: K-hop neighborhood regularization for few-shot learning on graphs25 Jan 2023
- 2022State-Regularized Recurrent Neural Networks to Extract Automata and Explain Predictions10 Dec 2022
- 2022Classifying text using machine learning models and determining conversation drift15 Nov 2022
- 2022Spam Review Detection Using Deep Learning3 Nov 2022
- 2022A Transformer-based Framework for POI-level Social Post Geolocation26 Oct 2022
- 2022A Machine Learning Approach to Classifying Construction Cost Documents into the International Construction Measurement Standard24 Oct 2022
- 2022Comparing Baseline Shapley and Integrated Gradients for Local Explanation: Some Additional Insights12 Aug 2022
- 2022Learning Sequence Representations by Non-local Recurrent Neural Memory20 Jul 2022
- 2022HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classification28 Apr 2022
- 2022TextConvoNet:A Convolutional Neural Network based Architecture for Text Classification10 Mar 2022
- 2022Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classification8 Mar 2022
- 2022TraceNet: Tracing and Locating the Key Elements in Sentiment Analysis28 Feb 2022
- 2022A Survey on Automated Sarcasm Detection on Twitter5 Feb 2022
- 2021Automated Detection of GDPR Disclosure Requirements in Privacy Policies using Deep Active Learning8 Nov 2021
- 2021Solar cell patent classification method based on keyword extraction and deep neural network18 Sep 2021
- 2021Hierarchy-Aware T5 with Path-Adaptive Mask Mechanism for Hierarchical Text Classification17 Sep 2021
- 2021Preliminary Steps Towards Federated Sentiment Classification26 Jul 2021
- 2021Hierarchical Text Classification of Urdu News using Deep Neural Network7 Jul 2021
- 2021Multi-Label Learning from Single Positive Labels17 Jun 2021
- 2021Literature review on vulnerability detection using NLP technology23 Apr 2021
- 2021HTCInfoMax: A Global Model for Hierarchical Text Classification via Information Maximization12 Apr 2021
- 2021Structural block driven - enhanced convolutional neural representation for relation extraction21 Mar 2021
- 2021Sent2Matrix: Folding Character Sequences in Serpentine Manifolds for Two-Dimensional Sentence15 Mar 2021
- 2021Joint Learning of Hyperbolic Label Embeddings for Hierarchical Multi-label Classification13 Jan 2021
- 2023Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarkscited by 142
- 2021Multi-Label Learning from Single Positive Labelscited by 81
- 2022Incorporating Hierarchy into Text Encoder: a Contrastive Learning Approach for Hierarchical Text Classificationcited by 52
- 2022HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classificationcited by 31
- 2021HTCInfoMax: A Global Model for Hierarchical Text Classification via Information Maximizationcited by 25
- 2023SciReviewGen: A Large-scale Dataset for Automatic Literature Review Generationcited by 17
- 2022A Transformer-based Framework for POI-level Social Post Geolocationcited by 13
- 2021Joint Learning of Hyperbolic Label Embeddings for Hierarchical Multi-label Classificationcited by 8
- 2023Encoded Summarization: Summarizing Documents into Continuous Vector Space for Legal Case Retrievalcited by 6
- 2022TextConvoNet:A Convolutional Neural Network based Architecture for Text Classificationcited by 5
- 2021Hierarchical Text Classification of Urdu News using Deep Neural Networkcited by 4
- 2022Spam Review Detection Using Deep Learningcited by 4
12 most cited of 40 All 40 (JSON)
- 2026Automatic Detection of Deaths from Social Networking Sites1 Jul 2026
- 2025Convolutional Lie Operator for Sentence Classification18 Dec 2025
- 2025GTA: Supervised-Guided Reinforcement Learning for Text Classification with Large Language Models15 Sep 2025
- 2025Hierarchical Text Classification Using Contrastive Learning Informed Path Guided Hierarchy4 Jun 2025
- 2025Understanding Mental Health Content on Social Media and Its Effect Towards Suicidal Ideation16 Jan 2025
- 2024Utilizing Local Hierarchy with Adversarial Training for Hierarchical Text Classification29 Feb 2024
- 2023Deep Learning-based Sentiment Classification: A Comparative Survey12 Dec 2023
- 2023SECNN: Squeeze-and-Excitation Convolutional Neural Network for Sentence Classification11 Dec 2023
- 2023JPAVE: A Generation and Classification-based Model for Joint Product Attribute Prediction and Value Extraction7 Nov 2023
- 2023AE-smnsMLC: Multi-Label Classification with Semantic Matching and Negative Label Sampling for Product Attribute Value Extraction11 Oct 2023
- 2023Encoded Summarization: Summarizing Documents into Continuous Vector Space for Legal Case Retrieval15 Sep 2023
- 2023Classification-Aware Neural Topic Model Combined With Interpretable Analysis -- For Conflict Classification29 Aug 2023
12 newest of 40 All 40 (JSON)