Text Understanding from Scratch
Not on the map. Why?
Abstract (arXiv)
This article demontrates that we can apply deep learning to text understanding from character-level inputs all the way up to abstract text concepts, using temporal convolutional networks (ConvNets). We apply ConvNets to various large-scale datasets, including ontology classification, sentiment analysis, and text categorization. We show that temporal ConvNets can achieve astonishing performance without the knowledge of words, phrases, sentences and any other syntactic or semantic structures with regards to a human language. Evidence shows that our models can work for both English and Chinese.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Feb 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 2; 2023: 4; 2024: 3; 2025: 3; 2026: 2.
25 papers.
Sort:
By area:
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021Supporting Clustering with Contrastive Learningcited by 90
- 2022On the Relation between Sensitivity and Accuracy in In-context Learningcited by 71
- 2021Pairwise Supervised Contrastive Learning of Sentence Representationscited by 31
- 2021Mitigating Memorization of Noisy Labels via Regularization between Representationscited by 26
- 2021Virtual Augmentation Supported Contrastive Learning of Sentence Representationscited by 21
- 2021NewsEmbed: Modeling News through Pre-trained Document Representationscited by 6
- 2022Contrastive Learning with Prompt-derived Virtual Semantic Prototypes for Unsupervised Sentence Embeddingcited by 6
- 2023Clustering-Aware Negative Sampling for Unsupervised Sentence Representationcited by 5
- 2023Well-calibrated Confidence Measures for Multi-label Text Classification with a Large Number of Labelscited by 5
- 2024Explainable Artificial Intelligence (XAI) for Malware Analysis: A Survey of Techniques, Applications, and Open Challengescited by 5
- 2021SocialInteractionGAN: Multi-person Interaction Sequence Generationcited by 4
13 more
- 2021Short Text Clustering with Transformerscited by 3
- 2025Large Language Models for Healthcare Text Classification: A Systematic Reviewcited by 3
- 2021How to Train Your Agent to Read and Writecited by 2
- 2025Adversarial Text Generation with Dynamic Contextual Perturbationcited by 2
- 2021The Role of the Input in Natural Language Video Descriptioncited by 1
- 2024Contrastive Learning Subspace for Text Clusteringcited by 1
- 2021Secondary Use of Clinical Problem List Entries for Neural Network-Based Disease Code Assignmentcited by 0
- 2023CEIL: A General Classification-Enhanced Iterative Learning Framework for Text Clusteringcited by 0
- 2023Mental Health Diagnosis in the Digital Age: Harnessing Sentiment Analysis on Social Media Platforms upon Ultra-Sparse Feature Contentcited by 0
- 2024Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Modelscited by 0
- 2025VizGen: Data Exploration and Visualization from Natural Language via a Multi-Agent AI Architecturecited by 0
- 2026PruneFuse: Efficient Data Selection via Weight Pruning and Network Fusioncited by 0
- 2026Random Label Prediction Heads for Studying Memorization in Deep Neural Networkscited by 0
- 2026Random Label Prediction Heads for Studying Memorization in Deep Neural Networks13 Jul 2026
- 2026PruneFuse: Efficient Data Selection via Weight Pruning and Network Fusion27 Mar 2026
- 2025VizGen: Data Exploration and Visualization from Natural Language via a Multi-Agent AI Architecture26 Sep 2025
- 2025Adversarial Text Generation with Dynamic Contextual Perturbation10 Jun 2025
- 2025Large Language Models for Healthcare Text Classification: A Systematic Review3 Mar 2025
- 2024Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Models18 Nov 2024
- 2024Explainable Artificial Intelligence (XAI) for Malware Analysis: A Survey of Techniques, Applications, and Open Challenges9 Sep 2024
- 2024Contrastive Learning Subspace for Text Clustering26 Aug 2024
- 2023Well-calibrated Confidence Measures for Multi-label Text Classification with a Large Number of Labels14 Dec 2023
- 2023Mental Health Diagnosis in the Digital Age: Harnessing Sentiment Analysis on Social Media Platforms upon Ultra-Sparse Feature Content9 Nov 2023
- 2023Clustering-Aware Negative Sampling for Unsupervised Sentence Representation17 May 2023
- 2023CEIL: A General Classification-Enhanced Iterative Learning Framework for Text Clustering20 Apr 2023
13 more
- 2022Contrastive Learning with Prompt-derived Virtual Semantic Prototypes for Unsupervised Sentence Embedding7 Nov 2022
- 2022On the Relation between Sensitivity and Accuracy in In-context Learning16 Sep 2022
- 2021Secondary Use of Clinical Problem List Entries for Neural Network-Based Disease Code Assignment27 Dec 2021
- 2021Mitigating Memorization of Noisy Labels via Regularization between Representations18 Oct 2021
- 2021Virtual Augmentation Supported Contrastive Learning of Sentence Representations16 Oct 2021
- 2021Pairwise Supervised Contrastive Learning of Sentence Representations12 Sep 2021
- 2021A Survey on Data Augmentation for Text Classification7 Jul 2021
- 2021NewsEmbed: Modeling News through Pre-trained Document Representations1 Jun 2021
- 2021Supporting Clustering with Contrastive Learning24 Mar 2021
- 2021SocialInteractionGAN: Multi-person Interaction Sequence Generation10 Mar 2021
- 2021The Role of the Input in Natural Language Video Description9 Feb 2021
- 2021Short Text Clustering with Transformers31 Jan 2021
- 2021How to Train Your Agent to Read and Write4 Jan 2021
- 2021A Survey on Data Augmentation for Text Classificationcited by 111
- 2021Supporting Clustering with Contrastive Learningcited by 90
- 2022On the Relation between Sensitivity and Accuracy in In-context Learningcited by 71
- 2021Pairwise Supervised Contrastive Learning of Sentence Representationscited by 31
- 2021Mitigating Memorization of Noisy Labels via Regularization between Representationscited by 26
- 2021Virtual Augmentation Supported Contrastive Learning of Sentence Representationscited by 21
- 2021NewsEmbed: Modeling News through Pre-trained Document Representationscited by 6
- 2022Contrastive Learning with Prompt-derived Virtual Semantic Prototypes for Unsupervised Sentence Embeddingcited by 6
- 2023Clustering-Aware Negative Sampling for Unsupervised Sentence Representationcited by 5
- 2023Well-calibrated Confidence Measures for Multi-label Text Classification with a Large Number of Labelscited by 5
- 2024Explainable Artificial Intelligence (XAI) for Malware Analysis: A Survey of Techniques, Applications, and Open Challengescited by 5
- 2021SocialInteractionGAN: Multi-person Interaction Sequence Generationcited by 4
12 most cited of 24 All 24 (JSON)
- 2026Random Label Prediction Heads for Studying Memorization in Deep Neural Networks13 Jul 2026
- 2026PruneFuse: Efficient Data Selection via Weight Pruning and Network Fusion27 Mar 2026
- 2025Adversarial Text Generation with Dynamic Contextual Perturbation10 Jun 2025
- 2025Large Language Models for Healthcare Text Classification: A Systematic Review3 Mar 2025
- 2024Understanding Student Sentiment on Mental Health Support in Colleges Using Large Language Models18 Nov 2024
- 2024Explainable Artificial Intelligence (XAI) for Malware Analysis: A Survey of Techniques, Applications, and Open Challenges9 Sep 2024
- 2024Contrastive Learning Subspace for Text Clustering26 Aug 2024
- 2023Well-calibrated Confidence Measures for Multi-label Text Classification with a Large Number of Labels14 Dec 2023
- 2023Mental Health Diagnosis in the Digital Age: Harnessing Sentiment Analysis on Social Media Platforms upon Ultra-Sparse Feature Content9 Nov 2023
- 2023Clustering-Aware Negative Sampling for Unsupervised Sentence Representation17 May 2023
- 2023CEIL: A General Classification-Enhanced Iterative Learning Framework for Text Clustering20 Apr 2023
- 2022Contrastive Learning with Prompt-derived Virtual Semantic Prototypes for Unsupervised Sentence Embedding7 Nov 2022
12 newest of 24 All 24 (JSON)