mlsanityData to 7 Oct 2026

Recurrent Neural Network for Text Classification with Multi-Task Learning

arXiv 1605.05101 ↗First posted 17 May 2016cs.CLcited by 144

Not on the map. Why?

Abstract (arXiv)

Neural network based methods have obtained great progress on a variety of natural language processing tasks. However, in most previous works, the models are learned based on single-task supervised objectives, which often suffer from insufficient training data. In this paper, we use the multi-task learning framework to jointly learn across multiple related tasks. Based on recurrent neural network, we propose three different mechanisms of sharing information to model text with task-specific and shared layers. The entire network is trained jointly on all these tasks. Experiments on four benchmark text classification tasks show that our proposed models can improve the performance of a task with the help of other related tasks.

Key facts. Cited by 144 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 May 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 47; 2022: 43; 2023: 27; 2024: 13; 2025: 9; 2026: 5.

144 papers.

Sort:

By area:

  1. 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 417
  2. 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
  3. 2021Pre-Trained Models: Past, Present and Futurecited by 319
  4. 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
  5. 2021BERT: A Review of Applications in Natural Language Processing and Understandingcited by 109
  6. 2023Task-Specific Skill Localization in Fine-tuned Language Modelscited by 104
  7. 2023Text Classification via Large Language Modelscited by 104
  8. 2024Representation Surgery for Multi-Task Model Mergingcited by 95
  9. 2023Retrieving Multimodal Information for Augmented Generation: A Surveycited by 84
  10. 2021AEDA: An Easier Data Augmentation Technique for Text Classificationcited by 67
  11. 2022A Benchmark for Automatic Medical Consultation System: Frameworks, Tasks and Datasetscited by 45
  12. 2022A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methodscited by 42
38 more
  1. 2022No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligencecited by 41
  2. 2021Paradigm Shift in Natural Language Processingcited by 39
  3. 2021Refiner: Refining Self-attention for Vision Transformerscited by 38
  4. 2021TabularNet: A Neural Network Architecture for Understanding Semantic Structures of Tabular Datacited by 36
  5. 2021Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Reviewcited by 35
  6. 2024Fair Resource Allocation in Multi-Task Learningcited by 34
  7. 2021AMMU : A Survey of Transformer-based Biomedical Pretrained Language Modelscited by 32
  8. 2021Speaker and Time-aware Joint Contextual Learning for Dialogue-act Classification in Counselling Conversationscited by 31
  9. 2021Byzantine-robust Federated Learning through Collaborative Malicious Gradient Filteringcited by 28
  10. 2024Pushing The Limit of LLM Capacity for Text Classificationcited by 28
  11. 2022Towards Improving Faithfulness in Abstractive Summarizationcited by 27
  12. 2022CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AIcited by 25
  13. 2022PedFormer: Pedestrian Behavior Prediction via Cross-Modal Attention Modulation and Gated Multitask Learningcited by 23
  14. 2023GradientCoin: A Peer-to-Peer Decentralized Large Language Modelscited by 23
  15. 2021AngryBERT: Joint Learning Target and Emotion for Hate Speech Detectioncited by 19
  16. 2023SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understandingcited by 18
  17. 2021Interpreting the Robustness of Neural NLP Models to Textual Perturbationscited by 17
  18. 2024Semantic-CC: Boosting Remote Sensing Image Change Captioning via Foundational Knowledge and Semantic Guidancecited by 17
  19. 2025MoE-Loco: Mixture of Experts for Multitask Locomotioncited by 17
  20. 2021Simplified DOM Trees for Transferable Attribute Extraction from the Webcited by 16
  21. 2021Enhancing Label Correlation Feedback in Multi-Label Text Classification via Multi-Task Learningcited by 15
  22. 2021Sparse Structure Learning via Graph Neural Networks for Inductive Document Classificationcited by 15
  23. 2022InducT-GCN: Inductive Graph Convolutional Networks for Text Classificationcited by 15
  24. 2023Graph Neural Networks for Text Classification: A Surveycited by 15
  25. 2021Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbotscited by 14
  26. 2022TLP: A Deep Learning-based Cost Model for Tensor Program Tuningcited by 14
  27. 2021Hierarchical Heterogeneous Graph Representation Learning for Short Text Classificationcited by 13
  28. 2021Label-Aware Distribution Calibration for Long-tailed Classificationcited by 13
  29. 2023ChatAgri: Exploring Potentials of ChatGPT on Cross-linguistic Agricultural Text Classificationcited by 13
  30. 2024Meme-ingful Analysis: Enhanced Understanding of Cyberbullying in Memes Through Multimodal Explanationscited by 13
  31. 2022Robust Textual Embedding against Word-level Adversarial Attackscited by 12
  32. 2022Pretrained Domain-Specific Language Model for General Information Retrieval Tasks in the AEC Domaincited by 12
  33. 2022Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signalscited by 12
  34. 2021Deep Learning for Technical Document Classificationcited by 11
  35. 2022Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasetscited by 11
  36. 2021DeepStyle: User Style Embedding for Authorship Attribution of Short Textscited by 10
  37. 2021Enhancing Interpretable Clauses Semantically using Pretrained Word Representationcited by 10
  38. 2021Programming Knowledge Tracing: A Comprehensive Dataset and A New Modelcited by 9

50 most cited of 144 All 144 (JSON)