mlsanityData to 14 Oct 2026

A Primer on Neural Network Models for Natural Language Processing

arXiv 1510.00726 ↗First posted 2 Oct 2015cs.CLcited by 76

Not on the map. Why?

Abstract (arXiv)

Over the past few years, neural networks have re-emerged as powerful machine-learning models, yielding state-of-the-art results in fields such as image recognition and speech processing. More recently, neural network models started to be applied also to textual natural language signals, again with very promising results. This tutorial surveys neural network models from the perspective of natural language processing research, in an attempt to bring natural-language researchers up to speed with the neural techniques. The tutorial covers input encoding for natural language tasks, feed-forward networks, convolutional networks, recurrent networks and recursive networks, as well as the computation graph abstraction for automatic gradient computation.

Key facts. Cited by 76 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Oct 2015.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2019: 1; 2020: 0; 2021: 18; 2022: 12; 2023: 15; 2024: 13; 2025: 9; 2026: 8.

76 papers.

Sort:

By area:

  1. 2024Large Language Models in Mental Health Care: a Scoping Reviewcited by 34
  2. 2021Data-Free Knowledge Transfer: A Surveycited by 31
  3. 2021DeepHate: Hate Speech Detection via Multi-Faceted Text Representationscited by 29
  4. 2023Evidence of interrelated cognitive-like capabilities in large language models: Indications of artificial general intelligence or achievement?cited by 27
  5. 2021Watermarking Graph Neural Networks based on Backdoor Attackscited by 25
  6. 2023Quantum Recurrent Neural Networks for Sequential Learningcited by 25
  7. 2021Conformal prediction for text infilling and part-of-speech predictioncited by 22
  8. 2023The Machine Psychology of Cooperation: Can GPT models operationalise prompts for altruism, cooperation, competitiveness and selfishness in economic games?cited by 22
  9. 2022A survey on text generation using generative adversarial networkscited by 16
  10. 2023Multi-Modal Deep Learning for Credit Rating Prediction Using Text and Numerical Data Streamscited by 13
  11. 2023Exploring Multimodal Approaches for Alzheimer's Disease Detection Using Patient Speech Transcript and Audio Datacited by 13
  12. 2021A Systematic Literature Review of Automated ICD Coding and Classification Systems using Discharge Summariescited by 10
38 more
  1. 2023Language Models as a Service: Overview of a New Paradigm and its Challengescited by 10
  2. 2021Exploring Transformer Based Models to Identify Hate Speech and Offensive Content in English and Indo-Aryan Languagescited by 9
  3. 2024A Survey of Large Language Models in Cybersecuritycited by 8
  4. 2021Realised Volatility Forecasting: Machine Learning via Financial Word Embeddingcited by 7
  5. 2019Rationally Inattentive Inverse Reinforcement Learning Explains YouTube Commenting Behaviorcited by 6
  6. 2021Introduction to Neural Transfer Learning with Transformers for Social Science Text Analysiscited by 6
  7. 2021Abusive and Threatening Language Detection in Urdu using Boosting based and BERT based models: A Comparative Approachcited by 6
  8. 2023Trace Encoding in Process Mining: a survey and benchmarkingcited by 6
  9. 2024Revenge of the Fallen? Recurrent Models Match Transformers at Predicting Human Language Comprehension Metricscited by 6
  10. 2025Beyond Scale: Small Language Models are Comparable to GPT-4 in Mental Health Understandingcited by 6
  11. 2021Stance Detection with BERT Embeddings for Credibility Analysis of Information on Social Mediacited by 5
  12. 2022A scalable deep learning approach for solving high-dimensional dynamic optimal transportcited by 5
  13. 2022A Statistical-Modelling Approach to Feedforward Neural Network Model Selectioncited by 5
  14. 2021Privacy Inference Attacks and Defenses in Cloud-based Deep Neural Network: A Surveycited by 4
  15. 2023Backdoor Learning for NLP: Recent Advances, Challenges, and Future Research Directionscited by 4
  16. 2021Exploring Classic and Neural Lexical Translation Models for Information Retrieval: Interpretability, Effectiveness, and Efficiency Benefitscited by 3
  17. 2021Semi-tensor Product-based TensorDecomposition for Neural Network Compressioncited by 3
  18. 2022Deep Learning Architecture for Automatic Essay Scoringcited by 3
  19. 2023Deep Learning Models to Study Sentence Comprehension in the Human Braincited by 3
  20. 2023DelBugV: Delta-Debugging Neural Network Verifierscited by 3
  21. 2024Bayesian Entropy Neural Networks for Physics-Aware Predictioncited by 3
  22. 2025Graph-Enhanced Retrieval-Augmented Question Answering for E-Commerce Customer Supportcited by 3
  23. 2025A Graph Signal Processing Framework for Hallucination Detection in Large Language Modelscited by 3
  24. 2026DRAINCODE: Stealthy Energy Consumption Attacks on Retrieval-Augmented Code Generation via Context Poisoningcited by 3
  25. 2021Computational Morphology with Neural Network Approachescited by 2
  26. 2022MIME: Adapting a Single Neural Network for Multi-task Inference with Memory-efficient Dynamic Pruningcited by 2
  27. 2022hate-alert@DravidianLangTech-ACL2022: Ensembling Multi-Modalities for Tamil TrollMeme Classificationcited by 2
  28. 2022Sinhala Sentence Embedding: A Two-Tiered Structure for Low-Resource Languagescited by 2
  29. 2024Geometric Insights into Focal Loss: Reducing Curvature for Enhanced Model Calibrationcited by 2
  30. 2024Recent advancements in computational morphology : A comprehensive surveycited by 2
  31. 2025StreetMath: Study of LLMs' Approximation Behaviorscited by 2
  32. 2021Machine Learning Meets Natural Language Processing -- The story so farcited by 1
  33. 2021An In-depth Summary of Recent Artificial Intelligence Applications in Drug Designcited by 1
  34. 2022TSM: Measuring the Enticement of Honeyfiles with Natural Language Processingcited by 1
  35. 2022Statistical process monitoring of artificial neural networkscited by 1
  36. 2022Towards Fine-Dining Recipe Generation with Generative Pre-trained Transformerscited by 1
  37. 2023Global Hierarchical Neural Networks using Hierarchical Softmaxcited by 1
  38. 2024Enhancing Suicide Risk Detection on Social Media through Semi-Supervised Deep Label Smoothingcited by 1

50 most cited of 76 All 76 (JSON)