# Natural Language Processing Advancements By Deep Learning: A Survey

arXiv: https://arxiv.org/abs/2003.01200 · HTML: https://mlsanity.com/paper/2003.01200/

## Key facts

- Cited by 50 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Mar 2020.

## Built on by (most cited first, 30 of 50)

- [A Survey on Deep Semi-supervised Learning](https://mlsanity.com/paper/2103.00550/) (2021)
- [Image Data Augmentation for Deep Learning: A Survey](https://mlsanity.com/paper/2204.08610/) (2022)
- [Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction](https://mlsanity.com/paper/2409.00265/) (2024)
- [A Unified Review of Deep Learning for Automated Medical Coding](https://mlsanity.com/paper/2201.02797/) (2022)
- [A Survey of Adversarial Defences and Robustness in NLP](https://mlsanity.com/paper/2203.06414/) (2022)
- [Generating Executable Action Plans with Environmentally-Aware Language Models](https://mlsanity.com/paper/2210.04964/) (2022)
- [The Asymptotic Behavior of Attention in Transformers](https://mlsanity.com/paper/2412.02682/) (2024)
- [The RL/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Models](https://mlsanity.com/paper/2402.01874/) (2024)
- [DEAP-FAKED: Knowledge Graph based Approach for Fake News Detection](https://mlsanity.com/paper/2107.10648/) (2021)
- [NashAE: Disentangling Representations through Adversarial Covariance Minimization](https://mlsanity.com/paper/2209.10677/) (2022)
- [Plan*RAG: Efficient Test-Time Planning for Retrieval Augmented Generation](https://mlsanity.com/paper/2410.20753/) (2024)
- [Energy-Latency Attacks to On-Device Neural Networks via Sponge Poisoning](https://mlsanity.com/paper/2305.03888/) (2023)
- [BERT-Based Sentiment Analysis: A Software Engineering Perspective](https://mlsanity.com/paper/2106.02581/) (2021)
- [Predicting New Research Directions in Materials Science using Large Language Models and Concept Graphs](https://mlsanity.com/paper/2506.16824/) (2025)
- [Scaling Laws for the Few-Shot Adaptation of Pre-trained Image Classifiers](https://mlsanity.com/paper/2110.06990/) (2021)
- [Split-NER: Named Entity Recognition via Two Question-Answering-based Classifications](https://mlsanity.com/paper/2310.19942/) (2023)
- [BERT Transformer model for Detecting Arabic GPT2 Auto-Generated Tweets](https://mlsanity.com/paper/2101.09345/) (2021)
- [A Survey on Uncertainty Toolkits for Deep Learning](https://mlsanity.com/paper/2205.01040/) (2022)
- [Integrating AI Planning with Natural Language Processing: A Combination of Explicit and Tacit Knowledge](https://mlsanity.com/paper/2202.07138/) (2022)
- [Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challenges](https://mlsanity.com/paper/2211.14732/) (2022)
- [AudRandAug: Random Image Augmentations for Audio Classification](https://mlsanity.com/paper/2309.04762/) (2023)
- [IMFL-AIGC: Incentive Mechanism Design for Federated Learning Empowered by Artificial Intelligence Generated Content](https://mlsanity.com/paper/2406.08526/) (2024)
- [NeurLZ: An Online Neural Learning-Based Method to Enhance Scientific Lossy Compression](https://mlsanity.com/paper/2409.05785/) (2024)
- [GRAPPA-GANs for Parallel MRI Reconstruction](https://mlsanity.com/paper/2101.03135/) (2021)
- [Textual Data Distributions: Kullback Leibler Textual Distributions Contrasts on GPT-2 Generated Texts, with Supervised, Unsupervised Learning on Vaccine & Market Topics & Sentiment](https://mlsanity.com/paper/2107.02025/) (2021)
- [Gender Recognition in Informal and Formal Language Scenarios via Transfer Learning](https://mlsanity.com/paper/2107.02759/) (2021)
- [Physics-Informed Machine Learning of Argon Gas-Driven Melt Pool Dynamics](https://mlsanity.com/paper/2307.12304/) (2023)
- [Evaluation of Google Translate for Mandarin Chinese translation using sentiment and semantic analysis](https://mlsanity.com/paper/2409.04964/) (2024)
- [Focusing on Potential Named Entities During Active Label Acquisition](https://mlsanity.com/paper/2111.03837/) (2021)
- [Res-CNN-BiLSTM Network for overcoming Mental Health Disturbances caused due to Cyberbullying through Social Media](https://mlsanity.com/paper/2204.09738/) (2022)

## Abstract (arXiv)

Natural Language Processing (NLP) helps empower intelligent machines by enhancing a better understanding of the human language for linguistic-based human-computer communication. Recent developments in computational power and the advent of large amounts of linguistic data have heightened the need and demand for automating semantic analysis using data-driven approaches. The utilization of data-driven strategies is pervasive now due to the significant improvements demonstrated through the usage of deep learning methods in areas such as Computer Vision, Automatic Speech Recognition, and in particular, NLP. This survey categorizes and addresses the different aspects and applications of NLP that have benefited from deep learning. It covers core NLP tasks and applications and describes how deep learning methods and models advance these areas. We further analyze and compare different approaches and state-of-the-art models.