Natural Language Processing Advancements By Deep Learning: A Survey
Not on the map. Why?
Abstract (arXiv)
Natural Language Processing (NLP) helps empower intelligent machines by enhancing a better understanding of the human language for linguistic-based human-computer communication. Recent developments in computational power and the advent of large amounts of linguistic data have heightened the need and demand for automating semantic analysis using data-driven approaches. The utilization of data-driven strategies is pervasive now due to the significant improvements demonstrated through the usage of deep learning methods in areas such as Computer Vision, Automatic Speech Recognition, and in particular, NLP. This survey categorizes and addresses the different aspects and applications of NLP that have benefited from deep learning. It covers core NLP tasks and applications and describes how deep learning methods and models advance these areas. We further analyze and compare different approaches and state-of-the-art models.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 11; 2023: 8; 2024: 13; 2025: 5; 2026: 4.
50 papers.
Sort:
By area:
- 2021A Survey on Deep Semi-supervised Learningcited by 250
- 2022Image Data Augmentation for Deep Learning: A Surveycited by 96
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
- 2022A Unified Review of Deep Learning for Automated Medical Codingcited by 26
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2022Generating Executable Action Plans with Environmentally-Aware Language Modelscited by 21
- 2024The RL/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Modelscited by 15
- 2021DEAP-FAKED: Knowledge Graph based Approach for Fake News Detectioncited by 13
- 2022NashAE: Disentangling Representations through Adversarial Covariance Minimizationcited by 13
- 2024The Asymptotic Behavior of Attention in Transformerscited by 12
- 2024Plan*RAG: Efficient Test-Time Planning for Retrieval Augmented Generationcited by 11
- 2023Energy-Latency Attacks to On-Device Neural Networks via Sponge Poisoningcited by 10
38 more
- 2021BERT-Based Sentiment Analysis: A Software Engineering Perspectivecited by 9
- 2025Predicting New Research Directions in Materials Science using Large Language Models and Concept Graphscited by 9
- 2021Scaling Laws for the Few-Shot Adaptation of Pre-trained Image Classifierscited by 8
- 2023Split-NER: Named Entity Recognition via Two Question-Answering-based Classificationscited by 6
- 2021BERT Transformer model for Detecting Arabic GPT2 Auto-Generated Tweetscited by 4
- 2022A Survey on Uncertainty Toolkits for Deep Learningcited by 4
- 2022Integrating AI Planning with Natural Language Processing: A Combination of Explicit and Tacit Knowledgecited by 3
- 2022Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challengescited by 3
- 2023AudRandAug: Random Image Augmentations for Audio Classificationcited by 3
- 2024IMFL-AIGC: Incentive Mechanism Design for Federated Learning Empowered by Artificial Intelligence Generated Contentcited by 3
- 2024NeurLZ: An Online Neural Learning-Based Method to Enhance Scientific Lossy Compressioncited by 3
- 2021GRAPPA-GANs for Parallel MRI Reconstructioncited by 2
- 2021Textual Data Distributions: Kullback Leibler Textual Distributions Contrasts on GPT-2 Generated Texts, with Supervised, Unsupervised Learning on Vaccine & Market Topics & Sentimentcited by 2
- 2021Gender Recognition in Informal and Formal Language Scenarios via Transfer Learningcited by 2
- 2023Physics-Informed Machine Learning of Argon Gas-Driven Melt Pool Dynamicscited by 2
- 2024Evaluation of Google Translate for Mandarin Chinese translation using sentiment and semantic analysiscited by 2
- 2021Focusing on Potential Named Entities During Active Label Acquisitioncited by 1
- 2022Res-CNN-BiLSTM Network for overcoming Mental Health Disturbances caused due to Cyberbullying through Social Mediacited by 1
- 2022Break The Spell Of Total Correlation In betaTCVAEcited by 1
- 2023Master's Thesis: Out-of-distribution Detection with Energy-based Modelscited by 1
- 2023SuSana Distancia is all you need: Enforcing class separability in metric learning via two novel distance-based loss functions for few-shot image classificationcited by 1
- 2023Distil the informative essence of loop detector data set: Is network-level traffic forecasting hungry for more data?cited by 1
- 2024OxML Challenge 2023: Carcinoma classification using data augmentationcited by 1
- 2024Experimental Evaluation of Machine Learning Models for Goal-oriented Customer Service Chatbot with Pipeline Architecturecited by 1
- 2024TREB: a BERT attempt for imputing tabular data imputationcited by 1
- 2024On the ERM Principle in Meta-Learningcited by 1
- 2025What Scalable Second-Order Information Knows for Pruning at Initializationcited by 1
- 2025EmoGRACE: Aspect-based emotion analysis for social media datacited by 1
- 2022Natural Language Communication with a Teachable Agentcited by 0
- 2023Fundamental Limits of Deep Learning-Based Binary Classifiers Trained with Hinge Losscited by 0
- 2024Convex Distillation: Efficient Compression of Deep Networks via Convex Optimizationcited by 0
- 2024A Fusion-Driven Approach of Attention-Based CNN-BiLSTM for Protein Family Classification -- ProFamNetcited by 0
- 2025Exploring new Approaches for Information Retrieval through Natural Language Processingcited by 0
- 2025Enhancing Classification with Semi-Supervised Deep Learning Using Distance-Based Sample Weightscited by 0
- 2026Abusive music and song transformation using GenAI and LLMscited by 0
- 2026Class Confidence Aware Reweighting for Long Tailed Learningcited by 0
- 2026Don't Shoot The Breeze: Topic Continuity Model Using Nonlinear Naive Bayes With Attentioncited by 0
- 2026Survey on Disaster Management Datasets for Remote Sensing Based Emergency Applicationscited by 0
- 2026Survey on Disaster Management Datasets for Remote Sensing Based Emergency Applications5 May 2026
- 2026Don't Shoot The Breeze: Topic Continuity Model Using Nonlinear Naive Bayes With Attention10 Feb 2026
- 2026Class Confidence Aware Reweighting for Long Tailed Learning22 Jan 2026
- 2026Abusive music and song transformation using GenAI and LLMs21 Jan 2026
- 2025Predicting New Research Directions in Materials Science using Large Language Models and Concept Graphs20 Jun 2025
- 2025Enhancing Classification with Semi-Supervised Deep Learning Using Distance-Based Sample Weights20 May 2025
- 2025Exploring new Approaches for Information Retrieval through Natural Language Processing4 May 2025
- 2025EmoGRACE: Aspect-based emotion analysis for social media data19 Mar 2025
- 2025What Scalable Second-Order Information Knows for Pruning at Initialization17 Feb 2025
- 2024The Asymptotic Behavior of Attention in Transformers3 Dec 2024
- 2024On the ERM Principle in Meta-Learning26 Nov 2024
- 2024Plan*RAG: Efficient Test-Time Planning for Retrieval Augmented Generation28 Oct 2024
38 more
- 2024A Fusion-Driven Approach of Attention-Based CNN-BiLSTM for Protein Family Classification -- ProFamNet21 Oct 2024
- 2024Convex Distillation: Efficient Compression of Deep Networks via Convex Optimization9 Oct 2024
- 2024Experimental Evaluation of Machine Learning Models for Goal-oriented Customer Service Chatbot with Pipeline Architecture27 Sep 2024
- 2024TREB: a BERT attempt for imputing tabular data imputation16 Sep 2024
- 2024NeurLZ: An Online Neural Learning-Based Method to Enhance Scientific Lossy Compression9 Sep 2024
- 2024Evaluation of Google Translate for Mandarin Chinese translation using sentiment and semantic analysis8 Sep 2024
- 2024OxML Challenge 2023: Carcinoma classification using data augmentation1 Sep 2024
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction30 Aug 2024
- 2024IMFL-AIGC: Incentive Mechanism Design for Federated Learning Empowered by Artificial Intelligence Generated Content12 Jun 2024
- 2024The RL/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Models2 Feb 2024
- 2023Distil the informative essence of loop detector data set: Is network-level traffic forecasting hungry for more data?31 Oct 2023
- 2023Split-NER: Named Entity Recognition via Two Question-Answering-based Classifications30 Oct 2023
- 2023Fundamental Limits of Deep Learning-Based Binary Classifiers Trained with Hinge Loss13 Sep 2023
- 2023AudRandAug: Random Image Augmentations for Audio Classification9 Sep 2023
- 2023Physics-Informed Machine Learning of Argon Gas-Driven Melt Pool Dynamics23 Jul 2023
- 2023SuSana Distancia is all you need: Enforcing class separability in metric learning via two novel distance-based loss functions for few-shot image classification15 May 2023
- 2023Energy-Latency Attacks to On-Device Neural Networks via Sponge Poisoning6 May 2023
- 2023Master's Thesis: Out-of-distribution Detection with Energy-based Models28 Jan 2023
- 2022Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challenges27 Nov 2022
- 2022Break The Spell Of Total Correlation In betaTCVAE17 Oct 2022
- 2022Generating Executable Action Plans with Environmentally-Aware Language Models10 Oct 2022
- 2022NashAE: Disentangling Representations through Adversarial Covariance Minimization21 Sep 2022
- 2022A Survey on Uncertainty Toolkits for Deep Learning2 May 2022
- 2022Res-CNN-BiLSTM Network for overcoming Mental Health Disturbances caused due to Cyberbullying through Social Media20 Apr 2022
- 2022Image Data Augmentation for Deep Learning: A Survey19 Apr 2022
- 2022Natural Language Communication with a Teachable Agent17 Mar 2022
- 2022A Survey of Adversarial Defences and Robustness in NLP12 Mar 2022
- 2022Integrating AI Planning with Natural Language Processing: A Combination of Explicit and Tacit Knowledge15 Feb 2022
- 2022A Unified Review of Deep Learning for Automated Medical Coding8 Jan 2022
- 2021Focusing on Potential Named Entities During Active Label Acquisition6 Nov 2021
- 2021Scaling Laws for the Few-Shot Adaptation of Pre-trained Image Classifiers13 Oct 2021
- 2021DEAP-FAKED: Knowledge Graph based Approach for Fake News Detection4 Jul 2021
- 2021Gender Recognition in Informal and Formal Language Scenarios via Transfer Learning23 Jun 2021
- 2021Textual Data Distributions: Kullback Leibler Textual Distributions Contrasts on GPT-2 Generated Texts, with Supervised, Unsupervised Learning on Vaccine & Market Topics & Sentiment15 Jun 2021
- 2021BERT-Based Sentiment Analysis: A Software Engineering Perspective4 Jun 2021
- 2021A Survey on Deep Semi-supervised Learning28 Feb 2021
- 2021BERT Transformer model for Detecting Arabic GPT2 Auto-Generated Tweets22 Jan 2021
- 2021GRAPPA-GANs for Parallel MRI Reconstruction5 Jan 2021
- 2021A Survey on Deep Semi-supervised Learningcited by 250
- 2022Image Data Augmentation for Deep Learning: A Surveycited by 96
- 2024Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Directioncited by 46
- 2022A Unified Review of Deep Learning for Automated Medical Codingcited by 26
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 22
- 2022Generating Executable Action Plans with Environmentally-Aware Language Modelscited by 21
- 2024The RL/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Modelscited by 15
- 2021DEAP-FAKED: Knowledge Graph based Approach for Fake News Detectioncited by 13
- 2022NashAE: Disentangling Representations through Adversarial Covariance Minimizationcited by 13
- 2024The Asymptotic Behavior of Attention in Transformerscited by 12
- 2023Energy-Latency Attacks to On-Device Neural Networks via Sponge Poisoningcited by 10
- 2021BERT-Based Sentiment Analysis: A Software Engineering Perspectivecited by 9
12 most cited of 49 All 49 (JSON)
- 2026Survey on Disaster Management Datasets for Remote Sensing Based Emergency Applications5 May 2026
- 2026Don't Shoot The Breeze: Topic Continuity Model Using Nonlinear Naive Bayes With Attention10 Feb 2026
- 2026Class Confidence Aware Reweighting for Long Tailed Learning22 Jan 2026
- 2026Abusive music and song transformation using GenAI and LLMs21 Jan 2026
- 2025Predicting New Research Directions in Materials Science using Large Language Models and Concept Graphs20 Jun 2025
- 2025Enhancing Classification with Semi-Supervised Deep Learning Using Distance-Based Sample Weights20 May 2025
- 2025Exploring new Approaches for Information Retrieval through Natural Language Processing4 May 2025
- 2025EmoGRACE: Aspect-based emotion analysis for social media data19 Mar 2025
- 2025What Scalable Second-Order Information Knows for Pruning at Initialization17 Feb 2025
- 2024The Asymptotic Behavior of Attention in Transformers3 Dec 2024
- 2024On the ERM Principle in Meta-Learning26 Nov 2024
- 2024A Fusion-Driven Approach of Attention-Based CNN-BiLSTM for Protein Family Classification -- ProFamNet21 Oct 2024
12 newest of 49 All 49 (JSON)