A Survey on Neural Network Language Models
Not on the map. Why?
Abstract (arXiv)
As the core component of Natural Language Processing (NLP) system, Language Model (LM) can provide word representation and probability indication of word sequences. Neural Network Language Models (NNLMs) overcome the curse of dimensionality and improve the performance of traditional LMs. A survey on NNLMs is performed in this paper. The structure of classic NNLMs is described firstly, and then some major improvements are introduced and analyzed. We summarize and compare corpora and toolkits of NNLMs. Further, some research directions of NNLMs are discussed.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 1; 2023: 6; 2024: 1.
12 papers.
- 2024Algorithmic progress in language modelscited by 31
- 2021An enriched category theory of language: from syntax to semanticscited by 21
- 2021Customizing Contextualized Language Models forLegal Document Reviewscited by 8
- 2023Ticket-BERT: Labeling Incident Management Tickets with Language Modelscited by 3
- 2023An Introduction to Natural Language Processing Techniques and Framework for Clinical Implementation in Radiation Oncologycited by 2
- 2022Res-CNN-BiLSTM Network for overcoming Mental Health Disturbances caused due to Cyberbullying through Social Mediacited by 1
- 2023A Pilot Evaluation of ChatGPT and DALL-E 2 on Decision Making and Spatial Reasoningcited by 1
- 2023When Giant Language Brains Just Aren't Enough! Domain Pizzazz with Knowledge Sparkle Dustcited by 1
- 2021Feature Alignment as a Generative Processcited by 0
- 2021Sentence-level Online Handwritten Chinese Character Recognitioncited by 0
- 2023Structured Thoughts Automaton: First Formalized Execution Model for Auto-Regressive Language Modelscited by 0
- 2023An Analysis of Embedding Layers and Similarity Scores using Siamese Neural Networkscited by 0
- 2024Algorithmic progress in language models9 Mar 2024
- 2023An Analysis of Embedding Layers and Similarity Scores using Siamese Neural Networks31 Dec 2023
- 2023An Introduction to Natural Language Processing Techniques and Framework for Clinical Implementation in Radiation Oncology3 Nov 2023
- 2023Ticket-BERT: Labeling Incident Management Tickets with Language Models30 Jun 2023
- 2023Structured Thoughts Automaton: First Formalized Execution Model for Auto-Regressive Language Models16 Jun 2023
- 2023When Giant Language Brains Just Aren't Enough! Domain Pizzazz with Knowledge Sparkle Dust12 May 2023
- 2023A Pilot Evaluation of ChatGPT and DALL-E 2 on Decision Making and Spatial Reasoning15 Feb 2023
- 2022Res-CNN-BiLSTM Network for overcoming Mental Health Disturbances caused due to Cyberbullying through Social Media20 Apr 2022
- 2021Sentence-level Online Handwritten Chinese Character Recognition4 Jul 2021
- 2021Feature Alignment as a Generative Process23 Jun 2021
- 2021An enriched category theory of language: from syntax to semantics15 Jun 2021
- 2021Customizing Contextualized Language Models forLegal Document Reviews10 Feb 2021