mlsanityData to 14 Oct 2026

An Analysis of Neural Language Modeling at Multiple Scales

arXiv 1803.08240 ↗First posted 22 Mar 2018cs.CL cs.AI cs.NEcited by 31

Not on the map. Why?

Abstract (arXiv)

Many of the leading approaches in language modeling introduce novel, complex and specialized architectures. We take existing state-of-the-art word level language models based on LSTMs and QRNNs and extend them to both larger vocabularies as well as character-level granularity. When properly tuned, LSTMs and QRNNs achieve state-of-the-art results on character-level (Penn Treebank, enwik8) and word-level (WikiText-103) datasets, respectively. Results are obtained in only 12 hours (WikiText-103) to 2 days (enwik8) using a single modern GPU.

Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Mar 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 13; 2022: 5; 2023: 3; 2024: 0; 2025: 4; 2026: 6.

31 papers.

Sort:

By area:

  1. 2021Machine Unlearning of Features and Labelscited by 229
  2. 2023End-to-End Speech Recognition: A Surveycited by 129
  3. 2022Your Transformer May Not be as Powerful as You Expectcited by 55
  4. 2021Subformer: Exploring Weight Sharing for Parameter Efficiency in Generative Transformerscited by 43
  5. 2021A Cognitive Regularizer for Language Modelingcited by 11
  6. 2023Linear Log-Normal Attention with Unbiased Concentrationcited by 11
  7. 2021Low-Resource Language Modelling of South African Languagescited by 10
  8. 2021Revisiting Simple Neural Probabilistic Language Modelscited by 10
  9. 2021Exploring Self-Identified Counseling Expertise in Online Support Forumscited by 10
  10. 2021Working Memory Connections for LSTMcited by 10
  11. 2021Language Modelling via Learning to Rankcited by 7
  12. 2026Membership Inference Attacks Against Fine-tuned Diffusion Language Modelscited by 5
19 more
  1. 2021Training and Generating Neural Networks in Compressed Weight Spacecited by 4
  2. 2021Towards Zero-shot Language Modelingcited by 3
  3. 2022N-gram Is Back: Residual Learning of Neural Text Generation with n-gram Language Modelcited by 3
  4. 2025Accelerating LLM Inference with Flexible N:M Sparsity via A Fully Digital Compute-in-Memory Acceleratorcited by 3
  5. 2026GPUTOK: GPU Accelerated Byte Level BPE Tokenizationcited by 3
  6. 2021Predicting the utility of search spaces for black-box optimization: a simple, budget-aware approachcited by 2
  7. 2022Generative Adversarial Training Can Improve Neural Language Modelscited by 2
  8. 2026Consistency Deep Equilibrium Modelscited by 2
  9. 2026Adaptive Block Diffusion: Resolving Training-Inference Mismatch in Diffusion Language Modelscited by 2
  10. 2021Contextual Text Embeddings for Twicited by 1
  11. 2023Minimal Effective Theory for Phonotactic Memory: Capturing Local Correlations due to Errors in Speechcited by 1
  12. 2025Efficient Language Modeling for Low-Resource Settings with Hybrid RNN-Transformer Architecturescited by 1
  13. 2026Support Tokens, Stability Margins, and a New Foundation for Robust LLMscited by 1
  14. 2021Impact of Gender Debiased Word Embeddings in Language Modelingcited by 0
  15. 2022Optimize_Prime@DravidianLangTech-ACL2022: Emotion Analysis in Tamilcited by 0
  16. 2022Optimize_Prime@DravidianLangTech-ACL2022: Abusive Comment Detection in Tamilcited by 0
  17. 2025Estimating the Effects of Sample Training Orders for Large Language Models without Retrainingcited by 0
  18. 2025EG-MLA: Embedding-Gated Multi-head Latent Attention for Scalable and Efficient LLMscited by 0
  19. 2026Long-Context Modeling via GSS-Transformer Hybrid Architecture with Learnable Mixingcited by 0