ChatGPT Alternative Solutions: Large Language Models Survey
Not on the map. Why?
Abstract (arXiv)
In recent times, the grandeur of Large Language Models (LLMs) has not only shone in the realm of natural language processing but has also cast its brilliance across a vast array of applications. This remarkable display of LLM capabilities has ignited a surge in research contributions within this domain, spanning a diverse spectrum of topics. These contributions encompass advancements in neural network architecture, context length enhancements, model alignment, training datasets, benchmarking, efficiency improvements, and more. Recent years have witnessed a dynamic synergy between academia and industry, propelling the field of LLM research to new heights. A notable milestone in this journey is the introduction of ChatGPT, a powerful AI chatbot grounded in LLMs, which has garnered widespread societal attention. The evolving technology of LLMs has begun to reshape the landscape of the entire AI community, promising a revolutionary shift in the way we create and employ AI algorithms. Given this swift-paced technical evolution, our survey embarks on a journey to encapsulate the recent strides made in the world of LLMs. Through an exploration of the background, key discoveries, and prevailing methodologies, we offer an up-to-the-minute review of the literature. By examining multiple LLM models, our paper not only presents a comprehensive overview but also charts a course that identifies existing challenges and points toward potential future research trajectories. This survey furnishes a well-rounded perspective on the current state of generative AI, shedding light on opportunities for further exploration, enhancement, and innovation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 25 of its 46 references that are in the map. First posted on arXiv 21 Mar 2024.
Builds on
25 of 46 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2020GLU Variants Improve Transformercited by 1,804
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
13 more
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
- 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 713
- 2021Datasets: A Community Library for Natural Language Processingcited by 530
- 2020Towards a Human-like Open-Domain Chatbotcited by 470
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
- 2023Large Language Models for Information Retrieval: A Surveycited by 331
- 2019Transformers without Tears: Improving the Normalization of Self-Attentioncited by 153
- 2023The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Datasetcited by 148
- 2023Why think step by step? Reasoning emerges from the locality of experiencecited by 103
- 2023Navigating Prompt Complexity for Zero-Shot Classification: A Study of Large Language Models in Computational Social Sciencecited by 19
- 2021Generative Pre-Trained Transformer for Design Concept Generation: An Explorationcited by 17
- 2020KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learningcited by 9
- 2022Training a T5 Using Lab-sized Resourcescited by 5
Built on by
Citing papers per year: 2025: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?
- 2025Challenges and Applications of Large Language Models: A Comparison of GPT and DeepSeek family of models
- 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models
- 2023A Comprehensive Overview of Large Language Models
- 2024Exploring Advanced Large Language Models with LLMsuite
- 2024Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challenges
- 2023Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New Languages
- 2024Beware of Words: Evaluating the Lexical Diversity of Conversational LLMs using ChatGPT as Case Study