Several categories of Large Language Models (LLMs): A Short Survey
Not on the map. Why?
Abstract (arXiv)
Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments and efforts made for various LLM kinds, including task-based financial LLMs, multilingual language LLMs, biomedical and clinical LLMs, vision language LLMs, and code language models. The survey gives a general summary of the methods, attributes, datasets, transformer models, and comparison metrics applied in each category of LLMs. Furthermore, it highlights unresolved problems in the field of developing chatbots and virtual assistants, such as boosting natural language processing, enhancing chatbot intelligence, and resolving moral and legal dilemmas. The purpose of this study is to provide readers, developers, academics, and users interested in LLM-based chatbots and virtual intelligent assistant technologies with useful information and future directions.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 87 of its 138 references that are in the map. First posted on arXiv 5 Jul 2023.
Builds on
87 of 138 references.
References · 87
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
38 more
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2023A Survey of Large Language Modelscited by 2,576
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
- 2018Deep contextualized word representationscited by 2,290
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,043
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2019Publicly Available Clinical BERT Embeddingscited by 1,002
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 906
- 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 766
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 733
- 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 713
- 2023Instruction Tuning with GPT-4cited by 686
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 654
- 2022MTEB: Massive Text Embedding Benchmarkcited by 640
- 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 597
- 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 559
- 2021Datasets: A Community Library for Natural Language Processingcited by 530
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 529
50 most cited of 87 All 87 (JSON)
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 1; 2026: 1.
7 papers.
- 2023"It's a Fair Game", or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational Agentscited by 60
- 2024Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languagescited by 36
- 2024Language Models can Exploit Cross-Task In-context Learning for Data-Scarce Novel Taskscited by 13
- 2024A Comparison of LLM Finetuning Methods & Evaluation Metrics with Travel Chatbot Use Casecited by 6
- 2023ArcGPT: A Large Language Model Tailored for Real-world Archival Applicationscited by 3
- 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessmentcited by 2
- 2026LYNX: Analytical Program Synthesis via Grounding and Closed-Loop Refinementcited by 0
- 2026LYNX: Analytical Program Synthesis via Grounding and Closed-Loop Refinement10 Oct 2026
- 2025Securing Educational LLMs: A Generalised Taxonomy of Attacks on LLMs and DREAD Risk Assessment12 Aug 2025
- 2024A Comparison of LLM Finetuning Methods & Evaluation Metrics with Travel Chatbot Use Case7 Aug 2024
- 2024Language Models can Exploit Cross-Task In-context Learning for Data-Scarce Novel Tasks17 May 2024
- 2024Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages19 Feb 2024
- 2023"It's a Fair Game", or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational Agents20 Sep 2023
- 2023ArcGPT: A Large Language Model Tailored for Real-world Archival Applications27 Jul 2023