mlsanityData to 7 Oct 2026

a survey on GPT-3

arXiv 2212.00857 ↗First posted 1 Dec 2022cs.CL cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

This paper provides an introductory survey to GPT-3. We cover some of the historical development behind this technology, some of the key features of GPT-3, and discuss the machine learning model and the datasets used. We survey both academic and commercial efforts applying GPT-3 in diverse domains such as developing conversational AI chatbots, software development, creative work, domain knowledge, and business productivity. We discuss some of the challenges that GPT-3 faces such as the problems of training complexity, bias, and hallucination/incorrect answers. We also discuss the future research opportunities in this area.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 12 of its 40 references that are in the map. First posted on arXiv 1 Dec 2022.

Builds on

12 of 40 references.

References · 12

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  6. 2021A Survey of Transformerscited by 399
  7. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 376
  8. 2021Is GPT-3 Text Indistinguishable from Human Text? Scarecrow: A Framework for Scrutinizing Machine Textcited by 89
  9. 2021Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarizationcited by 76
  10. 2021GPT3-to-plan: Extracting plans from text using GPT-3cited by 26
  11. 2021Q-Pain: A Question Answering Dataset to Measure Social Bias in Pain Managementcited by 16
  12. 2021CGEMs: A Metric Model for Automatic Code Generation using GPT-3cited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 1; 2025: 2; 2026: 1.

9 papers.

  1. 2023Language Model Behavior: A Comprehensive Surveycited by 92
  2. 2023Can ChatGPT Assess Human Personalities? A General Evaluation Frameworkcited by 69
  3. 2023Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformerscited by 35
  4. 2023BIM-GPT: a Prompt-Based Virtual Assistant Framework for BIM Information Retrievalcited by 12
  5. 2023Hallucination-minimized Data-to-answer Framework for Financial Decision-makerscited by 9
  6. 2024Ta'keed: The First Generative Fact-Checking System for Arabic Claimscited by 3
  7. 2025Implicit Causality-biases in humans and LLMs as a tool for benchmarking LLM discourse capabilitiescited by 1
  8. 2025How LLMs are Shaping the Future of Virtual Realitycited by 1
  9. 2026NLI:Non-uniform Linear Interpolation Approximation of Nonlinear Operations for Efficient LLMs Inferencecited by 1