mlsanityData to 7 Oct 2026

Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models

arXiv 2304.01852 ↗First posted 4 Apr 2023cs.CLcited by 152

Not on the map. Why?

Abstract (arXiv)

This paper presents a comprehensive survey of ChatGPT-related (GPT-3.5 and GPT-4) research, state-of-the-art large language models (LLM) from the GPT series, and their prospective applications across diverse domains. Indeed, key innovations such as large-scale pre-training that captures knowledge across the entire world wide web, instruction fine-tuning and Reinforcement Learning from Human Feedback (RLHF) have played significant roles in enhancing LLMs' adaptability and performance. We performed an in-depth analysis of 194 relevant papers on arXiv, encompassing trend analysis, word cloud representation, and distribution analysis across various application domains. The findings reveal a significant and increasing interest in ChatGPT-related research, predominantly centered on direct natural language processing applications, while also demonstrating considerable potential in areas ranging from education and history to mathematics, medicine, and physics. This study endeavors to furnish insights into ChatGPT's capabilities, potential implications, ethical concerns, and offer direction for future advancements in this field.

Key facts. Cited by 152 papers in the map (data through 7 Oct 2026). Builds on 78 of its 113 references that are in the map. First posted on arXiv 4 Apr 2023.

Builds on

78 of 113 references.

References · 78

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2017Deep reinforcement learning from human preferencescited by 3,846
  4. 2015Teaching Machines to Read and Comprehendcited by 1,039
  5. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  6. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
  7. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  8. 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
  9. 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 420
  10. 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 416
  11. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 345
  12. 2023Mathematical Capabilities of ChatGPTcited by 263
38 more
  1. 2021ICDAR2019 Competition on Scanned Receipt OCR and Information Extractioncited by 254
  2. 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
  3. 2023ChatGPT: Jack of all trades, master of nonecited by 204
  4. 2023The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientationcited by 183
  5. 2020Event Extraction by Answering (Almost) Natural Questionscited by 177
  6. 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 172
  7. 2023A Categorical Archive of ChatGPT Failurescited by 167
  8. 2023Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speechcited by 165
  9. 2021To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translationcited by 161
  10. 2023Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERTcited by 155
  11. 2023Does Synthetic Data Generation of LLMs Help Clinical Text Mining?cited by 151
  12. 2021Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extractioncited by 129
  13. 2023DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4cited by 128
  14. 2023Exploring the Limits of ChatGPT for Query or Aspect-based Text Summarizationcited by 122
  15. 2023ChatCAD: Interactive Computer-Aided Diagnosis on Medical Image using Large Language Modelscited by 116
  16. 2023An Analysis of the Automatic Bug Fixing Performance of ChatGPTcited by 108
  17. 2023Regulating ChatGPT and other Large Generative AI Modelscited by 102
  18. 2022ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reportscited by 100
  19. 2022ChatGPT: The End of Online Exam Integrity?cited by 88
  20. 2023Extracting Accurate Materials Data from Research Papers with Conversational Language Models and Prompt Engineeringcited by 86
  21. 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 86
  22. 2022How would Stance Detection Techniques Evolve after the Launch of ChatGPT?cited by 76
  23. 2023Exploring the Feasibility of ChatGPT for Event Extractioncited by 76
  24. 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 73
  25. 2019CrossWeigh: Training Named Entity Tagger from Imperfect Annotationscited by 60
  26. 2023Chat2VIS: Generating Data Visualisations via Natural Language using ChatGPT, Codex and GPT-3 Large Language Modelscited by 58
  27. 2023Can ChatGPT Write a Good Boolean Query for Systematic Review Literature Search?cited by 54
  28. 2023When Brain-inspired AI Meets AGIcited by 54
  29. 2018A Hierarchical Framework for Relation Extraction with Reinforcement Learningcited by 49
  30. 2023ChatGPT: Beginning of an End of Manual Linguistic Data Annotation? Use Case of Automatic Genre Identificationcited by 45
  31. 2021Frustratingly Easy Transferability Estimationcited by 44
  32. 2023Learning gain differences between ChatGPT and human tutor generated algebra hintscited by 42
  33. 2023Conversational Automated Program Repaircited by 41
  34. 2023Will ChatGPT get you caught? Rethinking of Plagiarism Detectioncited by 41
  35. 2023Will Affective Computing Emerge from Foundation Models and General AI? A First Evaluation on ChatGPTcited by 41
  36. 2023ICL-D3IE: In-Context Learning with Diverse Demonstrations Updating for Document Information Extractioncited by 38
  37. 2023Causal-Discovery Performance of ChatGPT in the context of Neuropathic Pain Diagnosiscited by 36
  38. 2022"I think this is the most disruptive technology": Exploring Sentiments of ChatGPT Early Adopters using Twitter Datacited by 32

50 most cited of 78 All 78 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 27; 2024: 80; 2025: 37; 2026: 8.

152 papers.

Sort:

By area:

  1. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  2. 2023A Comprehensive Overview of Large Language Modelscited by 639
  3. 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 157
  4. 2023Large Language Models in Law: A Surveycited by 128
  5. 2024Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQLcited by 118
  6. 2024Large Language Models and Games: A Survey and Roadmapcited by 91
  7. 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectivescited by 88
  8. 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 88
  9. 2023Using Large Language Models for Hyperparameter Optimizationcited by 71
  10. 2024Large language models surpass human experts in predicting neuroscience resultscited by 69
  11. 2024Understanding LLMs: A Comprehensive Overview from Training to Inferencecited by 58
  12. 2024A Comprehensive Review of Multimodal Large Language Models: Performance and Challenges Across Different Taskscited by 57
38 more
  1. 2023Generative Pre-trained Transformer: A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directionscited by 55
  2. 2023Prompt Engineering for Healthcare: Methodologies and Applicationscited by 52
  3. 2024Autonomous LLM-driven research from data to human-verifiable research paperscited by 50
  4. 2025From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agentscited by 49
  5. 2023Open-TI: Open Traffic Intelligence with Augmented Language Modelcited by 38
  6. 2023Is ChatGPT a Good Teacher Coach? Measuring Zero-Shot Performance For Scoring and Providing Actionable Insights on Classroom Instructioncited by 37
  7. 2023Artificial General Intelligence for Medical Imaging Analysiscited by 32
  8. 2024Large Language Model-Based Evolutionary Optimizer: Reasoning with elitismcited by 27
  9. 2024Dynamic and Adaptive Feature Generation with LLMcited by 27
  10. 2023Differentiate ChatGPT-generated and Human-written Medical Textscited by 26
  11. 2024Language-driven Grasp Detectioncited by 26
  12. 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Researchcited by 26
  13. 2025AVCD: Mitigating Hallucinations in Audio-Visual Large Language Models through Contrastive Decodingcited by 26
  14. 2024Evaluating Human-AI Collaboration: A Review and Methodological Frameworkcited by 25
  15. 2023Segment Anything Model (SAM) for Radiation Oncologycited by 24
  16. 2024AgroGPT: Efficient Agricultural Vision-Language Model with Expert Tuningcited by 23
  17. 2025Transformer Copilot: Learning from The Mistake Log in LLM Fine-tuningcited by 21
  18. 2024Watermarking Techniques for Large Language Models: A Surveycited by 20
  19. 2024Exploring the Frontiers of LLMs in Psychological Applications: A Comprehensive Reviewcited by 17
  20. 2025ChemGraph: An Agentic Framework for Computational Chemistry Workflowscited by 16
  21. 20233DAxiesPrompts: Unleashing the 3D Spatial Task Capabilities of GPT-4Vcited by 15
  22. 2024The RL/LLM Taxonomy Tree: Reviewing Synergies Between Reinforcement Learning and Large Language Modelscited by 15
  23. 2023Large Language Models for Travel Behavior Predictioncited by 13
  24. 2025Attack and defense techniques in large language models: A survey and new perspectivescited by 13
  25. 2024SceneGPT: A Language Model for 3D Scene Understandingcited by 12
  26. 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decisioncited by 11
  27. 2023The Potential of Visual ChatGPT For Remote Sensingcited by 10
  28. 2023Can ChatGPT Pass An Introductory Level Functional Language Programming Course?cited by 9
  29. 2023Transformation vs Tradition: Artificial General Intelligence (AGI) for Arts and Humanitiescited by 9
  30. 2024LLMs for Coding and Robotics Educationcited by 9
  31. 2024Using Large Language Models to Automate and Expedite Reinforcement Learning with Reward Machinecited by 9
  32. 2024More RLHF, More Trust? On The Impact of Preference Alignment On Trustworthinesscited by 9
  33. 2024Information Extraction from Clinical Notes: Are We Ready to Switch to Large Language Models?cited by 9
  34. 2023Understanding Fairness Surrogate Functions in Algorithmic Fairnesscited by 8
  35. 2024BenchmarkCards: Standardized Documentation for Large Language Model Benchmarkscited by 8
  36. 2025TH-Bench: Evaluating Evading Attacks via Humanizing AI Text on Machine-Generated Text Detectorscited by 8
  37. 2024Probabilistically Robust Watermarking of Neural Networkscited by 7
  38. 2024CaT-GNN: Enhancing Credit Card Fraud Detection via Causal Temporal Graph Neural Networkscited by 7

50 most cited of 152 All 152 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets
  2. 2024ChatGPT Alternative Solutions: Large Language Models Survey
  3. 2023ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?
  4. 2023GPTEval: A Survey on Assessments of ChatGPT and GPT-4
  5. 2023Can we trust the evaluation on ChatGPT?
  6. 2024Beware of Words: Evaluating the Lexical Diversity of Conversational LLMs using ChatGPT as Case Study
  7. 2026Experimental evidence of progressive ChatGPT models self-convergence
  8. 2024Testing and Evaluation of Large Language Models: Correctness, Non-Toxicity, and Fairness