mlsanityData to 7 Oct 2026

A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets

arXiv 2305.18486 ↗First posted 29 May 2023cs.CL cs.AI cs.LGcited by 123

Not on the map. Why?

Abstract (arXiv)

The development of large language models (LLMs) such as ChatGPT has brought a lot of attention recently. However, their evaluation in the benchmark academic datasets remains under-explored due to the difficulty of evaluating the generative outputs produced by this model against the ground truth. In this paper, we aim to present a thorough evaluation of ChatGPT's performance on diverse academic datasets, covering tasks like question-answering, text summarization, code generation, commonsense reasoning, mathematical problem-solving, machine translation, bias detection, and ethical considerations. Specifically, we evaluate ChatGPT across 140 tasks and analyze 255K responses it generates in these datasets. This makes our work the largest evaluation of ChatGPT in NLP benchmarks. In short, our study aims to validate the strengths and weaknesses of ChatGPT in various tasks and provide insights for future research using LLMs. We also report a new emergent ability to follow multi-query instructions that we mostly found in ChatGPT and other instruction-tuned models. Our extensive evaluation shows that even though ChatGPT is capable of performing a wide variety of tasks, and may obtain impressive performance in several benchmark datasets, it is still far from achieving the ability to reliably solve many challenging tasks. By providing a thorough assessment of ChatGPT's performance across diverse NLP tasks, this paper sets the stage for a targeted deployment of ChatGPT-like LLMs in real-world applications.

Key facts. Cited by 123 papers in the map (data through 7 Oct 2026). Builds on 147 of its 232 references that are in the map. First posted on arXiv 29 May 2023.

Builds on

147 of 232 references.

References · 147

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  8. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  9. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  10. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  11. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  12. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
38 more
  1. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  3. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  4. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  6. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  7. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  8. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  9. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  10. 2021Program Synthesis with Large Language Modelscited by 3,509
  11. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  12. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  13. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  14. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  15. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  16. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
  17. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  18. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  19. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
  20. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
  21. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  22. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  23. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  24. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  25. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,718
  26. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  27. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  28. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  29. 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,359
  30. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  31. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
  32. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  33. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  34. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  35. 2023PaLM 2 Technical Reportcited by 1,154
  36. 2015Teaching Machines to Read and Comprehendcited by 1,039
  37. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  38. 2019Publicly Available Clinical BERT Embeddingscited by 995

50 most cited of 147 All 147 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 33; 2024: 56; 2025: 22; 2026: 12.

123 papers.

Sort:

By area:

  1. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  2. 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
  3. 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 224
  4. 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 198
  5. 2024Are We Done with MMLU?cited by 178
  6. 2023Can LLM-Generated Misinformation Be Detected?cited by 173
  7. 2024When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboardscited by 134
  8. 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
  9. 2024A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendationscited by 84
  10. 2024A Survey on Retrieval-Augmented Text Generation for Large Language Modelscited by 77
  11. 2023GPTEval: A Survey on Assessments of ChatGPT and GPT-4cited by 73
  12. 2023Evaluating Large Language Models on Controlled Generation Taskscited by 73
38 more
  1. 2025The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMscited by 72
  2. 2024Wisdom of the Silicon Crowd: LLM Ensemble Prediction Capabilities Rival Human Crowd Accuracycited by 66
  3. 2023CritiqueLLM: Towards an Informative Critique Generation Model for Evaluation of Large Language Model Generationcited by 65
  4. 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 65
  5. 2023Empirical Study of Zero-Shot NER with ChatGPTcited by 60
  6. 2024ALLaM: Large Language Models for Arabic and Englishcited by 55
  7. 2024Med42 -- Evaluating Fine-Tuning Strategies for Medical LLMs: Full-Parameter vs. Parameter-Efficient Approachescited by 51
  8. 2024A Comprehensive Evaluation of Quantization Strategies for Large Language Modelscited by 47
  9. 2023Exploring the Potential of Large Language Models in Computational Argumentationcited by 42
  10. 2023Efficient RLHF: Reducing the Memory Usage of PPOcited by 40
  11. 2023Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?cited by 39
  12. 2023LMDX: Language Model-based Document Information Extraction and Localizationcited by 37
  13. 2023A Comprehensive Evaluation of Large Language Models on Benchmark Biomedical Text Processing Taskscited by 36
  14. 2024Assessing and Understanding Creativity in Large Language Modelscited by 35
  15. 2023Building Real-World Meeting Summarization Systems using Large Language Models: A Practical Perspectivecited by 34
  16. 2024Tiny Titans: Can Smaller Large Language Models Punch Above Their Weight in the Real World for Meeting Summarization?cited by 32
  17. 2023A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Timecited by 30
  18. 2024The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmerscited by 28
  19. 2023Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learningcited by 26
  20. 2024Can Large Language Models Understand Context?cited by 26
  21. 2023BenLLMEval: A Comprehensive Evaluation into the Potentials and Pitfalls of Large Language Models on Bengali NLPcited by 23
  22. 2023Are Large Language Models Reliable Judges? A Study on the Factuality Evaluation Capabilities of LLMscited by 23
  23. 2023Evaluation of ChatGPT on Biomedical Tasks: A Zero-Shot Comparison with Fine-Tuned Generative Transformerscited by 22
  24. 2024A Systematic Comparison of Contextualized Word Embeddings for Lexical Semantic Changecited by 21
  25. 2024Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and Challengescited by 20
  26. 2024Improving Model Evaluation using SMART Filtering of Benchmark Datasetscited by 20
  27. 2025When Can We Trust LLMs in Mental Health? Large-Scale Benchmarks for Reliable LLM Evaluationcited by 19
  28. 2024Are Large Language Models More Empathetic than Humans?cited by 18
  29. 2025Text2Scenario: Text-Driven Scenario Generation for Autonomous Driving Testcited by 18
  30. 2023Flesch or Fumble? Evaluating Readability Standard Alignment of Instruction-Tuned Language Modelscited by 17
  31. 2023TARJAMAT: Evaluation of Bard and ChatGPT on Machine Translation of Ten Arabic Varietiescited by 16
  32. 2024Large Language Models Are Cross-Lingual Knowledge-Free Reasonerscited by 16
  33. 2023Studying and improving reasoning in humans and machinescited by 14
  34. 2024METAL: Towards Multilingual Meta-Evaluationcited by 14
  35. 2024Copilot Evaluation Harness: Evaluating LLM-Guided Software Programmingcited by 13
  36. 2024From Text to Emotion: Unveiling the Emotion Annotation Capabilities of LLMscited by 13
  37. 2025Improving Automatic Evaluation of Large Language Models (LLMs) in Biomedical Relation Extraction via LLMs-as-the-Judgecited by 13
  38. 2023An Assessment of ChatGPT on Log Datacited by 11

50 most cited of 123 All 123 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models
  2. 2023Pushing the Limits of ChatGPT on NLP Tasks
  3. 2025Comparative Evaluation of ChatGPT and DeepSeek Across Key NLP Tasks: Strengths, Weaknesses, and Domain-Specific Performance
  4. 2024A Systematic Evaluation of Large Language Models for Natural Language Generation Tasks
  5. 2024Testing and Evaluation of Large Language Models: Correctness, Non-Toxicity, and Fairness
  6. 2024Benchmarking Large Language Models for Persian: A Preliminary Study Focusing on ChatGPT
  7. 2023Extractive Summarization via ChatGPT for Faithful Summary Generation
  8. 2024Beware of Words: Evaluating the Lexical Diversity of Conversational LLMs using ChatGPT as Case Study