mlsanityData to 7 Oct 2026

Is ChatGPT a Good Sentiment Analyzer? A Preliminary Study

arXiv 2304.04339 ↗First posted 10 Apr 2023cs.CL cs.AIcited by 96

Not on the map. Why?

Abstract (arXiv)

Recently, ChatGPT has drawn great attention from both the research community and the public. We are particularly interested in whether it can serve as a universal sentiment analyzer. To this end, in this work, we provide a preliminary evaluation of ChatGPT on the understanding of opinions, sentiments, and emotions contained in the text. Specifically, we evaluate it in three settings, including standard evaluation, polarity shift evaluation and open-domain evaluation. We conduct an evaluation on 7 representative sentiment analysis tasks covering 17 benchmark datasets and compare ChatGPT with fine-tuned BERT and corresponding state-of-the-art (SOTA) models on them. We also attempt several popular prompting techniques to elicit the ability further. Moreover, we conduct human evaluation and present some qualitative case studies to gain a deep comprehension of its sentiment analysis capabilities.

Key facts. Cited by 96 papers in the map (data through 7 Oct 2026). Builds on 37 of its 76 references that are in the map. First posted on arXiv 10 Apr 2023.

Builds on

37 of 76 references.

References · 37

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  7. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  8. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  9. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  10. 2017Deep reinforcement learning from human preferencescited by 3,846
  11. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  12. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
25 more
  1. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  2. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  3. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  4. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  5. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  6. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  7. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  8. 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 557
  9. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  10. 2023Mathematical Capabilities of ChatGPTcited by 263
  11. 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 244
  12. 2023On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspectivecited by 208
  13. 2022The Unreliability of Explanations in Few-shot Prompting for Textual Reasoningcited by 169
  14. 2023A Categorical Archive of ChatGPT Failurescited by 167
  15. 2023Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERTcited by 155
  16. 2018Deep Learning for Sentiment Analysis : A Surveycited by 139
  17. 2019Emotion-Cause Pair Extraction: A New Task to Emotion Analysis in Textscited by 82
  18. 2022A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challengescited by 61
  19. 2019Exploiting BERT for End-to-End Aspect-based Sentiment Analysiscited by 57
  20. 2021Learning Implicit Sentiment in Aspect-based Sentiment Analysis with Supervised Contrastive Pre-Trainingcited by 37
  21. 2019From Independent Prediction to Re-ordered Prediction: Integrating Relative Position and Global Label Information to Emotion Cause Identificationcited by 17
  22. 2022METS-CoV: A Dataset of Medical Entity and Targeted Sentiment on COVID-19 Related Tweetscited by 12
  23. 2022Challenges for Open-domain Targeted Sentiment Analysiscited by 9
  24. 2020Multi-task Learning of Negation and Speculation for Targeted Sentiment Classificationcited by 7
  25. 2022Towards Unifying the Label Space for Aspect- and Sentence-based Sentiment Analysiscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 35; 2024: 39; 2025: 15; 2026: 7.

96 papers.

Sort:

By area:

  1. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  2. 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 262
  3. 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 138
  4. 2023A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasetscited by 123
  5. 2024Large Language Models Meet NLP: A Surveycited by 102
  6. 2023Can Large Language Models Explain Themselves? A Study of LLM-Generated Self-Explanationscited by 90
  7. 2023Exploring the Potential of Large Language Models in Computational Argumentationcited by 42
  8. 2023What's the Magic Word? A Control Theory of LLM Promptingcited by 41
  9. 2024Membership Inference Attacks Against In-Context Learningcited by 38
  10. 2023GPTAraEval: A Comprehensive Evaluation of ChatGPT on Arabic NLPcited by 37
  11. 2024Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Taskscited by 33
  12. 2023DialogBench: Evaluating LLMs as Human-like Dialogue Systemscited by 31
38 more
  1. 2023A Wide Evaluation of ChatGPT on Affective Computing Taskscited by 30
  2. 2023PPTC Benchmark: Evaluating Large Language Models for PowerPoint Task Completioncited by 30
  3. 2023Who is ChatGPT? Benchmarking LLMs' Psychological Portrayal Using PsychoBenchcited by 28
  4. 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Studycited by 24
  5. 2023Knowledge Graph Completion Models are Few-shot Learners: An Empirical Study of Relation Labeling in E-commerce with LLMscited by 24
  6. 2024Affective Computing in the Era of Large Language Models: A Survey from the NLP Perspectivecited by 24
  7. 2024LLMvsSmall Model? Large Language Model Based Text Augmentation Enhanced Personality Detection Modelcited by 21
  8. 2024Assessing Adversarial Robustness of Large Language Models: An Empirical Studycited by 21
  9. 2023MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension Taskscited by 18
  10. 2023Why Can Large Language Models Generate Correct Chain-of-Thoughts?cited by 16
  11. 2024WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual World Knowledgecited by 16
  12. 2024Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Surveycited by 16
  13. 2024Prompt Design Matters for Computational Social Science Tasks but in Unpredictable Wayscited by 14
  14. 2025Enhancing Semantic Consistency of Large Language Models through Model Editing: An Interpretability-Oriented Approachcited by 14
  15. 2024Reflect-RL: Two-Player Online RL Fine-Tuning for LMscited by 13
  16. 2023Through the Lens of Core Competency: Survey on Evaluation of Large Language Modelscited by 12
  17. 2023Exploring Recommendation Capabilities of GPT-4V(ision): A Preliminary Case Studycited by 12
  18. 2024Can LLMs Replace Economic Choice Prediction Labs? The Case of Language-based Persuasion Gamescited by 12
  19. 2023Language Models as a Service: Overview of a New Paradigm and its Challengescited by 10
  20. 2024PPTC-R benchmark: Towards Evaluating the Robustness of Large Language Models for PowerPoint Task Completioncited by 9
  21. 2024Laboratory-Scale AI: Open-Weight Models are Competitive with ChatGPT Even in Low-Resource Settingscited by 9
  22. 2023Ask Again, Then Fail: Large Language Models' Vacillations in Judgmentcited by 8
  23. 2023From Voices to Validity: Leveraging Large Language Models (LLMs) for Textual Analysis of Policy Stakeholder Interviewscited by 8
  24. 2024Deciphering Political Entity Sentiment in News with Large Language Models: Zero-Shot and Few-Shot Strategiescited by 8
  25. 2024SelfCP: Compressing Over-Limit Prompt via the Frozen Large Language Model Itselfcited by 8
  26. 2024A Comparative Analysis of Instruction Fine-Tuning LLMs for Financial Text Classificationcited by 8
  27. 2023Enhance Multi-domain Sentiment Analysis of Review Texts through Prompting Strategiescited by 7
  28. 2024Enhancing Large Language Model with Decomposed Reasoning for Emotion Cause Pair Extractioncited by 7
  29. 2024OccamLLM: Fast and Exact Language Model Arithmetic in a Single Stepcited by 7
  30. 2023A New Dialogue Response Generation Agent for Large Language Models by Asking Questions to Detect User's Intentionscited by 6
  31. 2023The Limits of ChatGPT in Extracting Aspect-Category-Opinion-Sentiment Quadruples: A Comparative Analysiscited by 6
  32. 2024UniICL: An Efficient Unified Framework Unifying Compression, Selection, and Generationcited by 6
  33. 2024Luna: An Evaluation Foundation Model to Catch Language Model Hallucinations with High Accuracy and Low Costcited by 5
  34. 2024Dynamic Sentiment Analysis with Local Large Language Models using Majority Voting: A Study on Factors Affecting Restaurant Evaluationcited by 5
  35. 2024A Comprehensive Evaluation of Large Language Models on Aspect-Based Sentiment Analysiscited by 5
  36. 2025Emotions in the Loop: A Survey of Affective Computing for Emotional Supportcited by 5
  37. 2025Out-of-Distribution Generalization of In-Context Learning: A Low-Dimensional Subspace Perspectivecited by 5
  38. 2023MEMD-ABSA: A Multi-Element Multi-Domain Dataset for Aspect-Based Sentiment Analysiscited by 4

50 most cited of 96 All 96 (JSON)