Can ChatGPT's Responses Boost Traditional Natural Language Processing?
Not on the map. Why?
Abstract (arXiv)
The employment of foundation models is steadily expanding, especially with the launch of ChatGPT and the release of other foundation models. These models have shown the potential of emerging capabilities to solve problems, without being particularly trained to solve. A previous work demonstrated these emerging capabilities in affective computing tasks; the performance quality was similar to traditional Natural Language Processing (NLP) techniques, but falling short of specialised trained models, like fine-tuning of the RoBERTa language model. In this work, we extend this by exploring if ChatGPT has novel knowledge that would enhance existing specialised models when they are fused together. We achieve this by investigating the utility of verbose responses from ChatGPT about solving a downstream task, in addition to studying the utility of fusing that with existing NLP methods. The study is conducted on three affective computing problems, namely sentiment analysis, suicide tendency detection, and big-five personality assessment. The results conclude that ChatGPT has indeed novel knowledge that can improve existing NLP techniques by way of fusion, be it early or late fusion.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 19 of its 39 references that are in the map. First posted on arXiv 6 Jul 2023.
Builds on
19 of 39 references.
References · 19
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
- 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
7 more
- 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 344
- 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 262
- 2021SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimizationcited by 229
- 2023ChatGPT: Jack of all trades, master of nonecited by 204
- 2023Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERTcited by 155
- 2023Will Affective Computing Emerge from Foundation Models and General AI? A First Evaluation on ChatGPTcited by 41
- 2023Translation and Fusion Improves Zero-shot Cross-lingual Information Extractioncited by 15
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 1.
6 papers.
- 2023A Wide Evaluation of ChatGPT on Affective Computing Taskscited by 30
- 2024XAI meets LLMs: A Survey of the Relation between Explainable AI and Large Language Modelscited by 23
- 2024On Prompt Sensitivity of ChatGPT in Affective Computingcited by 7
- 2025Can Large Language Models Generate Effective Datasets for Emotion Recognition in Conversations?cited by 2
- 2024Enhancing Personality Recognition in Dialogue by Data Augmentation and Heterogeneous Conversational Graph Networkscited by 0
- 2024Large language models for crowd decision making based on prompt design strategies using ChatGPT: models, analysis and challengescited by 0
- 2025Can Large Language Models Generate Effective Datasets for Emotion Recognition in Conversations?7 Aug 2025
- 2024XAI meets LLMs: A Survey of the Relation between Explainable AI and Large Language Models21 Jul 2024
- 2024Large language models for crowd decision making based on prompt design strategies using ChatGPT: models, analysis and challenges22 Mar 2024
- 2024On Prompt Sensitivity of ChatGPT in Affective Computing20 Mar 2024
- 2024Enhancing Personality Recognition in Dialogue by Data Augmentation and Heterogeneous Conversational Graph Networks11 Jan 2024
- 2023A Wide Evaluation of ChatGPT on Affective Computing Tasks26 Aug 2023