Demystifying ChatGPT: How It Masters Genre Recognition
Not on the map. Why?
Abstract (arXiv)
The introduction of ChatGPT has garnered significant attention within the NLP community and beyond. Previous studies have demonstrated ChatGPT's substantial advancements across various downstream NLP tasks, highlighting its adaptability and potential to revolutionize language-related applications. However, its capabilities and limitations in genre prediction remain unclear. This work analyzes three Large Language Models (LLMs) using the MovieLens-100K dataset to assess their genre prediction capabilities. Our findings show that ChatGPT, without fine-tuning, outperformed other LLMs, and fine-tuned ChatGPT performed best overall. We set up zero-shot and few-shot prompts using audio transcripts/subtitles from movie trailers in the MovieLens-100K dataset, covering 1682 movies of 18 genres, where each movie can have multiple genres. Additionally, we extended our study by extracting IMDb movie posters to utilize a Vision Language Model (VLM) with prompts for poster information. This fine-grained information was used to enhance existing LLM prompts. In conclusion, our study reveals ChatGPT's remarkable genre prediction capabilities, surpassing other language models. The integration of VLM further enhances our findings, showcasing ChatGPT's potential for content-related applications by incorporating visual information from movie posters.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 41 references that are in the map. First posted on arXiv 5 Jul 2025.
Builds on
21 of 41 references.
References · 21
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Visual Instruction Tuningcited by 7,869
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
- 2023Large Language Models for Information Retrieval: A Surveycited by 331
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 251
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 129
- 2021How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVENcited by 124
9 more
- 2023Document-Level Machine Translation with Large Language Modelscited by 90
- 2023Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language Modelscited by 68
- 2023Adaptive Machine Translation with Large Language Modelscited by 58
- 2023Instruct-FinGPT: Financial Sentiment Analysis by Instruction Tuning of General-Purpose Large Language Modelscited by 58
- 2022Multitask Vision-Language Prompt Tuningcited by 51
- 2024Prompting Large Vision-Language Models for Compositional Reasoningcited by 6
- 20211D CNN Architectures for Music Genre Classificationcited by 5
- 2022Personalized Prompt for Sequential Recommendationcited by 4
- 2023Demystifying Visual Features of Movie Posters for Multi-Label Genre Identificationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets
- 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models
- 2025Comparative Evaluation of ChatGPT and DeepSeek Across Key NLP Tasks: Strengths, Weaknesses, and Domain-Specific Performance
- 2025Beyond Tokens in Language Models: Interpreting Activations through Text Genre Chunks
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity
- 2023Pushing the Limits of ChatGPT on NLP Tasks
- 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Study
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?