LLM for Comparative Narrative Analysis
Not on the map. Why?
Abstract (arXiv)
In this paper, we conducted a Multi-Perspective Comparative Narrative Analysis (CNA) on three prominent LLMs: GPT-3.5, PaLM2, and Llama2. We applied identical prompts and evaluated their outputs on specific tasks, ensuring an equitable and unbiased comparison between various LLMs. Our study revealed that the three LLMs generated divergent responses to the same prompt, indicating notable discrepancies in their ability to comprehend and analyze the given task. Human evaluation was used as the gold standard, evaluating four perspectives to analyze differences in LLM performance.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 12 of its 27 references that are in the map. First posted on arXiv 11 Apr 2025.
Builds on
12 of 27 references.
References · 12
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,054
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
- 2022Text and Patterns: For Effective Chain of Thought, It Takes Two to Tangocited by 128
- 2023TELeR: A General Taxonomy of LLM Prompts for Benchmarking Complex Taskscited by 48
- 2023Exploring Natural Language Processing Methods for Interactive Behaviour Modellingcited by 2
- 2024Benchmarking LLMs on the Semantic Overlap Summarization Taskcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.