mlsanityData to 7 Oct 2026

Beyond Sentiment: Comparing Traditional NLP and LLM-Based Multi-Dimensional Analysis for Political News Evaluation

arXiv 2608.05155 ↗First posted 22 May 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Traditional sentiment analysis (SA) models, while effective for polarity classification, provide limited insight into the rhetorical, ideological, and framing dimensions of political discourse -- dimensions that are central to research in the social sciences and humanities (SSH). In this paper, we present a comparative study of RoBERTa-based sentiment analysis and an LLM-based multi-dimensional framing analysis platform applied to a corpus of 50 political news articles from 17 international media outlets. The results reveal a critical limitation we term neutral collapse: RoBERTa classifies 70% of articles as neutral, effectively flattening substantively rich political content into an analytically uninformative category. We find that 23% of neutral-classified articles exhibit negative probability scores above 0.30. By contrast, the LLM-based approach captures political bias direction and intensity, sensationalism, emotional appeal, and political framing -- yielding multi-dimensional analytical outputs aligned with SSH epistemologies. We argue that for political media analysis, traditional SA alone is insufficient, and that LLM-based multi-dimensional frameworks offer a more epistemologically adequate computational lens for SSH research needs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 23 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

8 of 23 references.

References · 8

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
  4. 2020TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classificationcited by 414
  5. 2023Can Large Language Models Transform Computational Social Science?cited by 245
  6. 2022TimeLMs: Diachronic Language Models from Twittercited by 129
  7. 2018Framing and Agenda-setting in Russian News: a Computational Analysis of Intricate Political Strategiescited by 47
  8. 2019Sentiment and position-taking analysis of parliamentary debates: A systematic literature reviewcited by 13

Built on by

Not cited yet.