mlsanityData to 14 Oct 2026

Left, Right, or Center? Evaluating LLM Framing in News Classification and Generation

arXiv 2601.05835 ↗First posted 9 Jan 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Large Language Model (LLM) based summarization and text generation are increasingly used for producing and rewriting text, raising concerns about political framing in journalism where subtle wording choices can shape interpretation. Across nine state-of-the-art LLMs, we study political framing by testing whether LLMs' classification-based bias signals align with framing behavior in their generated summaries. We first compare few-shot ideology predictions against LEFT/CENTER/RIGHT labels. We then generate "steered" summaries under FAITHFUL, CENTRIST, LEFT, and RIGHT prompts, and score all outputs using a single fixed ideology evaluator. We find pervasive ideological center-collapse in both article-level ratings and generated text, indicating a systematic tendency toward centrist framing. Among evaluated models, Grok 4 is by far the most ideologically expressive generator, while Claude Sonnet 4.5 and Llama 3.1 achieve the strongest bias-rating performance among commercial and open-weight models, respectively.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 23 references that are in the map. First posted on arXiv 9 Jan 2026.

Builds on

17 of 23 references.

References · 17

  1. 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 243
  2. 2020We Can Detect Your Bias: Predicting the Political Ideology of News Articlescited by 92
  3. 2024Measuring Political Bias in Large Language Models: What Is Said and How It Is Saidcited by 89
  4. 2019In Plain Sight: Media Bias Through the Lens of Factual Reportingcited by 68
  5. 2020Moral Framing and Ideological Bias of Newscited by 29
  6. 2018Multi-view Models for Political Ideology Detection of News Articlescited by 27
  7. 2024Evaluating the Prompt Steerability of Large Language Modelscited by 27
  8. 2025Understanding and Mitigating Overrefusal in LLMs from an Unveiling Perspective of Safety Decision Boundarycited by 18
  9. 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Biascited by 12
  10. 2024Is Safer Better? The Impact of Guardrails on the Argumentative Strength of LLMs in Hate Speech Counteringcited by 11
  11. 2024Quantifying Generative Media Bias with a Corpus of Real-world and Generated News Articlescited by 9
  12. 2025Analyzing Political Bias in LLMs via Target-Oriented Sentiment Classificationcited by 7
5 more
  1. 2024Decoding News Narratives: A Critical Analysis of Large Language Models in Framing Detectioncited by 6
  2. 2025Media Bias Detector: Designing and Implementing a Tool for Real-Time Selection and Framing Bias Analysis in News Coveragecited by 6
  3. 2023P^3SUM: Preserving Author's Perspective in News Summarization with Diffusion Language Modelscited by 4
  4. 2025Safety and Security Analysis of Large Language Models: Benchmarking Risk Profile and Harm Potentialcited by 3
  5. 2025Leveraging In-Context Learning for Political Bias Testing of LLMscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.