We Can Detect Your Bias: Predicting the Political Ideology of News Articles
Not on the map. Why?
Abstract (arXiv)
We explore the task of predicting the leading political ideology or bias of news articles. First, we collect and release a large dataset of 34,737 articles that were manually annotated for political ideology -left, center, or right-, which is well-balanced across both topics and media. We further use a challenging experimental setup where the test examples come from media that were not seen during training, which prevents the model from learning to detect the source of the target news article instead of predicting its political ideology. From a modeling perspective, we propose an adversarial media adaptation, as well as a specially adapted triplet loss. We further add background information about the source, and we show that it is quite helpful for improving article-level prediction. Our experimental results show very sizable improvements over using state-of-the-art pre-trained Transformers in this challenging setup.
Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 10; 2023: 19; 2024: 22; 2025: 25; 2026: 11.
92 papers.
Sort:
By area:
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2024Measuring Political Bias in Large Language Models: What Is Said and How It Is Saidcited by 89
- 2022POLITICS: Pretraining with Same-story Article Comparison for Ideology Prediction and Stance Detectioncited by 50
- 2024Can Unconfident LLM Annotations Be Used for Confident Conclusions?cited by 44
- 2023Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Modelscited by 37
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2021A Survey on Predicting the Factuality and the Bias of News Mediacited by 20
- 2022KCD: Knowledge Walks and Textual Cues Enhanced Political Perspective Detection in News Mediacited by 20
- 2021Interpretable Propaganda Detection in News Articlescited by 16
- 2024IndiVec: An Exploration of Leveraging Large Language Models for Media Bias Detection with Fine-Grained Bias Indicatorscited by 15
- 2021KGAP: Knowledge Graph Augmented Political Perspective Detection in News Mediacited by 14
- 2024Modelling Political Coalition Negotiations Using LLM-based Agentscited by 13
38 more
- 2021To Protect and To Serve? Analyzing Entity-Centric Framing of Police Violencecited by 12
- 2024Beyond Relevance: Evaluate and Improve Retrievers on Perspective Awarenesscited by 12
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Biascited by 11
- 2024SoMeLVLM: A Large Vision Language Model for Social Media Processingcited by 11
- 2024Generating Media Background Checks for Automated Source Critical Reasoningcited by 10
- 2025Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaningcited by 10
- 2023Multilingual Coarse Political Stance Classification of Media. The Editorial Line of a ChatGPT and Bard Newspapercited by 9
- 2023A Template Is All You Memecited by 9
- 2024Quantifying Generative Media Bias with a Corpus of Real-world and Generated News Articlescited by 9
- 2023Mixed Multi-Model Semantic Interaction for Graph-based Narrative Visualizationscited by 8
- 2023Identifying Conspiracy Theories News based on Event Relation Graphcited by 8
- 2025UniDetox: Universal Detoxification of Large Language Models via Dataset Distillationcited by 8
- 2026Evaluating Decision Models for Text Annotation in Computational Social Sciencecited by 8
- 2025Probably Approximately Correct Labelscited by 7
- 2025What Is The Political Content in LLMs' Pre- and Post-Training Data?cited by 7
- 2022Using Persuasive Writing Strategies to Explain and Detect Health Misinformationcited by 6
- 2023Predicting Sentence-Level Factuality of News and Bias of Media Outletscited by 6
- 2023Disentangling Structure and Style: Political Bias Detection in News by Inducing Document Hierarchycited by 6
- 2023Connecting the Dots in News Analysis: Bridging the Cross-Disciplinary Disparities in Media Bias and Framingcited by 6
- 2024Measuring and Addressing Indexical Bias in Information Retrievalcited by 6
- 2025Mitigating Bias in RAG: Controlling the Embeddercited by 6
- 2022Modeling Multi-level Context for Informational Bias Detection by Contrastive Learning and Sentential Graph Networkcited by 5
- 2022Identifying and Characterizing Active Citizens who Refute Misinformation in Social Mediacited by 5
- 2022PAR: Political Actor Representation Learning with Social Context and Expert Knowledgecited by 5
- 2023Discourse Structures Guided Fine-grained Propaganda Identificationcited by 5
- 2024EMONA: Event-level Moral Opinions in News Articlescited by 5
- 2025On Synthetic Data Strategies for Domain-Specific Generative Retrievalcited by 5
- 2025PRISM: A Framework for Producing Interpretable Political Bias Embeddings with Political-Aware Cross-Encodercited by 5
- 2025Framing Political Bias in Multilingual LLMs Across Pakistani Languagescited by 5
- 2025Read Between the Lines: A Benchmark for Uncovering Political Bias in Bangla News Articlescited by 5
- 2025Robust Sampling for Active Statistical Inferencecited by 5
- 2023"We Demand Justice!": Towards Social Context Grounding of Political Textscited by 4
- 2024Sentence-level Media Bias Analysis with Event Relation Graphcited by 3
- 2024Yesterday's News: Benchmarking Multi-Dimensional Out-of-Distribution Generalization of Misinformation Detection Modelscited by 3
- 2024A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Modelscited by 3
- 2025Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human Expertscited by 3
- 2025A Detailed Factor Analysis for the Political Compass Test: Navigating Ideologies of Large Language Modelscited by 3
- 2023All Things Considered: Detecting Partisan Events from News Media with Cross-Article Comparisoncited by 2
50 most cited of 92 All 92 (JSON)
- 2026Evaluating Decision Models for Text Annotation in Computational Social Science21 Sep 2026
- 2026Framing by Wording, Framing by Selection: A Large-Scale Two-Dimensional Audit of French News Headlines, 2022-202512 Aug 2026
- 2026Structuring the Space of Perspectives12 Aug 2026
- 2026Can temporal article-level credibility signals improve domain-level credibility prediction?6 Jul 2026
- 2026Does Topic Sentiment Cause Perceived Ideology? Comparing Human and LLM Annotations in Political News Articles4 Jun 2026
- 2026A Cognitively Grounded Bayesian Framework for Misinformation Susceptibility10 May 2026
- 2026The Proxy Presumption: From Semantic Embeddings to Valid Social Measures8 May 2026
- 2026A Multi-View Media Profiling Suite: Resources, Evaluation, and Analysis2 May 2026
- 2026When Bigger Isn't Better: A Comprehensive Fairness Evaluation of Political Bias in Multi-News Summarisation23 Apr 2026
- 2026A Community-Based Approach for Stance Distribution and Argument Organization18 Apr 2026
- 2026Left, Right, or Center? Evaluating LLM Framing in News Classification and Generation9 Jan 2026
- 2025A Multifaceted Analysis of Social Biases in Large Language Models16 Dec 2025
38 more
- 2025BAID: A Benchmark for Bias Assessment of AI Detectors12 Dec 2025
- 2025Robust Sampling for Active Statistical Inference12 Nov 2025
- 2025Quantifying Affective Bias in Low-Resource Media: Large-Scale Emotion Profiling of Bengali Headlines20 Oct 2025
- 2025Read Between the Lines: A Benchmark for Uncovering Political Bias in Bangla News Articles4 Oct 2025
- 2025What Is The Political Content in LLMs' Pre- and Post-Training Data?26 Sep 2025
- 2025Counterspeech for Mitigating the Influence of Media Bias: Comparing Human and LLM-Generated Responses20 Aug 2025
- 2025Political Leaning and Politicalness Classification of Texts18 Jul 2025
- 2025Journalism-Guided Agentic In-Context Learning for News Stance Detection15 Jul 2025
- 2025A Detailed Factor Analysis for the Political Compass Test: Navigating Ideologies of Large Language Models24 Jun 2025
- 2025Multi-document Summarization through Multi-document Event Relation Graph Reasoning in LLMs: a case study in Framing Bias Mitigation15 Jun 2025
- 2025Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human Experts14 Jun 2025
- 2025Probably Approximately Correct Labels12 Jun 2025
- 2025Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaning10 Jun 2025
- 2025PRISM: A Framework for Producing Interpretable Political Bias Embeddings with Political-Aware Cross-Encoder30 May 2025
- 2025Framing Political Bias in Multilingual LLMs Across Pakistani Languages29 May 2025
- 2025Towards Automated Situation Awareness: A RAG-Based Framework for Peacebuilding Reports14 May 2025
- 2025Unraveling Media Perspectives: A Comprehensive Methodology Combining Large Language Models, Topic Modeling, Sentiment Analysis, and Ontology Learning to Analyse Media Bias3 May 2025
- 2025UniDetox: Universal Detoxification of Large Language Models via Dataset Distillation29 Apr 2025
- 2025"Whose Side Are You On?" Estimating Ideology of Political and News Content Using Large Language Models and Few-shot Demonstration Selection23 Mar 2025
- 2025On Synthetic Data Strategies for Domain-Specific Generative Retrieval25 Feb 2025
- 2025Mitigating Bias in RAG: Controlling the Embedder24 Feb 2025
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checking13 Feb 2025
- 2025Decoding News Bias: Multi Bias Detection in News Articles5 Jan 2025
- 2025Tracing Partisan Bias to Its Emotional Fingerprints: A Computational Approach to Mitigation2 Jan 2025
- 2024Improved Models for Media Bias Detection and Subcategorization16 Dec 2024
- 2024Coverage-based Fairness in Multi-document Summarization11 Dec 2024
- 2024A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Models28 Oct 2024
- 2024Yesterday's News: Benchmarking Multi-Dimensional Out-of-Distribution Generalization of Misinformation Detection Models12 Oct 2024
- 2024Generating Media Background Checks for Automated Source Critical Reasoning1 Sep 2024
- 2024Can Unconfident LLM Annotations Be Used for Confident Conclusions?27 Aug 2024
- 2024Combining Objective and Subjective Perspectives for Political News Understanding20 Aug 2024
- 2024Prompt Selection Matters: Enhancing Text Annotations for Social Sciences with Large Language Models15 Jul 2024
- 2024Quantifying Generative Media Bias with a Corpus of Real-world and Generated News Articles16 Jun 2024
- 2024Measuring and Addressing Indexical Bias in Information Retrieval6 Jun 2024
- 2024Encoding Hierarchical Schema via Concept Flow for Multifaceted Ideology Detection29 May 2024
- 2024A Novel Method for News Article Event-Based Embedding20 May 2024
- 2024Beyond Relevance: Evaluate and Improve Retrievers on Perspective Awareness4 May 2024
- 2024Sentence-level Media Bias Analysis with Event Relation Graph2 Apr 2024
50 newest of 92 All 92 (JSON)
- 2023Can Large Language Models Transform Computational Social Science?cited by 245
- 2024Measuring Political Bias in Large Language Models: What Is Said and How It Is Saidcited by 89
- 2022POLITICS: Pretraining with Same-story Article Comparison for Ideology Prediction and Stance Detectioncited by 50
- 2024Can Unconfident LLM Annotations Be Used for Confident Conclusions?cited by 44
- 2023Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Modelscited by 37
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2021A Survey on Predicting the Factuality and the Bias of News Mediacited by 20
- 2022KCD: Knowledge Walks and Textual Cues Enhanced Political Perspective Detection in News Mediacited by 20
- 2021Interpretable Propaganda Detection in News Articlescited by 16
- 2024IndiVec: An Exploration of Leveraging Large Language Models for Media Bias Detection with Fine-Grained Bias Indicatorscited by 15
- 2021KGAP: Knowledge Graph Augmented Political Perspective Detection in News Mediacited by 14
- 2021To Protect and To Serve? Analyzing Entity-Centric Framing of Police Violencecited by 12
12 most cited of 86 All 86 (JSON)
- 2026Evaluating Decision Models for Text Annotation in Computational Social Science21 Sep 2026
- 2026Framing by Wording, Framing by Selection: A Large-Scale Two-Dimensional Audit of French News Headlines, 2022-202512 Aug 2026
- 2026Structuring the Space of Perspectives12 Aug 2026
- 2026Can temporal article-level credibility signals improve domain-level credibility prediction?6 Jul 2026
- 2026Does Topic Sentiment Cause Perceived Ideology? Comparing Human and LLM Annotations in Political News Articles4 Jun 2026
- 2026A Cognitively Grounded Bayesian Framework for Misinformation Susceptibility10 May 2026
- 2026The Proxy Presumption: From Semantic Embeddings to Valid Social Measures8 May 2026
- 2026A Multi-View Media Profiling Suite: Resources, Evaluation, and Analysis2 May 2026
- 2026When Bigger Isn't Better: A Comprehensive Fairness Evaluation of Political Bias in Multi-News Summarisation23 Apr 2026
- 2026A Community-Based Approach for Stance Distribution and Argument Organization18 Apr 2026
- 2026Left, Right, or Center? Evaluating LLM Framing in News Classification and Generation9 Jan 2026
- 2025A Multifaceted Analysis of Social Biases in Large Language Models16 Dec 2025
12 newest of 86 All 86 (JSON)