To Bias or Not to Bias: Detecting bias in News with bias-detector
Not on the map. Why?
Abstract (arXiv)
Media bias detection is a critical task in ensuring fair and balanced information dissemination, yet it remains challenging due to the subjectivity of bias and the scarcity of high-quality annotated data. In this work, we perform sentence-level bias classification by fine-tuning a RoBERTa-based model on the expert-annotated BABE dataset. Using McNemar's test and the 5x2 cross-validation paired t-test, we show statistically significant improvements in performance when comparing our model to a domain-adaptively pre-trained DA-RoBERTa baseline. Furthermore, attention-based analysis shows that our model avoids common pitfalls like oversensitivity to politically charged terms and instead attends more meaningfully to contextually relevant tokens. For a comprehensive examination of media bias, we present a pipeline that combines our model with an already-existing bias-type classifier. Our method exhibits good generalization and interpretability, despite being constrained by sentence-level analysis and dataset size because of a lack of larger and more advanced bias corpora. We talk about context-aware modeling, bias neutralization, and advanced bias type classification as potential future directions. Our findings contribute to building more robust, explainable, and socially responsible NLP systems for media bias detection.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 9 of its 20 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
9 of 20 references.
References · 9
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2019Automatically Neutralizing Subjective Bias in Textcited by 105
- 2022Neural Media Bias Detection Using Distant Supervision With BABE -- Bias Annotations By Expertscited by 56
- 2021MBIC -- A Media Bias Annotation Dataset Including Annotator Characteristicscited by 24
- 2022A Domain-adaptive Pre-training Approach for Language Bias Detection in Newscited by 16
- 2021Enabling News Consumers to View and Understand Biased News Coverage: A Study on the Perception and Visualization of Media Biascited by 14
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026LLM BiasScope: A Real-Time Bias Analysis Platform for Comparative LLM Evaluationcited by 1
- 2025Explaining News Bias Detection: A Comparative SHAP Analysis of Transformer Model Decision Mechanismscited by 0
- 2026Does Welsh media need a review? Detecting bias in Nation.Cymru's political reportingcited by 0
- 2026HierBias: Context-Conditioned Hierarchical Media Bias Detection with Multi-Task Type Classificationcited by 0
- 2026AutoJourn: Multi-Perspective Summarisation, Bias Detection and Bias Neutralisation for LLM-Generated News in Automated Journalismcited by 0
- 2026AutoJourn: Multi-Perspective Summarisation, Bias Detection and Bias Neutralisation for LLM-Generated News in Automated Journalism21 Jul 2026
- 2026HierBias: Context-Conditioned Hierarchical Media Bias Detection with Multi-Task Type Classification29 Apr 2026
- 2026Does Welsh media need a review? Detecting bias in Nation.Cymru's political reporting19 Apr 2026
- 2026LLM BiasScope: A Real-Time Bias Analysis Platform for Comparative LLM Evaluation12 Mar 2026
- 2025Explaining News Bias Detection: A Comparative SHAP Analysis of Transformer Model Decision Mechanisms29 Dec 2025