Exploiting Transformer-based Multitask Learning for the Detection of Media Bias in News Articles
Not on the map. Why?
Abstract (arXiv)
Media has a substantial impact on the public perception of events. A one-sided or polarizing perspective on any topic is usually described as media bias. One of the ways how bias in news articles can be introduced is by altering word choice. Biased word choices are not always obvious, nor do they exhibit high context-dependency. Hence, detecting bias is often difficult. We propose a Transformer-based deep learning architecture trained via Multi-Task Learning using six bias-related data sets to tackle the media bias detection problem. Our best-performing implementation achieves a macro F1 of 0.776, a performance boost of 3% compared to our baseline, outperforming existing methods. Our results indicate Multi-Task Learning as a promising alternative to improve existing baseline models in identifying slanted reporting.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 25 of its 46 references that are in the map. First posted on arXiv 7 Nov 2022.
Builds on
25 of 46 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
- 2019How to Fine-Tune BERT for Text Classification?cited by 409
- 2019Multi-Task Deep Neural Networks for Natural Language Understandingcited by 349
- 2019ERNIE 2.0: A Continual Pre-training Framework for Language Understandingcited by 230
13 more
- 2019Automatically Neutralizing Subjective Bias in Textcited by 105
- 2019In Plain Sight: Media Bias Through the Lens of Factual Reportingcited by 68
- 2022Neural Media Bias Detection Using Distant Supervision With BABE -- Bias Annotations By Expertscited by 54
- 2020Analyzing Political Bias and Unfairness in News Articles at Different Levels of Granularitycited by 32
- 2021MBIC -- A Media Bias Annotation Dataset Including Annotator Characteristicscited by 24
- 2018Neural Based Statement Classification for Biased Languagecited by 17
- 2021Enabling News Consumers to View and Understand Biased News Coverage: A Study on the Perception and Visualization of Media Biascited by 14
- 2021Do You Think It's Biased? How To Ask For The Perception Of Media Biascited by 12
- 2021Towards A Reliable Ground-Truth For Biased Language Detectioncited by 10
- 2021Us vs. Them: A Dataset of Populist Attitudes, News Bias and Emotionscited by 9
- 2021Identification of Biased Terms in News Articles by Comparison of Outlet-specific Word Embeddingscited by 9
- 2021An Interdisciplinary Approach for the Automated Detection and Visualization of Media Bias in News Articlescited by 6
- 2021TASSY -- A Text Annotation Survey Systemcited by 5
Built on by
Citing papers per year: 2023: 3; 2024: 6; 2025: 2.
11 papers.
- 2023Introducing MBIB -- the first Media Bias Identification Benchmark Task and Dataset Collectioncited by 17
- 2024The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias Detectioncited by 14
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Biascited by 11
- 2023Same Same, But Different: Conditional Multi-Task Learning for Demographic-Specific Toxicity Detectioncited by 10
- 2025medDreamer: Model-Based Reinforcement Learning with Latent Imagination on Complex EHRs for Clinical Decision Supportcited by 8
- 2024Large Language Models' Detection of Political Orientation in Newspaperscited by 5
- 2024MAGPIE: Multi-Task Media-Bias Analysis Generalization for Pre-Trained Identification of Expressionscited by 4
- 2025Neutralizing the Narrative: AI-Powered Debiasing of Online News Articlescited by 4
- 2024ChatGPT v.s. Media Bias: A Comparative Study of GPT-3.5 and Fine-tuned Language Modelscited by 2
- 2024DocNet: Semantic Structure in Inductive Bias Detection Modelscited by 0
- 2024Intertwined Biases Across Social Media Spheres: Unpacking Correlations in Media Bias Dimensionscited by 0
- 2025medDreamer: Model-Based Reinforcement Learning with Latent Imagination on Complex EHRs for Clinical Decision Support26 May 2025
- 2025Neutralizing the Narrative: AI-Powered Debiasing of Online News Articles4 Apr 2025
- 2024The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias Detection17 Nov 2024
- 2024Intertwined Biases Across Social Media Spheres: Unpacking Correlations in Media Bias Dimensions27 Aug 2024
- 2024DocNet: Semantic Structure in Inductive Bias Detection Models16 Jun 2024
- 2024Large Language Models' Detection of Political Orientation in Newspapers23 May 2024
- 2024ChatGPT v.s. Media Bias: A Comparative Study of GPT-3.5 and Fine-tuned Language Models29 Mar 2024
- 2024MAGPIE: Multi-Task Media-Bias Analysis Generalization for Pre-Trained Identification of Expressions27 Feb 2024
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Bias26 Dec 2023
- 2023Introducing MBIB -- the first Media Bias Identification Benchmark Task and Dataset Collection25 Apr 2023
- 2023Same Same, But Different: Conditional Multi-Task Learning for Demographic-Specific Toxicity Detection14 Feb 2023