mlsanityData to 7 Oct 2026

A Domain-adaptive Pre-training Approach for Language Bias Detection in News

arXiv 2205.10773 ↗First posted 22 May 2022cs.CL cs.LGcited by 16

Not on the map. Why?

Abstract (arXiv)

Media bias is a multi-faceted construct influencing individual behavior and collective decision-making. Slanted news reporting is the result of one-sided and polarized writing which can occur in various forms. In this work, we focus on an important form of media bias, i.e. bias by word choice. Detecting biased word choices is a challenging task due to its linguistic complexity and the lack of representative gold-standard corpora. We present DA-RoBERTa, a new state-of-the-art transformer-based model adapted to the media bias domain which identifies sentence-level bias with an F1 score of 0.814. In addition, we also train, DA-BERT and DA-BART, two more transformer models adapted to the bias domain. Our proposed domain-adapted models outperform prior bias detection approaches on the same data.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 32 of its 58 references that are in the map. First posted on arXiv 22 May 2022.

Builds on

32 of 58 references.

References · 32

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  7. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  8. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  9. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
  10. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  11. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
  12. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
20 more
  1. 2019How to Fine-Tune BERT for Text Classification?cited by 409
  2. 2021ExT5: Towards Extreme Multi-Task Scaling for Transfer Learningcited by 161
  3. 2019Automatically Neutralizing Subjective Bias in Textcited by 105
  4. 2021Multi-Task Learning in Natural Language Processing: An Overviewcited by 61
  5. 2020Multi-task learning for natural language processing in the 2020s: where are we going?cited by 27
  6. 2021MBIC -- A Media Bias Annotation Dataset Including Annotator Characteristicscited by 24
  7. 2020Aspect-based Document Similarity for Research Paperscited by 21
  8. 2021Are Neural Language Models Good Plagiarists? A Benchmark for Neural Paraphrase Detectioncited by 17
  9. 2021Identifying Machine-Paraphrased Plagiarismcited by 16
  10. 2021Enabling News Consumers to View and Understand Biased News Coverage: A Study on the Perception and Visualization of Media Biascited by 14
  11. 2021Do You Think It's Biased? How To Ask For The Perception Of Media Biascited by 12
  12. 2022Specialized Document Embeddings for Aspect-based Similarity of Research Paperscited by 12
  13. 2021Testing the Generalization of Neural Language Models for COVID-19 Misinformation Detectioncited by 10
  14. 2021Towards A Reliable Ground-Truth For Biased Language Detectioncited by 10
  15. 2021Identification of Biased Terms in News Articles by Comparison of Outlet-specific Word Embeddingscited by 9
  16. 2021Transforming Fake News: Robust Generalisable News Classification Using Transformerscited by 8
  17. 2020Pairwise Multi-Class Document Classification for Semantic Relations between Wikipedia Articlescited by 7
  18. 2021Incorporating Word Sense Disambiguation in Neural Language Modelscited by 6
  19. 2021An Interdisciplinary Approach for the Automated Detection and Visualization of Media Bias in News Articlescited by 6
  20. 2021TASSY -- A Text Annotation Survey Systemcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 3; 2024: 4; 2025: 3; 2026: 4.

16 papers.

Sort:

By area:

  1. 2022CySecBERT: A Domain-Adapted Language Model for the Cybersecurity Domaincited by 31
  2. 2023Introducing MBIB -- the first Media Bias Identification Benchmark Task and Dataset Collectioncited by 17
  3. 2024The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias Detectioncited by 14
  4. 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Biascited by 11
  5. 2025To Bias or Not to Bias: Detecting bias in News with bias-detectorcited by 5
  6. 2024MAGPIE: Multi-Task Media-Bias Analysis Generalization for Pre-Trained Identification of Expressionscited by 4
  7. 2024Automatically Generating Numerous Context-Driven SFT Data for LLMs across Diverse Granularitycited by 4
  8. 2023Data-Augmented and Retrieval-Augmented Context Enrichment in Chinese Media Bias Detectioncited by 2
  9. 2022A Commonsense-Infused Language-Agnostic Learning Framework for Enhancing Prediction of Political Polarity in Multilingual News Headlinescited by 1
  10. 2025Decoding News Bias: Multi Bias Detection in News Articlescited by 1
  11. 2026LLM BiasScope: A Real-Time Bias Analysis Platform for Comparative LLM Evaluationcited by 1
  12. 2026Reliable News or Propagandist News? A Neurosymbolic Model Using Genre, Topic, and Persuasion Techniques to Improve Robustness in Classificationcited by 1
4 more
  1. 2024DocNet: Semantic Structure in Inductive Bias Detection Modelscited by 0
  2. 2025Explaining News Bias Detection: A Comparative SHAP Analysis of Transformer Model Decision Mechanismscited by 0
  3. 2026HierBias: Context-Conditioned Hierarchical Media Bias Detection with Multi-Task Type Classificationcited by 0
  4. 2026AutoJourn: Multi-Perspective Summarisation, Bias Detection and Bias Neutralisation for LLM-Generated News in Automated Journalismcited by 0