A Survey on Predicting the Factuality and the Bias of News Media
Not on the map. Why?
Abstract (arXiv)
The present level of proliferation of fake, biased, and propagandistic content online has made it impossible to fact-check every single suspicious claim or article, either manually or automatically. Thus, many researchers are shifting their attention to higher granularity, aiming to profile entire news outlets, which makes it possible to detect likely "fake news" the moment it is published, by simply checking the reliability of its source. Source factuality is also an important element of systems for automatic fact-checking and "fake news" detection, as they need to assess the reliability of the evidence they retrieve online. Political bias detection, which in the Western political landscape is about predicting left-center-right bias, is an equally important topic, which has experienced a similar shift towards profiling entire news outlets. Moreover, there is a clear connection between the two, as highly biased media are less likely to be factual; yet, the two problems have been addressed separately. In this survey, we review the state of the art on media profiling for factuality and bias, arguing for the need to model them jointly. We further discuss interesting recent advances in using different information sources and modalities, which go beyond the text of the articles the target news outlet has published. Finally, we discuss current challenges and outline future research directions.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 33 of its 105 references that are in the map. First posted on arXiv 16 Mar 2021.
Builds on
33 of 105 references.
References · 33
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2017Fake News Detection on Social Media: A Data Mining Perspectivecited by 334
- 2020Media Forensics and DeepFakes: an overviewcited by 208
- 2018Fighting Fake News: Image Splice Detection via Learned Self-Consistencycited by 136
- 2020FANG: Leveraging Social Context for Fake News Detection Using Graph Representationcited by 98
- 2018Automated Fact Checking: Task formulations, methods and future directionscited by 96
- 2020We Can Detect Your Bias: Predicting the Political Ideology of News Articlescited by 92
- 2020Explainable Automated Fact-Checking: A Surveycited by 83
- 2018Predicting Factuality of Reporting and Bias of News Media Sourcescited by 71
- 2020A Survey on Computational Propaganda Detectioncited by 69
- 2017This Just In: Fake News Packs a Lot in Title, Uses Simpler, Repetitive Content in Text Body, More Similar to Satire than Real Newscited by 59
21 more
- 2018All-in-one: Multi-task Learning for Rumour Verificationcited by 54
- 2019Fact-Checking Meets Fauxtography: Verifying Claims About Imagescited by 52
- 2019Exploiting Multi-domain Visual Information for Fake News Detectioncited by 48
- 2018Framing and Agenda-setting in Russian News: a Computational Analysis of Intricate Political Strategiescited by 47
- 2019Unsupervised User Stance Detection on Twittercited by 45
- 2020What Was Written vs. Who Read It: News Media Profiling Using Text Analysis and Social Media Contextcited by 42
- 2017Fully Automated Fact Checking Using External Sourcescited by 27
- 2019Multi-Task Ordinal Regression for Jointly Predicting the Trustworthiness and the Leading Political Ideology of News Mediacited by 26
- 2020A Systematic Media Frame Analysis of 1.5 Million New York Times Articles from 2000 to 2017cited by 23
- 2018Sampling the News Producers: A Large News and Feature Data Set for the Study of the Complex Media Landscapecited by 20
- 2019A Topic-Agnostic Approach for Identifying Fake News Pagescited by 17
- 2019Tanbih: Get To Know What You Are Readingcited by 16
- 2013A Bayesian approach for predicting the popularity of tweetscited by 12
- 2017People on Media: Jointly Identifying Credible News and Trustworthy Citizen Journalists in Online Communitiescited by 10
- 2018Fact Checking in Community Forumscited by 10
- 2017Seminar Users in the Arabic Twitter Spherecited by 5
- 2021Efficient video integrity analysis through container characterizationcited by 5
- 2018Camera-based Image Forgery Localization using Convolutional Neural Networkscited by 4
- 2016Two Tales of the World: Comparison of Widely Used World News Datasets GDELT and EventRegistrycited by 3
- 2018What We Read, What We Search: Media Attention and Public Attention Among 193 Countriescited by 1
- 2020How-to Present News on Social Media: A Causal Analysis of Editing News Headlines for Boosting User Engagementcited by 1
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 3; 2024: 3; 2025: 3; 2026: 6.
20 papers.
Sort:
By area:
- 2023Factuality Challenges in the Era of Large Language Modelscited by 125
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 63
- 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
- 2021Findings of the NLP4IF-2021 Shared Tasks on Fighting the COVID-19 Infodemic and Censorship Detectioncited by 14
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Biascited by 11
- 2023QCRI at SemEval-2023 Task 3: News Genre, Framing and Persuasion Techniques Detection using Multilingual Modelscited by 5
- 2021WhatTheWikiFact: Fact-Checking Claims Against Wikipediacited by 3
- 2024Yesterday's News: Benchmarking Multi-Dimensional Out-of-Distribution Generalization of Misinformation Detection Modelscited by 3
- 2025Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human Expertscited by 3
- 2026MALicious INTent Dataset and Inoculating LLMs for Enhanced Disinformation Detectioncited by 3
- 2022Detecting the Role of an Entity in Harmful Memes: Techniques and Their Limitationscited by 2
- 2024MGM: Global Understanding of Audience Overlap Graphs for Predicting the Factuality and the Bias of News Mediacited by 2
8 more
- 2025The Psychology of Falsehood: A Human-Centric Survey of Misinformation Detectioncited by 1
- 2021No News is Good News: A Critique of the One Billion Word Benchmarkcited by 0
- 2025From Veracity to Diffusion: Adressing Operational Challenges in Moving From Fake-News Detection to Information Disorderscited by 0
- 2026The Tag is the Signal: URL-Agnostic Credibility Scoring for Messages on Telegramcited by 0
- 2026AuthorityBench: Benchmarking LLM Authority Perception for Reliable Retrieval-Augmented Generationcited by 0
- 2026A Multi-View Media Profiling Suite: Resources, Evaluation, and Analysiscited by 0
- 2026MEDIAREF: A Public Knowledge Store for Media Background Checkscited by 0
- 2026From Articles to Publishers: Aggregating Language Model Predictions for News Source Reliability Inferencecited by 0
- 2026From Articles to Publishers: Aggregating Language Model Predictions for News Source Reliability Inference21 Sep 2026
- 2026MEDIAREF: A Public Knowledge Store for Media Background Checks2 Jul 2026
- 2026A Multi-View Media Profiling Suite: Resources, Evaluation, and Analysis2 May 2026
- 2026AuthorityBench: Benchmarking LLM Authority Perception for Reliable Retrieval-Augmented Generation26 Mar 2026
- 2026MALicious INTent Dataset and Inoculating LLMs for Enhanced Disinformation Detection15 Mar 2026
- 2026The Tag is the Signal: URL-Agnostic Credibility Scoring for Messages on Telegram19 Jan 2026
- 2025From Veracity to Diffusion: Adressing Operational Challenges in Moving From Fake-News Detection to Information Disorders2 Dec 2025
- 2025The Psychology of Falsehood: A Human-Centric Survey of Misinformation Detection19 Sep 2025
- 2025Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human Experts14 Jun 2025
- 2024MGM: Global Understanding of Audience Overlap Graphs for Predicting the Factuality and the Bias of News Media12 Dec 2024
- 2024Yesterday's News: Benchmarking Multi-Dimensional Out-of-Distribution Generalization of Misinformation Detection Models12 Oct 2024
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems11 Jan 2024
8 more
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Bias26 Dec 2023
- 2023Factuality Challenges in the Era of Large Language Models8 Oct 2023
- 2023QCRI at SemEval-2023 Task 3: News Genre, Framing and Persuasion Techniques Detection using Multilingual Models5 May 2023
- 2022Detecting the Role of an Entity in Harmful Memes: Techniques and Their Limitations9 May 2022
- 2022Detecting and Understanding Harmful Memes: A Survey9 May 2022
- 2021No News is Good News: A Critique of the One Billion Word Benchmark25 Oct 2021
- 2021Findings of the NLP4IF-2021 Shared Tasks on Fighting the COVID-19 Infodemic and Censorship Detection23 Sep 2021
- 2021WhatTheWikiFact: Fact-Checking Claims Against Wikipedia16 Apr 2021
- 2023Factuality Challenges in the Era of Large Language Modelscited by 125
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systemscited by 63
- 2022Detecting and Understanding Harmful Memes: A Surveycited by 58
- 2021Findings of the NLP4IF-2021 Shared Tasks on Fighting the COVID-19 Infodemic and Censorship Detectioncited by 14
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Biascited by 11
- 2023QCRI at SemEval-2023 Task 3: News Genre, Framing and Persuasion Techniques Detection using Multilingual Modelscited by 5
- 2021WhatTheWikiFact: Fact-Checking Claims Against Wikipediacited by 3
- 2024Yesterday's News: Benchmarking Multi-Dimensional Out-of-Distribution Generalization of Misinformation Detection Modelscited by 3
- 2025Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human Expertscited by 3
- 2026MALicious INTent Dataset and Inoculating LLMs for Enhanced Disinformation Detectioncited by 3
- 2022Detecting the Role of an Entity in Harmful Memes: Techniques and Their Limitationscited by 2
- 2024MGM: Global Understanding of Audience Overlap Graphs for Predicting the Factuality and the Bias of News Mediacited by 2
12 most cited of 18 All 18 (JSON)
- 2026From Articles to Publishers: Aggregating Language Model Predictions for News Source Reliability Inference21 Sep 2026
- 2026A Multi-View Media Profiling Suite: Resources, Evaluation, and Analysis2 May 2026
- 2026MALicious INTent Dataset and Inoculating LLMs for Enhanced Disinformation Detection15 Mar 2026
- 2026The Tag is the Signal: URL-Agnostic Credibility Scoring for Messages on Telegram19 Jan 2026
- 2025From Veracity to Diffusion: Adressing Operational Challenges in Moving From Fake-News Detection to Information Disorders2 Dec 2025
- 2025The Psychology of Falsehood: A Human-Centric Survey of Misinformation Detection19 Sep 2025
- 2025Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human Experts14 Jun 2025
- 2024MGM: Global Understanding of Audience Overlap Graphs for Predicting the Factuality and the Bias of News Media12 Dec 2024
- 2024Yesterday's News: Benchmarking Multi-Dimensional Out-of-Distribution Generalization of Misinformation Detection Models12 Oct 2024
- 2024Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems11 Jan 2024
- 2023The Media Bias Taxonomy: A Systematic Literature Review on the Forms and Automated Detection of Media Bias26 Dec 2023
- 2023Factuality Challenges in the Era of Large Language Models8 Oct 2023
12 newest of 18 All 18 (JSON)