# FACTOID: A New Dataset for Identifying Misinformation Spreaders and Political Bias

arXiv: https://arxiv.org/abs/2205.06181 · HTML: https://mlsanity.com/paper/2205.06181/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 11 May 2022.

## Built on by (most cited first, 10 of 10)

- [A Survey on Mechanistic Interpretability for Multi-Modal Foundation Models](https://mlsanity.com/paper/2502.17516/) (2025)
- [Unifying Data Perspectivism and Personalization: An Application to Social Norms](https://mlsanity.com/paper/2210.14531/) (2022)
- [Exploring news intent and its application: A theory-driven approach](https://mlsanity.com/paper/2312.16490/) (2023)
- [Towards Fair Graph Anomaly Detection: Problem, Benchmark Datasets, and Evaluation](https://mlsanity.com/paper/2402.15988/) (2024)
- [MisinfoEval: Generative AI in the Era of "Alternative Facts"](https://mlsanity.com/paper/2410.09949/) (2024)
- [An Interactive Framework for Profiling News Media Sources](https://mlsanity.com/paper/2309.07384/) (2023)
- [Toxicity in Online Platforms and AI Systems: A Survey of Needs, Challenges, Mitigations, and Future Directions](https://mlsanity.com/paper/2509.25539/) (2025)
- [News Source Credibility Assessment: A Reddit Case Study](https://mlsanity.com/paper/2402.10938/) (2024)
- [SpatialJB: How Text Distribution Art Becomes the "Jailbreak Key" for LLM Guardrails](https://mlsanity.com/paper/2601.09321/) (2026)
- [Clustering Document Parts: Detecting and Characterizing Influence Campaigns from Documents](https://mlsanity.com/paper/2402.17151/) (2024)

## Abstract (arXiv)

Proactively identifying misinformation spreaders is an important step towards mitigating the impact of fake news on our society. In this paper, we introduce a new contemporary Reddit dataset for fake news spreader analysis, called FACTOID, monitoring political discussions on Reddit since the beginning of 2020. The dataset contains over 4K users with 3.4M Reddit posts, and includes, beyond the users' binary labels, also their fine-grained credibility level (very low to very high) and their political bias strength (extreme right to extreme left). As far as we are aware, this is the first fake news spreader dataset that simultaneously captures both the long-term context of users' historical posts and the interactions between them. To create the first benchmark on our data, we provide methods for identifying misinformation spreaders by utilizing the social connections between the users along with their psycho-linguistic features. We show that the users' social interactions can, on their own, indicate misinformation spreading, while the psycho-linguistic features are mostly informative in non-neural classification settings. In a qualitative analysis, we observe that detecting affective mental processes correlates negatively with right-biased users, and that the openness to experience factor is lower for those who spread fake news.