# AraStance: A Multi-Country and Multi-Domain Dataset of Arabic Stance Detection for Fact Checking

arXiv: https://arxiv.org/abs/2104.13559 · HTML: https://mlsanity.com/paper/2104.13559/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- Builds on 16 of its 35 references that are in the map.
- First posted on arXiv 28 Apr 2021.

## Builds on (most cited first, 16 of 16)

- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [Automatic Detection of Machine Generated Text: A Critical Survey](https://mlsanity.com/paper/2011.01314/) (2020)
- [ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic](https://mlsanity.com/paper/2101.01785/) (2020)
- [The Fact Extraction and VERification (FEVER) Shared Task](https://mlsanity.com/paper/1811.10971/) (2018)
- [KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social Media](https://mlsanity.com/paper/2007.13184/) (2020)
- [SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumours](https://mlsanity.com/paper/1704.05972/) (2017)
- [RumourEval 2019: Determining Rumour Veracity and Support for Rumours](https://mlsanity.com/paper/1809.06683/) (2018)
- [A Survey on Stance Detection for Mis- and Disinformation Identification](https://mlsanity.com/paper/2103.00242/) (2021)
- [A Retrospective Analysis of the Fake News Challenge Stance Detection Task](https://mlsanity.com/paper/1806.05180/) (2018)
- [Integrating Stance Detection and Fact Checking in a Unified Corpus](https://mlsanity.com/paper/1804.08012/) (2018)
- [Stance Detection Benchmark: How Robust Is Your Stance Detection?](https://mlsanity.com/paper/2001.01565/) (2020)
- [Cross-Domain Label-Adaptive Stance Detection](https://mlsanity.com/paper/2104.07467/) (2021)
- [Stance Prediction and Claim Verification: An Arabic Perspective](https://mlsanity.com/paper/2005.10410/) (2020)
- [Contrastive Language Adaptation for Cross-Lingual Stance Detection](https://mlsanity.com/paper/1910.02076/) (2019)
- [Machine Generation and Detection of Arabic Manipulated and Fake News](https://mlsanity.com/paper/2011.03092/) (2020)
- [Automatic Stance Detection Using End-to-End Memory Networks](https://mlsanity.com/paper/1804.07581/) (2018)

## Built on by (most cited first, 8 of 8)

- [Few-Shot Cross-Lingual Stance Detection with Sentiment-Based Pre-Training](https://mlsanity.com/paper/2109.06050/) (2021)
- [Large Language Models Meet Stance Detection: A Survey of Tasks, Methods, Applications, Challenges and Future Directions](https://mlsanity.com/paper/2505.08464/) (2025)
- [ClaimDiff: Comparing and Contrasting Claims on Contentious Issues](https://mlsanity.com/paper/2205.12221/) (2022)
- [Enabling Contextual Soft Moderation on Social Media through Contrastive Textual Deviation](https://mlsanity.com/paper/2407.20910/) (2024)
- [Mawqif-XT: An Arabic Benchmark Dataset for Cross-Target Stance Detection](https://mlsanity.com/paper/2608.09539/) (2026)
- [Detecting Stance of Authorities towards Rumors in Arabic Tweets: A Preliminary Study](https://mlsanity.com/paper/2301.05863/) (2023)
- [UstanceBR: a social media language resource for stance prediction](https://mlsanity.com/paper/2312.06374/) (2023)
- [ARAFA: An LLM-Generated Arabic Fact-Checking Dataset](https://mlsanity.com/paper/2609.25833/) (2026)

## Abstract (arXiv)

With the continuing spread of misinformation and disinformation online, it is of increasing importance to develop combating mechanisms at scale in the form of automated systems that support multiple languages. One task of interest is claim veracity prediction, which can be addressed using stance detection with respect to relevant documents retrieved online. To this end, we present our new Arabic Stance Detection dataset (AraStance) of 4,063 claim--article pairs from a diverse set of sources comprising three fact-checking websites and one news website. AraStance covers false and true claims from multiple domains (e.g., politics, sports, health) and several Arab countries, and it is well-balanced between related and unrelated documents with respect to the claims. We benchmark AraStance, along with two other stance detection datasets, using a number of BERT-based models. Our best model achieves an accuracy of 85% and a macro F1 score of 78%, which leaves room for improvement and reflects the challenging nature of AraStance and the task of stance detection in general.
