SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumours
Not on the map. Why?
Abstract (arXiv)
Media is full of false claims. Even Oxford Dictionaries named "post-truth" as the word of 2016. This makes it more important than ever to build systems that can identify the veracity of a story, and the kind of discourse there is around it. RumourEval is a SemEval shared task that aims to identify and handle rumours and reactions to them, in text. We present an annotation scheme, a large dataset covering multiple topics - each having their own families of claims and replies - and use these to pose two concrete challenges as well as the results achieved by participants on these challenges.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 26; 2022: 14; 2023: 9; 2024: 14; 2025: 8; 2026: 6.
77 papers.
Sort:
By area:
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
- 2021ExplaGraphs: An Explanation Graph Generation Task for Structured Commonsense Reasoningcited by 58
- 2021Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contextscited by 56
- 2021Automated Fact-Checking: A Surveycited by 55
- 2021SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Imagescited by 49
- 2021Few-Shot Cross-Lingual Stance Detection with Sentiment-Based Pre-Trainingcited by 28
- 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake Newscited by 23
- 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claimscited by 22
- 2023Emotion Detection for Misinformation: A Reviewcited by 20
- 2023The Intended Uses of Automated Fact-Checking Artefacts: Why, How and Whocited by 19
- 2023Navigating Prompt Complexity for Zero-Shot Classification: A Study of Large Language Models in Computational Social Sciencecited by 18
38 more
- 2022Improved Target-specific Stance Detection on Social Media Platforms by Delving into Conversation Threadscited by 16
- 2021Investigating label suggestions for opinion mining in German Covid-19 social mediacited by 15
- 2022Human-in-the-loop Evaluation for Early Misinformation Detection: A Case Study of COVID-19 Treatmentscited by 14
- 2023VaxxHesitancy: A Dataset for Studying Hesitancy towards COVID-19 Vaccination on Twittercited by 14
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrievalcited by 14
- 2022Claim-Dissector: An Interpretable Fact-Checking System with Joint Re-ranking and Veracity Predictioncited by 12
- 2021Dataset of Fake News Detection and Fact Verification: A Surveycited by 11
- 2021Semi-automatic Generation of Multilingual Datasets for Stance Detection in Twittercited by 10
- 2021On Unifying Misinformation Detectioncited by 10
- 2022A Weakly Supervised Propagation Model for Rumor Verification and Stance Detection with Multiple Instance Learningcited by 10
- 2021VRoC: Variational Autoencoder-aided Multi-task Rumor Classifier Based on Textcited by 9
- 2021STEM: Unsupervised STructural EMbedding for Stance Detectioncited by 9
- 2022CrowdChecked: Detecting Previously Fact-Checked Claims in Social Mediacited by 9
- 2021AraStance: A Multi-Country and Multi-Domain Dataset of Arabic Stance Detection for Fact Checkingcited by 8
- 2021What goes on inside rumour and non-rumour tweets and their reactions: A Psycholinguistic Analysescited by 8
- 2022Stanceosaurus: Classifying Stance Towards Multilingual Misinformationcited by 8
- 2024A Survey of Stance Detection on Social Media: New Directions and Perspectivescited by 8
- 2025Truth over Tricks: Measuring and Mitigating Shortcut Learning in Misinformation Detectioncited by 8
- 2021Automatic Detection of COVID-19 Vaccine Misinformation with Graph Link Predictioncited by 7
- 2023Early Rumor Detection Using Neural Hawkes Process with a New Benchmark Datasetcited by 7
- 2024Towards a Framework for Evaluating Explanations in Automated Fact Verificationcited by 7
- 2024ORCHID: A Chinese Debate Corpus for Target-Independent Stance Detection and Argumentative Dialogue Summarizationcited by 6
- 2025LLM-Enhanced Multiple Instance Learning for Joint Rumor and Stance Detection with Social Context Informationcited by 6
- 2021Constraint 2021: Machine Learning Models for COVID-19 Fake News Detection Shared Taskcited by 5
- 2021A Second Pandemic? Analysis of Fake News About COVID-19 Vaccines in Qatarcited by 5
- 2022ExaASC: A General Target-Based Stance Detection Corpus in Arabic Languagecited by 5
- 2024Reinforcement Tuning for Detecting Stances and Debunking Rumors Jointly with Large Language Modelscited by 5
- 2024Stanceformer: Target-Aware Transformer for Stance Detectioncited by 5
- 2024On the Risk of Evidence Pollution for Malicious Social Text Detection in the Era of LLMscited by 5
- 2025EcoLANG: Efficient and Effective Agent Communication Language Induction for Social Simulationcited by 5
- 2021Social Analysis of Young Basque Speaking Communities in Twittercited by 4
- 2022Overview of the Shared Task on Fake News Detection in Urdu at FIRE 2021cited by 4
- 2023Topic-Guided Sampling For Data-Efficient Multi-Domain Stance Detectioncited by 4
- 2024Instruction Tuning Vs. In-Context Learning: Revisiting Large Language Models in Few-Shot Computational Social Sciencecited by 4
- 2025SciClaimHunt: A Large Dataset for Evidence-based Scientific Claim Verificationcited by 4
- 2021Dynamically Addressing Unseen Rumor via Continual Learningcited by 3
- 2021WhatTheWikiFact: Fact-Checking Claims Against Wikipediacited by 3
- 2022Identifying the Adoption or Rejection of Misinformation Targeting COVID-19 Vaccines in Twitter Discoursecited by 3
50 most cited of 77 All 77 (JSON)
- 2026Long Live Fine-Tuning: Task-Specific Transformers Outperform Zero-Shot LLMs for Misinformation Response Classification on Reddit2 Jun 2026
- 2026You Can't Fool Us: Understanding the Resilience of LLM-driven Agent Communities to Misinformation17 May 2026
- 2026TruthStance: An Annotated Dataset of Conversations on Truth Social16 Feb 2026
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking10 Feb 2026
- 2026The Facade of Truth: Uncovering and Mitigating LLM Susceptibility to Deceptive Evidence9 Jan 2026
- 2026LLMberjack: Guided Trimming of Debate Trees for Multi-Party Conversation Creation7 Jan 2026
- 2025Verifying Rumors via Stance-Aware Structural Modeling15 Dec 2025
- 2025SPOT: An Annotated French Corpus and Benchmark for Detecting Critical Interventions in Online Conversations10 Nov 2025
- 2025Truth over Tricks: Measuring and Mitigating Shortcut Learning in Misinformation Detection3 Jun 2025
- 2025SCRum-9: Multilingual Stance Classification over Rumours on Social Media25 May 2025
- 2025EcoLANG: Efficient and Effective Agent Communication Language Induction for Social Simulation11 May 2025
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval19 Mar 2025
38 more
- 2025SciClaimHunt: A Large Dataset for Evidence-based Scientific Claim Verification14 Feb 2025
- 2025LLM-Enhanced Multiple Instance Learning for Joint Rumor and Stance Detection with Social Context Information13 Feb 2025
- 2024Rumor Detection on Social Media with Temporal Propagation Structure Optimization11 Dec 2024
- 2024Efficient Annotator Reliability Assessment and Sample Weighting for Knowledge-Based Misinformation Detection on Social Media18 Oct 2024
- 2024ORCHID: A Chinese Debate Corpus for Target-Independent Stance Detection and Argumentative Dialogue Summarization17 Oct 2024
- 2024On the Risk of Evidence Pollution for Malicious Social Text Detection in the Era of LLMs16 Oct 2024
- 2024Stanceformer: Target-Aware Transformer for Stance Detection9 Oct 2024
- 2024A Survey of Stance Detection on Social Media: New Directions and Perspectives24 Sep 2024
- 2024Instruction Tuning Vs. In-Context Learning: Revisiting Large Language Models in Few-Shot Computational Social Science23 Sep 2024
- 2024Cross-Target Stance Detection: A Survey of Techniques, Datasets, and Challenges20 Sep 2024
- 2024Reinforcement Tuning for Detecting Stances and Debunking Rumors Jointly with Large Language Models4 Jun 2024
- 2024Hoaxpedia: A Unified Wikipedia Hoax Articles Dataset3 May 2024
- 2024Rumour Evaluation with Very Large Language Models11 Apr 2024
- 2024Towards a Framework for Evaluating Explanations in Automated Fact Verification29 Mar 2024
- 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claims25 Mar 2024
- 2024Generating Zero-shot Abstractive Explanations for Rumour Verification23 Jan 2024
- 2023Emotion Detection for Misinformation: A Review1 Nov 2023
- 2023Classification-Aware Neural Topic Model Combined With Interpretable Analysis -- For Conflict Classification29 Aug 2023
- 2023Early Rumor Detection Using Neural Hawkes Process with a New Benchmark Dataset5 Jun 2023
- 2023Topic-Guided Sampling For Data-Efficient Multi-Domain Stance Detection1 Jun 2023
- 2023Navigating Prompt Complexity for Zero-Shot Classification: A Study of Large Language Models in Computational Social Science23 May 2023
- 2023The Intended Uses of Automated Fact-Checking Artefacts: Why, How and Who27 Apr 2023
- 2023Rumor Detection with Hierarchical Representation on Bipartite Adhoc Event Trees27 Apr 2023
- 2023Can We Identify Stance Without Target Arguments? A Study for Rumour Stance Classification22 Mar 2023
- 2023VaxxHesitancy: A Dataset for Studying Hesitancy towards COVID-19 Vaccination on Twitter17 Jan 2023
- 2022Human-in-the-loop Evaluation for Early Misinformation Detection: A Case Study of COVID-19 Treatments19 Dec 2022
- 2022Check-worthy Claim Detection across Topics for Automated Fact-checking16 Dec 2022
- 2022Exploring Graph-aware Multi-View Fusion for Rumor Detection on Social Media8 Nov 2022
- 2022Improved Target-specific Stance Detection on Social Media Platforms by Delving into Conversation Threads6 Nov 2022
- 2022Stanceosaurus: Classifying Stance Towards Multilingual Misinformation28 Oct 2022
- 2022Language Independent Stance Detection: Social Interaction-based Embeddings and Large Language Models11 Oct 2022
- 2022CrowdChecked: Detecting Previously Fact-Checked Claims in Social Media10 Oct 2022
- 2022Claim-Dissector: An Interpretable Fact-Checking System with Joint Re-ranking and Veracity Prediction28 Jul 2022
- 2022Overview of the Shared Task on Fake News Detection in Urdu at FIRE 202025 Jul 2022
- 2022Overview of the Shared Task on Fake News Detection in Urdu at FIRE 202111 Jul 2022
- 2022ClaimDiff: Comparing and Contrasting Claims on Contentious Issues24 May 2022
- 2022ExaASC: A General Target-Based Stance Detection Corpus in Arabic Language29 Apr 2022
- 2022A Weakly Supervised Propagation Model for Rumor Verification and Stance Detection with Multiple Instance Learning6 Apr 2022
50 newest of 77 All 77 (JSON)
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
- 2021ExplaGraphs: An Explanation Graph Generation Task for Structured Commonsense Reasoningcited by 58
- 2021Just Say No: Analyzing the Stance of Neural Dialogue Generation in Offensive Contextscited by 56
- 2021Automated Fact-Checking: A Surveycited by 55
- 2021SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Imagescited by 49
- 2021Few-Shot Cross-Lingual Stance Detection with Sentiment-Based Pre-Trainingcited by 28
- 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake Newscited by 23
- 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claimscited by 22
- 2023Emotion Detection for Misinformation: A Reviewcited by 20
- 2023The Intended Uses of Automated Fact-Checking Artefacts: Why, How and Whocited by 19
- 2023Navigating Prompt Complexity for Zero-Shot Classification: A Study of Large Language Models in Computational Social Sciencecited by 18
12 most cited of 75 All 75 (JSON)
- 2026Long Live Fine-Tuning: Task-Specific Transformers Outperform Zero-Shot LLMs for Misinformation Response Classification on Reddit2 Jun 2026
- 2026TruthStance: An Annotated Dataset of Conversations on Truth Social16 Feb 2026
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking10 Feb 2026
- 2026The Facade of Truth: Uncovering and Mitigating LLM Susceptibility to Deceptive Evidence9 Jan 2026
- 2026LLMberjack: Guided Trimming of Debate Trees for Multi-Party Conversation Creation7 Jan 2026
- 2025Verifying Rumors via Stance-Aware Structural Modeling15 Dec 2025
- 2025SPOT: An Annotated French Corpus and Benchmark for Detecting Critical Interventions in Online Conversations10 Nov 2025
- 2025Truth over Tricks: Measuring and Mitigating Shortcut Learning in Misinformation Detection3 Jun 2025
- 2025SCRum-9: Multilingual Stance Classification over Rumours on Social Media25 May 2025
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval19 Mar 2025
- 2025SciClaimHunt: A Large Dataset for Evidence-based Scientific Claim Verification14 Feb 2025
- 2025LLM-Enhanced Multiple Instance Learning for Joint Rumor and Stance Detection with Social Context Information13 Feb 2025
12 newest of 75 All 75 (JSON)