# SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums

arXiv: https://arxiv.org/abs/1906.01727 · HTML: https://mlsanity.com/paper/1906.01727/

## Key facts

- Cited by 18 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 25 May 2019.

## Built on by (most cited first, 18 of 18)

- [FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation](https://mlsanity.com/paper/2305.14251/) (2023)
- [Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections](https://mlsanity.com/paper/2104.04670/) (2021)
- [VERISCORE: Evaluating the factuality of verifiable claims in long-form text generation](https://mlsanity.com/paper/2406.19276/) (2024)
- [COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemic](https://mlsanity.com/paper/2106.03794/) (2021)
- [Describing Differences between Text Distributions with Natural Language](https://mlsanity.com/paper/2201.12323/) (2022)
- [SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Images](https://mlsanity.com/paper/2105.09284/) (2021)
- [SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)](https://mlsanity.com/paper/2105.13995/) (2021)
- [Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News](https://mlsanity.com/paper/2109.12987/) (2021)
- [Overview of the CLEF-2019 CheckThat!: Automatic Identification and Verification of Claims](https://mlsanity.com/paper/2109.15118/) (2021)
- [The Role of Context in Detecting Previously Fact-Checked Claims](https://mlsanity.com/paper/2104.07423/) (2021)
- [The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval](https://mlsanity.com/paper/2503.14828/) (2025)
- [Joint Models for Answer Verification in Question Answering Systems](https://mlsanity.com/paper/2107.04217/) (2021)
- [Human-Centric Research for NLP: Towards a Definition and Guiding Questions](https://mlsanity.com/paper/2207.04447/) (2022)
- [A Second Pandemic? Analysis of Fake News About COVID-19 Vaccines in Qatar](https://mlsanity.com/paper/2109.11372/) (2021)
- [DAHL: Domain-specific Automated Hallucination Evaluation of Long-Form Text through a Benchmark Dataset in Biomedicine](https://mlsanity.com/paper/2411.09255/) (2024)
- [WhatTheWikiFact: Fact-Checking Claims Against Wikipedia](https://mlsanity.com/paper/2105.00826/) (2021)
- [The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking](https://mlsanity.com/paper/2602.09516/) (2026)
- [Science Checker: Extractive-Boolean Question Answering For Scientific Fact Checking](https://mlsanity.com/paper/2204.12263/) (2022)

## Abstract (arXiv)

We present SemEval-2019 Task 8 on Fact Checking in Community Question Answering Forums, which features two subtasks. Subtask A is about deciding whether a question asks for factual information vs. an opinion/advice vs. just socializing. Subtask B asks to predict whether an answer to a factual question is true, false or not a proper answer. We received 17 official submissions for subtask A and 11 official submissions for Subtask B. For subtask A, all systems improved over the majority class baseline. For Subtask B, all systems were below a majority class baseline, but several systems were very close to it. The leaderboard and the data from the competition can be found at http://competitions.codalab.org/competitions/20022