SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums
Not on the map. Why?
Abstract (arXiv)
We present SemEval-2019 Task 8 on Fact Checking in Community Question Answering Forums, which features two subtasks. Subtask A is about deciding whether a question asks for factual information vs. an opinion/advice vs. just socializing. Subtask B asks to predict whether an answer to a factual question is true, false or not a proper answer. We received 17 official submissions for subtask A and 11 official submissions for Subtask B. For subtask A, all systems improved over the majority class baseline. For Subtask B, all systems were below a majority class baseline, but several systems were very close to it. The leaderboard and the data from the competition can be found at http://competitions.codalab.org/competitions/20022
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 3; 2023: 1; 2024: 2; 2025: 1; 2026: 1.
18 papers.
Sort:
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2021Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collectionscited by 128
- 2024VERISCORE: Evaluating the factuality of verifiable claims in long-form text generationcited by 114
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
- 2022Describing Differences between Text Distributions with Natural Languagecited by 54
- 2021SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Imagescited by 49
- 2021SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)cited by 35
- 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake Newscited by 23
- 2021Overview of the CLEF-2019 CheckThat!: Automatic Identification and Verification of Claimscited by 18
- 2021The Role of Context in Detecting Previously Fact-Checked Claimscited by 17
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrievalcited by 14
- 2021Joint Models for Answer Verification in Question Answering Systemscited by 13
6 more
- 2022Human-Centric Research for NLP: Towards a Definition and Guiding Questionscited by 9
- 2021A Second Pandemic? Analysis of Fake News About COVID-19 Vaccines in Qatarcited by 5
- 2024DAHL: Domain-specific Automated Hallucination Evaluation of Long-Form Text through a Benchmark Dataset in Biomedicinecited by 4
- 2021WhatTheWikiFact: Fact-Checking Claims Against Wikipediacited by 3
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checkingcited by 3
- 2022Science Checker: Extractive-Boolean Question Answering For Scientific Fact Checkingcited by 1
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking10 Feb 2026
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval19 Mar 2025
- 2024DAHL: Domain-specific Automated Hallucination Evaluation of Long-Form Text through a Benchmark Dataset in Biomedicine14 Nov 2024
- 2024VERISCORE: Evaluating the factuality of verifiable claims in long-form text generation27 Jun 2024
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation23 May 2023
- 2022Human-Centric Research for NLP: Towards a Definition and Guiding Questions10 Jul 2022
- 2022Science Checker: Extractive-Boolean Question Answering For Scientific Fact Checking26 Apr 2022
- 2022Describing Differences between Text Distributions with Natural Language28 Jan 2022
- 2021Overview of the CLEF-2019 CheckThat!: Automatic Identification and Verification of Claims25 Sep 2021
- 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News23 Sep 2021
- 2021A Second Pandemic? Analysis of Fake News About COVID-19 Vaccines in Qatar22 Sep 2021
- 2021Joint Models for Answer Verification in Question Answering Systems9 Jul 2021
6 more
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemic7 Jun 2021
- 2021SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)28 May 2021
- 2021SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Images25 Apr 2021
- 2021WhatTheWikiFact: Fact-Checking Claims Against Wikipedia16 Apr 2021
- 2021The Role of Context in Detecting Previously Fact-Checked Claims15 Apr 2021
- 2021Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections10 Apr 2021
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2021Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collectionscited by 128
- 2024VERISCORE: Evaluating the factuality of verifiable claims in long-form text generationcited by 114
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
- 2022Describing Differences between Text Distributions with Natural Languagecited by 54
- 2021SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Imagescited by 49
- 2021SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS)cited by 35
- 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake Newscited by 23
- 2021Overview of the CLEF-2019 CheckThat!: Automatic Identification and Verification of Claimscited by 18
- 2021The Role of Context in Detecting Previously Fact-Checked Claimscited by 17
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrievalcited by 14
- 2021Joint Models for Answer Verification in Question Answering Systemscited by 13
12 most cited of 18 All 18 (JSON)
- 2026The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking10 Feb 2026
- 2025The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval19 Mar 2025
- 2024DAHL: Domain-specific Automated Hallucination Evaluation of Long-Form Text through a Benchmark Dataset in Biomedicine14 Nov 2024
- 2024VERISCORE: Evaluating the factuality of verifiable claims in long-form text generation27 Jun 2024
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation23 May 2023
- 2022Human-Centric Research for NLP: Towards a Definition and Guiding Questions10 Jul 2022
- 2022Science Checker: Extractive-Boolean Question Answering For Scientific Fact Checking26 Apr 2022
- 2022Describing Differences between Text Distributions with Natural Language28 Jan 2022
- 2021Overview of the CLEF-2019 CheckThat!: Automatic Identification and Verification of Claims25 Sep 2021
- 2021Overview of the CLEF--2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News23 Sep 2021
- 2021A Second Pandemic? Analysis of Fake News About COVID-19 Vaccines in Qatar22 Sep 2021
- 2021Joint Models for Answer Verification in Question Answering Systems9 Jul 2021
12 newest of 18 All 18 (JSON)