NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledge
Not on the map. Why?
Abstract (arXiv)
Claim detection and verification are crucial for news understanding and have emerged as promising technologies for mitigating misinformation and disinformation in the news. However, most existing work has focused on claim sentence analysis while overlooking additional crucial attributes (e.g., the claimer and the main object associated with the claim). In this work, we present NewsClaims, a new benchmark for attribute-aware claim detection in the news domain. We extend the claim detection problem to include extraction of additional attributes related to each claim and release 889 claims annotated over 143 news articles. NewsClaims aims to benchmark claim detection systems in emerging scenarios, comprising unseen topics with little or no training data. To this end, we see that zero-shot and prompt-based baselines show promising performance on this benchmark, while still considerably behind human performance.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 35 of its 53 references that are in the map. First posted on arXiv 16 Dec 2021.
Builds on
35 of 53 references.
References · 35
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 669
- 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
23 more
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 308
- 2020Explainable Automated Fact-Checking for Public Health Claimscited by 211
- 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 167
- 2021Automated Fact-Checking for Assisting Human Fact-Checkerscited by 144
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
- 2020Zero-Shot Stance Detection: A Dataset and Model using Generalized Topic Representationscited by 98
- 2020That is a Known Lie: Detecting Previously Fact-Checked Claimscited by 82
- 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
- 2019A Richly Annotated Corpus for Different Tasks in Automated Fact-Checkingcited by 74
- 2020Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Societycited by 72
- 2020From Arguments to Key Points: Towards Automatic Argument Summarizationcited by 61
- 2018Cross-topic Argument Mining from Heterogeneous Sources Using Attention-based Neural Networkscited by 58
- 2019Corpus Wide Argument Mining -- a Working Solutioncited by 36
- 2021Cross-Domain Label-Adaptive Stance Detectioncited by 30
- 2017Fully Automated Fact Checking Using External Sourcescited by 27
- 2018ClaimRank: Detecting Check-Worthy Claims in Arabic and Englishcited by 27
- 2020A Benchmark Dataset of Check-worthy Factual Claimscited by 27
- 2021Overview of the CLEF-2019 CheckThat!: Automatic Identification and Verification of Claimscited by 18
- 2019It Takes Nine to Smell a Rat: Neural Multi-Task Learning for Check-Worthiness Predictioncited by 14
- 2019Automatic Fact-Checking Using Context and Discourse Informationcited by 11
- 2021Categorising Fine-to-Coarse Grained Misinformation: An Empirical Study of COVID-19 Infodemiccited by 9
- 2021Project Debater APIs: Decomposing the AI Grand Challengecited by 8
Built on by
Citing papers per year: 2022: 1; 2023: 8; 2024: 7; 2025: 1; 2026: 3.
20 papers.
Sort:
By area:
- 2023Factuality Challenges in the Era of Large Language Modelscited by 126
- 2024AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotatorscited by 28
- 2023EDIS: Entity-Driven Image Search over Multimodal Web Contentcited by 27
- 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
- 2023From Chaos to Clarity: Claim Normalization to Empower Fact-Checkingcited by 17
- 2023LAraBench: Benchmarking Arabic AI with Large Language Modelscited by 16
- 2023Decoding the Silent Majority: Inducing Belief Augmented Social Graph with Large Language Model for Response Forecastingcited by 11
- 2022KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understandingcited by 9
- 2023SmartBook: AI-Assisted Situation Report Generation for Intelligence Analystscited by 9
- 2024Claim Check-Worthiness Detection: How Well do LLMs Grasp Annotation Guidelines?cited by 9
- 2023Lost in Translation, Found in Spans: Identifying Claims in Multilingual Social Mediacited by 8
- 2025Veri-R1: Toward Precise and Faithful Claim Verification via Online Reinforcement Learningcited by 5
8 more
- 2023Multilingual and Multi-topical Benchmark of Fine-tuned Language models and Large Language Models for Check-Worthy Claim Detectioncited by 2
- 2024Multilingual Models for Check-Worthy Social Media Posts Detectioncited by 2
- 2024VERITAS-NLI : Validation and Extraction of Reliable Information Through Automated Scraping and Natural Language Inferencecited by 1
- 2024Self-Adaptive Paraphrasing and Preference Learning for Improved Claim Verifiabilitycited by 1
- 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platformscited by 1
- 2024Ontology Enhanced Claim Detectioncited by 0
- 2026ClaimPT: A Portuguese Dataset of Annotated Claims in News Articlescited by 0
- 2026Multilingual and Cross-Lingual Citation Needed Detection on Wikipedia for Lower-Resource Languagescited by 0
- 2026Multilingual and Cross-Lingual Citation Needed Detection on Wikipedia for Lower-Resource Languages29 May 2026
- 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platforms18 Apr 2026
- 2026ClaimPT: A Portuguese Dataset of Annotated Claims in News Articles27 Jan 2026
- 2025Veri-R1: Toward Precise and Faithful Claim Verification via Online Reinforcement Learning2 Oct 2025
- 2024Self-Adaptive Paraphrasing and Preference Learning for Improved Claim Verifiability16 Dec 2024
- 2024VERITAS-NLI : Validation and Extraction of Reliable Information Through Automated Scraping and Natural Language Inference12 Oct 2024
- 2024Multilingual Models for Check-Worthy Social Media Posts Detection13 Aug 2024
- 2024Generative Large Language Models in Automated Fact-Checking: A Survey2 Jul 2024
- 2024Claim Check-Worthiness Detection: How Well do LLMs Grasp Annotation Guidelines?18 Apr 2024
- 2024Ontology Enhanced Claim Detection19 Feb 2024
- 2024AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotators16 Feb 2024
- 2023Multilingual and Multi-topical Benchmark of Fine-tuned Language models and Large Language Models for Check-Worthy Claim Detection10 Nov 2023
8 more
- 2023Lost in Translation, Found in Spans: Identifying Claims in Multilingual Social Media27 Oct 2023
- 2023From Chaos to Clarity: Claim Normalization to Empower Fact-Checking22 Oct 2023
- 2023Decoding the Silent Majority: Inducing Belief Augmented Social Graph with Large Language Model for Response Forecasting20 Oct 2023
- 2023Factuality Challenges in the Era of Large Language Models8 Oct 2023
- 2023LAraBench: Benchmarking Arabic AI with Large Language Models24 May 2023
- 2023EDIS: Entity-Driven Image Search over Multimodal Web Content23 May 2023
- 2023SmartBook: AI-Assisted Situation Report Generation for Intelligence Analysts25 Mar 2023
- 2022KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understanding8 Oct 2022
- 2023Factuality Challenges in the Era of Large Language Modelscited by 126
- 2024AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotatorscited by 28
- 2023EDIS: Entity-Driven Image Search over Multimodal Web Contentcited by 27
- 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
- 2023From Chaos to Clarity: Claim Normalization to Empower Fact-Checkingcited by 17
- 2023LAraBench: Benchmarking Arabic AI with Large Language Modelscited by 16
- 2023Decoding the Silent Majority: Inducing Belief Augmented Social Graph with Large Language Model for Response Forecastingcited by 11
- 2022KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understandingcited by 9
- 2023SmartBook: AI-Assisted Situation Report Generation for Intelligence Analystscited by 9
- 2024Claim Check-Worthiness Detection: How Well do LLMs Grasp Annotation Guidelines?cited by 9
- 2023Lost in Translation, Found in Spans: Identifying Claims in Multilingual Social Mediacited by 8
- 2023Multilingual and Multi-topical Benchmark of Fine-tuned Language models and Large Language Models for Check-Worthy Claim Detectioncited by 2
12 most cited of 18 All 18 (JSON)
- 2026Multilingual and Cross-Lingual Citation Needed Detection on Wikipedia for Lower-Resource Languages29 May 2026
- 2026When Misinformation Speaks and Converses: Rethinking Fact-Checking in Audio Platforms18 Apr 2026
- 2026ClaimPT: A Portuguese Dataset of Annotated Claims in News Articles27 Jan 2026
- 2024VERITAS-NLI : Validation and Extraction of Reliable Information Through Automated Scraping and Natural Language Inference12 Oct 2024
- 2024Multilingual Models for Check-Worthy Social Media Posts Detection13 Aug 2024
- 2024Generative Large Language Models in Automated Fact-Checking: A Survey2 Jul 2024
- 2024Claim Check-Worthiness Detection: How Well do LLMs Grasp Annotation Guidelines?18 Apr 2024
- 2024Ontology Enhanced Claim Detection19 Feb 2024
- 2024AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotators16 Feb 2024
- 2023Multilingual and Multi-topical Benchmark of Fine-tuned Language models and Large Language Models for Check-Worthy Claim Detection10 Nov 2023
- 2023Lost in Translation, Found in Spans: Identifying Claims in Multilingual Social Media27 Oct 2023
- 2023From Chaos to Clarity: Claim Normalization to Empower Fact-Checking22 Oct 2023
12 newest of 18 All 18 (JSON)