mlsanityData to 14 Oct 2026

An Annotation Scheme for Factuality and its Application to Parliamentary Proceedings

arXiv 2509.26406 ↗First posted 30 Sep 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Factuality assesses the extent to which a language utterance relates to real-world information; it determines whether utterances correspond to facts, possibilities, or imaginary situations, and as such, it is instrumental for fact checking. Factuality is a complex notion that relies on multiple linguistic signals, and has been studied in various disciplines. We present a complex, multi-faceted annotation scheme of factuality that combines concepts from a variety of previous works. We developed the scheme for Hebrew, but we trust that it can be adapted to other languages. We also present a set of almost 5,000 sentences in the domain of parliamentary discourse that we manually annotated according to this scheme. We report on inter-annotator agreement, and experiment with various approaches to automatically predict (some features of) the scheme, in order to extend the annotation to a large corpus.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 38 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

9 of 38 references.

References · 9

  1. 2024Factuality of Large Language Models: A Surveycited by 66
  2. 2018Towards Automated Factchecking: Developing an Annotation Schema and Benchmark for Consistent Automated Claim Detectioncited by 55
  3. 2018Overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims. Task 1: Check-Worthinesscited by 41
  4. 2023DictaBERT: A State-of-the-Art BERT Suite for Modern Hebrewcited by 17
  5. 2022Large Pre-Trained Models with Extra-Large Vocabularies: A Contrastive Analysis of Hebrew BERT Models and a New One to Outperform Them Allcited by 14
  6. 2021The Possible, the Plausible, and the Desirable: Event-Based Modality Detection for Language Processingcited by 13
  7. 2024Transferable and Efficient Non-Factual Content Detection via Probe Training with Offline Consistency Checkingcited by 7
  8. 2024MAVEN-Fact: A Large-scale Event Factuality Detection Datasetcited by 6
  9. 2024The Knesset Corpus: An Annotated Corpus of Hebrew Parliamentary Proceedingscited by 4

Built on by

Not cited yet.