ElementCheck: Complexity-Aware Long-Form Text Factuality Evaluation via Sentence Elements
Not on the map. Why?
Abstract (arXiv)
Existing long-form factuality evaluation relies on the decompose-retrieve-verify pipeline. However, the pipeline suffers from noise from claim decomposition and fixed verification granularity, resulting in unreliable results. We propose ElementCheck, a complexity-aware framework that verifies long-form outputs via sentence elements. Instead of uniformly decomposing sentences into atomic sub-claims, ElementCheck extracts entity pairs that are explicitly linked through verifiable connections in the original sentence as elements, and organizes these into an element graph. The graph topology provides a structural signal for estimating sentence complexity, enabling direct verification for simple sentences and targeted element-level refinement and verification for complex ones. To support fine-grained evaluation, we construct a new benchmark FastFact-Sent by mapping isolated claims from FastFact-Bench back to their source sentences. Experiments on FastFact-Sent and two domain-specific benchmarks show ElementCheck consistently improves factuality verification across five backbone models while maintaining a favorable accuracy-cost trade-off. Further analyses demonstrate that complexity-aware verification reduces unnecessary re-verification and maintains stability across different backbones. The code is available at hrefhttps://github.com/gudehhh666/elementcheck.gitHere.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
31 of 45 references.
References · 31
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 288
- 2020Universal Dependencies v2: An Evergrowing Multilingual Treebank Collectioncited by 271
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 257
- 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
- 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 201
- 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 144
19 more
- 2024VERISCORE: Evaluating the factuality of verifiable claims in long-form text generationcited by 117
- 2023Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkerscited by 87
- 2023Multimodal Automated Fact-Checking: A Surveycited by 53
- 2024DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Expertscited by 43
- 2024A Closer Look at Claim Decompositioncited by 41
- 2024Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentationcited by 41
- 2024Decomposition Dilemmas: Does Claim Decomposition Boost or Burden Fact-Checking Performance?cited by 36
- 2023ChartCheck: Explainable Fact-Checking over Real-World Chart Imagescited by 26
- 2024DnDScore: Decontextualization and Decomposition for Factuality Verification in Long-Form Text Generationcited by 22
- 2025Towards Effective Extraction and Evaluation of Factual Claimscited by 19
- 2024Recoverable Compression: A Multimodal Vision Token Recovery Mechanism Guided by Text Informationcited by 18
- 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checkingcited by 18
- 2025AVerImaTeC: A Dataset for Automatic Verification of Image-Text Claims with Evidence from the Webcited by 18
- 2024Core: Robust Factual Precision with Informative Sub-Claim Identificationcited by 16
- 2025VeriFact: Enhancing Long-Form Factuality Evaluation with Refined Fact Extraction and Reference Factscited by 11
- 2024FactLens: Benchmarking Fine-Grained Fact Verificationcited by 10
- 2025Optimizing Decomposition for Optimal Claim Verificationcited by 10
- 2025FaStfact: Faster, Stronger Long-Form Factuality Evaluations in LLMscited by 8
- 2025FlashCheck: Exploration of Efficient Evidence Retrieval for Fast Fact-Checkingcited by 4
Built on by
Not cited yet.