QuestGen: Effectiveness of Question Generation Methods for Fact-Checking Applications
Not on the map. Why?
Abstract (arXiv)
Verifying fact-checking claims poses a significant challenge, even for humans. Recent approaches have demonstrated that decomposing claims into relevant questions to gather evidence enhances the efficiency of the fact-checking process. In this paper, we provide empirical evidence showing that this question decomposition can be effectively automated. We demonstrate that smaller generative models, fine-tuned for the question generation task using data augmentation from various datasets, outperform large language models by up to 8%. Surprisingly, in some cases, the evidence retrieved using machine-generated questions proves to be significantly more effective for fact-checking than that obtained from human-written questions. We also perform manual evaluation of the decomposed questions to assess the quality of the questions generated.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 16 of its 23 references that are in the map. First posted on arXiv 31 Jul 2024.
Builds on
16 of 23 references.
References · 16
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 247
- 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
- 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2023Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detectioncited by 69
- 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
- 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 52
- 2020Generating Fact Checking Briefscited by 50
- 2021FaVIQ: FAct Verification from Information-seeking Questionscited by 36
- 2022Varifocal Question Generation for Fact-checkingcited by 27
4 more
- 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claimscited by 22
- 2020BRENDA: Browser Extension for Fake News Detectioncited by 20
- 2024Surprising Efficacy of Fine-Tuned Transformers for Fact-Checking over Larger Language Modelscited by 14
- 2024FactCheck Editor: Multilingual Text Editor with End-to-End fact-checkingcited by 12
Built on by
Citing papers per year: 2025: 2.
2 papers.