mlsanityData to 7 Oct 2026

QuestGen: Effectiveness of Question Generation Methods for Fact-Checking Applications

arXiv 2407.21441 ↗First posted 31 Jul 2024cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Verifying fact-checking claims poses a significant challenge, even for humans. Recent approaches have demonstrated that decomposing claims into relevant questions to gather evidence enhances the efficiency of the fact-checking process. In this paper, we provide empirical evidence showing that this question decomposition can be effectively automated. We demonstrate that smaller generative models, fine-tuned for the question generation task using data augmentation from various datasets, outperform large language models by up to 8%. Surprisingly, in some cases, the evidence retrieved using machine-generated questions proves to be significantly more effective for fact-checking than that obtained from human-written questions. We also perform manual evaluation of the decomposed questions to assess the quality of the questions generated.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 16 of its 23 references that are in the map. First posted on arXiv 31 Jul 2024.

Builds on

16 of 23 references.

References · 16

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  3. 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 247
  4. 2019MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claimscited by 169
  5. 2023Fact-Checking Complex Claims with Program-Guided Reasoningcited by 146
  6. 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
  7. 2023Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detectioncited by 69
  8. 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
  9. 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 52
  10. 2020Generating Fact Checking Briefscited by 50
  11. 2021FaVIQ: FAct Verification from Information-seeking Questionscited by 36
  12. 2022Varifocal Question Generation for Fact-checkingcited by 27
4 more
  1. 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claimscited by 22
  2. 2020BRENDA: Browser Extension for Fake News Detectioncited by 20
  3. 2024Surprising Efficacy of Fine-Tuned Transformers for Fact-Checking over Larger Language Modelscited by 14
  4. 2024FactCheck Editor: Multilingual Text Editor with End-to-End fact-checkingcited by 12

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.