mlsanityData to 7 Oct 2026

Hallucination-Free Automatic Question & Answer Generation for Intuitive Learning

arXiv 2601.14280 ↗First posted 13 Jan 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Hallucinations in large language models (LLMs), defined as fluent yet incorrect or incoherent outputs, pose a significant challenge to the automatic generation of educational multiple-choice questions (MCQs). We identified four key hallucination types in MCQ generation: reasoning inconsistencies, insolvability, factual errors, and mathematical errors. To address this, we propose a hallucination-free multi-agent generation framework that breaks down MCQ generation into discrete, verifiable stages. Our framework utilizes both rule-based and LLM-based detection agents, as well as hallucination scoring metrics to optimize question quality. We redefined MCQ generation as an optimization task minimizing hallucination risk while maximizing validity, answerability, and cost-efficiency. We also introduce an agent-led refinement process that uses counterfactual reasoning and chain-of-thought (CoT) to iteratively improve hallucination in question generation. We evaluated a sample of AP- aligned STEM questions, where our system reduced hallucination rates by over 90% compared to baseline generation while preserving the educational value and style of questions. Our results demonstrate that structured multi-agent collaboration can mitigate hallucinations in educational content creation at scale, paving the way for more reliable LLM-powered learning tools.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 21 references that are in the map. First posted on arXiv 13 Jan 2026.

Builds on

9 of 21 references.

References · 9

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  3. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  4. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  5. 2025HalluLens: LLM Hallucination Benchmarkcited by 88
  6. 2023A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Educationcited by 34
  7. 2024Measuring and Reducing LLM Hallucination without Gold-Standard Answerscited by 31
  8. 2024Automated Educational Question Generation at Different Bloom's Skill Levels using Large Language Models: Strategies and Evaluationcited by 29
  9. 2026Automatic Question Generation for Intuitive Learning Utilizing Causal Graph Guided Chain of Thought Reasoningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Benchmarking Hallucination in Large Language Models based on Unanswerable Math Word Problem
  2. 2025Think More, Hallucinate Less: Mitigating Hallucinations via Dual Process of Fast and Slow Thinking
  3. 2023DelucionQA: Detecting Hallucinations in Domain-specific Question Answering
  4. 2024Towards Reliable Medical Question Answering: Techniques and Challenges in Mitigating Hallucinations in Language Models
  5. 2025Enhancing Reliability across Short and Long-Form QA via Reinforcement Learning
  6. 2024Towards Detecting LLMs Hallucination via Markov Chain-based Multi-agent Debate Framework
  7. 2025Don't Let It Hallucinate: Premise Verification via Retrieval-Augmented Logical Reasoning
  8. 2024Investigating and Addressing Hallucinations of LLMs in Tasks Involving Negation