Hallucination-Free Automatic Question & Answer Generation for Intuitive Learning
Not on the map. Why?
Abstract (arXiv)
Hallucinations in large language models (LLMs), defined as fluent yet incorrect or incoherent outputs, pose a significant challenge to the automatic generation of educational multiple-choice questions (MCQs). We identified four key hallucination types in MCQ generation: reasoning inconsistencies, insolvability, factual errors, and mathematical errors. To address this, we propose a hallucination-free multi-agent generation framework that breaks down MCQ generation into discrete, verifiable stages. Our framework utilizes both rule-based and LLM-based detection agents, as well as hallucination scoring metrics to optimize question quality. We redefined MCQ generation as an optimization task minimizing hallucination risk while maximizing validity, answerability, and cost-efficiency. We also introduce an agent-led refinement process that uses counterfactual reasoning and chain-of-thought (CoT) to iteratively improve hallucination in question generation. We evaluated a sample of AP- aligned STEM questions, where our system reduced hallucination rates by over 90% compared to baseline generation while preserving the educational value and style of questions. Our results demonstrate that structured multi-agent collaboration can mitigate hallucinations in educational content creation at scale, paving the way for more reliable LLM-powered learning tools.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 21 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
9 of 21 references.
References · 9
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
- 2025HalluLens: LLM Hallucination Benchmarkcited by 88
- 2023A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Educationcited by 34
- 2024Measuring and Reducing LLM Hallucination without Gold-Standard Answerscited by 31
- 2024Automated Educational Question Generation at Different Bloom's Skill Levels using Large Language Models: Strategies and Evaluationcited by 29
- 2026Automatic Question Generation for Intuitive Learning Utilizing Causal Graph Guided Chain of Thought Reasoningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Benchmarking Hallucination in Large Language Models based on Unanswerable Math Word Problem
- 2025Think More, Hallucinate Less: Mitigating Hallucinations via Dual Process of Fast and Slow Thinking
- 2023DelucionQA: Detecting Hallucinations in Domain-specific Question Answering
- 2024Towards Reliable Medical Question Answering: Techniques and Challenges in Mitigating Hallucinations in Language Models
- 2025Enhancing Reliability across Short and Long-Form QA via Reinforcement Learning
- 2024Towards Detecting LLMs Hallucination via Markov Chain-based Multi-agent Debate Framework
- 2025Don't Let It Hallucinate: Premise Verification via Retrieval-Augmented Logical Reasoning
- 2024Investigating and Addressing Hallucinations of LLMs in Tasks Involving Negation