Can a Small Model Learn to Look Before It Leaps? Dynamic Learning and Proactive Correction for Hallucination Detection
Not on the map. Why?
Abstract (arXiv)
Hallucination in large language models (LLMs) remains a critical barrier to their safe deployment. For hallucination detection to be practical in real-world scenarios, the use of efficient small models is essential to ensure low latency and minimal resource consumption. However, existing methods rely on fixed verification strategies, where simply tuning small models to mimic fixed verification trajectories fails to capture the adaptability required for diverse hallucination patterns, thereby inducing planning instability. To address this limitation, we propose a ``Learning to Evaluate and Adaptively Plan'' (LEAP) framework, which shifts hallucination detection from fixed execution to dynamic strategy learning. Specifically, LEAP first employs a powerful teacher model to iteratively explore and refine verification strategies through a failure-driven loop. This dynamic planning capability is then distilled into an efficient student model, augmented by a novel proactive correction mechanism that enables the model to evaluate and optimize its verification strategy before execution. Experiments on three benchmarks demonstrate that LEAP outperforms state-of-the-art methods, offering an effective and scalable solution for reliable hallucination detection.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 40 references that are in the map. First posted on arXiv 8 Nov 2025.
Builds on
19 of 40 references.
References · 19
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
- 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
- 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
- 2023A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generationcited by 206
- 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 197
7 more
- 2023LLM Lies: Hallucinations are not Bugs, but Features as Adversarial Examplescited by 177
- 2024HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detectioncited by 99
- 2023LLMLight: Large Language Models as Traffic Signal Control Agentscited by 73
- 2024FIRE: Fact-checking with Iterative Retrieval and Verificationcited by 39
- 2024Large Language Models are Learnable Planners for Long-Term Recommendationcited by 24
- 2024Hallucination Detection and Hallucination Mitigation: An Investigationcited by 21
- 2024Small Agent Can Also Rock! Empowering Small Language Models as Hallucination Detectorcited by 20
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Generate, but Verify: Reducing Hallucination in Vision-Language Models with Retrospective Resampling
- 2026Alleviating Hallucination in Reasoning Tasks with Training-Free Uncertainty-Guided Steering
- 2026Predictive Coding and Information Bottleneck for Hallucination Detection in Large Language Models
- 2025From Detection to Diagnosis: Advancing Hallucination Analysis with Automated Data Synthesis
- 2026Scalable Token-Level Hallucination Detection in Large Language Models
- 2026Risk-aware Selective Prompting for Hallucination Mitigation in Large Vision-Language Models
- 2025LLM-CAS: Dynamic Neuron Perturbation for Real-Time Hallucination Correction
- 2025Learning to Reason for Hallucination Span Detection