PHRBench: A Behavioral Evaluation of Post-Hallucination Reasoning in LLMs
On the map: LLM reasoning → Hallucination detection and mitigation
Abstract (arXiv)
Hallucinated information can propagate through multi-stage LLM systems and become part of the context for subsequent reasoning. Existing studies of post-hallucination reasoning (PHR) mainly characterize changes in final outcomes and aggregate reasoning dynamics, leaving how models resolve hallucinated premises at the response level insufficiently understood. In this work, we introduce PHRBench, a controlled benchmark for behaviorally structured PHR across four domains and 18 large language models. PHRBench characterizes each reasoning trajectory independently of final-answer correctness through Hallucination Compliance, Hallucination Avoidance, and Heuristic Correction, and defines an insightful trajectory as successful correction that ultimately reaches the correct answer. Across 4820 controlled instances, we find that successful recovery remains relatively rare and is associated with more frequent belief updates along the reasoning trajectory. We further find that properties of the hallucinated prompt contain substantial predictive signal for successful recovery, with a lightweight predictor achieving an AUROC of 0.847. These findings provide a behavioral view of post-hallucination reasoning, characterizing how LLMs resolve erroneous context and when successful recovery is likely to occur.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Hallucination detection and mitigation, one of 17 directions in LLM reasoning. Builds on 21 of its 57 references that are in the map. First posted on arXiv 7 Oct 2026.
Builds on
21 of 57 references.
References · 21
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023Mistral 7Bcited by 3,065
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
9 more
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,096
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
- 2023How Language Model Hallucinations Can Snowballcited by 310
- 2025Why Language Models Hallucinatecited by 205
- 2025Rethinking External Slow-Thinking: From Snowball Errors to Probability of Correct Reasoningcited by 36
- 2026Hallucination Cascade: Analyzing Error Propagation in Multi-Agent LLM Systemscited by 12
- 2026Why Your Deep Research Agent Fails? On Hallucination Evaluation in Full Research Trajectorycited by 5
- 2026Collective Hallucination in Multi-Agent LLMs:Modeling and Defensecited by 5
- 2026MM-Snowball: Evaluating and Mitigating Hallucination Snowballing in Multimodal Multi-Turn Dialoguecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Triggering Hallucinations in LLMs: A Quantitative Study of Prompt-Induced Hallucination in Large Language Models
- 2025Auditing Meta-Cognitive Hallucinations in Reasoning Large Language Models
- 2026HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models
- 2025Chain-of-Thought Prompting Obscures Hallucination Cues in Large Language Models: An Empirical Evaluation
- 2026PRISM: Probing Reasoning, Instruction, and Source Memory in LLM Hallucinations
- 2025CIP: A Plug-and-Play Causal Prompting Framework for Mitigating Hallucinations under Long-Context Noise
- 2026Understanding the Role of Hallucination in Reinforcement Post-Training of Multimodal Reasoning Models
- 2025Joint Evaluation of Answer and Reasoning Consistency for Hallucination Detection in Large Reasoning Models