Reasoning Denoiser: Denoising Reasoning Traces for Hallucination Detection in Large Reasoning Models
On the map: LLM reasoning → Hallucination detection and mitigation
Abstract (arXiv)
Large reasoning models (LRMs) generate long reasoning traces before producing final answers. While these traces may contain useful signals for hallucination detection, harnessing them is non-trivial because long trajectories often include noisy steps that obscure the cues relevant to truthfulness assessment. In this paper, we identify two prevalent forms of reasoning noises, i.e., irrelevant steps and repetitive steps, and show that both substantially degrade hallucination detection performance. Existing confidence-based scores and naive embedding-based filtering fail to reliably separate noisy from informative steps. To address this challenge, we propose REDE, a novel learning framework for denoising reasoning traces for hallucination detection. Specifically, REDE leverages final-answer attention as an automatic supervision signal to shape the step-level representation space, yielding refined embeddings in which noisy steps can be reliably identified and filtered. REDE can be readily plugged into diverse hallucination detectors by operating on the filtered reasoning trajectory after removing noisy steps. Extensive experiments on multiple reasoning benchmarks show that REDE consistently improves detection performance over competitive baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Hallucination detection and mitigation, one of 17 directions in LLM reasoning. Builds on 23 of its 73 references that are in the map. First posted on arXiv 24 Jul 2026.
Builds on
23 of 73 references.
Closest ancestors · 2
Same direction, newest first
- 2026Streaming Hallucination Detection in Long Chain-of-Thought Reasoning5 Jan
- 2025Are Reasoning Models More Prone to Hallucination?29 May
Other references · 21
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2024OpenAI o1 System Cardcited by 1,220
- 2023A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generationcited by 202
- 2025Deep Think with Confidencecited by 199
- 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learningcited by 187
- 2025Thought Anchors: Which LLM Reasoning Steps Matter?cited by 126
- 2025CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratingscited by 109
9 more
- 2025Deconstructing Long Chain-of-Thought: A Structured Reasoning Optimization Framework for Long CoT Distillationcited by 39
- 2025Pruning the Unsurprising: Efficient LLM Reasoning via First-Token Surprisalcited by 32
- 2025Not All Tokens Are What You Need In Thinkingcited by 20
- 2025DeepPrune: Parallel Scaling without Inter-trace Redundancycited by 10
- 2025What Defines Good Reasoning in LLMs? Dissecting Reasoning Steps with Multi-Aspect Evaluationcited by 10
- 2026Thinking by Subtraction: Confidence-Driven Contrastive Decoding for LLM Reasoningcited by 5
- 2025Beyond Token Length: Step Pruner for Efficient and Accurate Reasoning in Large Language Modelscited by 4
- 2026DRIFT: Detecting Representational Inconsistencies for Factual Truthfulnesscited by 4
- 2025Not all tokens are created equal: Perplexity Attention Weighted Networks for AI generated text detectioncited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Detection and Mitigation of Hallucination in Large Reasoning Models: A Mechanistic Perspective
- 2025Joint Evaluation of Answer and Reasoning Consistency for Hallucination Detection in Large Reasoning Models
- 2026Sanity Checks for Long-Form Hallucination Detection
- 2026Harnessing Reasoning Trajectories for Hallucination Detection via Answer-agreement Representation Shaping
- 2025HARP: Hallucination Detection via Reasoning Subspace Projection
- 2026Logical Consistency as a Bridge: Improving LLM Hallucination Detection via Label Constraint Modeling between Responses and Self-Judgments
- 2026Scalable Token-Level Hallucination Detection in Large Language Models
- 2025Reasoning's Razor: Reasoning Improves Accuracy but Can Hurt Recall at Critical Operating Points in Safety and Hallucination Detection