mlsanityData to 7 Oct 2026

Tethered Reasoning: Decoupling Entropy from Hallucination in Quantized LLMs via Manifold Steering

arXiv 2602.17691 ↗First posted 6 Feb 2026cs.LG cs.CLcited by 1

On the map: LLM reasoning → Hallucination detection and mitigation

also in 1 more
Abstract (arXiv)

Quantized language models face a fundamental dilemma: low sampling temperatures yield repetitive, mode-collapsed outputs, while high temperatures (T > 2.0) cause trajectory divergence and semantic incoherence. We present HELIX, a geometric framework that decouples output entropy from hallucination by tethering hidden-state trajectories to a pre-computed truthfulness manifold. HELIX computes a Unified Truth Score (UTS) combining token-level semantic entropy with Mahalanobis distance from the manifold. When UTS indicates trajectory divergence, graduated steering vectors redirect activations toward structurally coherent regions while affecting only 0.2-2.5% of tokens. On 4-bit quantized Granite 4.0 H Small (32B/9B active, hybrid Mamba-Transformer): GSM8K maintains 88.84% accuracy at T = 3.0 (2.81pp degradation from T = 0.5); MMLU maintains 72.49% across 14,042 questions (1.24pp degradation). This demonstrates that high-temperature hallucination is primarily trajectory divergence rather than semantic collapse. Notably, steering the sparse Transformer attention layers (~10% of layers) is sufficient to correct drift in the Mamba-2 state-space formulation. Geometric tethering reveals a previously-masked High-Entropy Creative Reservoir. At T > 2.0, steered outputs exhibit 5-20% idea duplication versus 70-80% at conservative settings. Cross-architecture validation (Qwen3-30B-A3B MOE) confirms this phenomenon is architecture-independent, with 46.7% higher unique concept generation. HELIX acts as a syntax tether, enabling exploration of semantic diversity without violating the logical backbone required for valid output. This enables Multi-Temperature Synthesis, generating 200% more unique concepts than single-temperature inference.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Hallucination detection and mitigation, one of 17 directions in LLM reasoning. Builds on 24 of its 31 references that are in the map. First posted on arXiv 6 Feb 2026.

Builds on

24 of 31 references.

References · 24

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  7. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  8. 2016Pointer Sentinel Mixture Modelscited by 2,992
  9. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  10. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  11. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  12. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
12 more
  1. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  2. 2022Language Models (Mostly) Know What They Knowcited by 1,783
  3. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  4. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
  5. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 733
  6. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 673
  7. 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
  8. 2024The Effect of Sampling Temperature on Problem Solving in Large Language Modelscited by 168
  9. 2024Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputscited by 148
  10. 2025SALT: Steering Activations towards Leakage-free Thinking in Chain of Thoughtcited by 11
  11. 2025In-Distribution Steering: Balancing Control and Coherence in Language Model Generationcited by 8
  12. 2026RISER: Orchestrating Latent Reasoning Skills for Adaptive Activation Steeringcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Where Does Reasoning Break? Step-Level Hallucination Detection via Hidden-State Transport Geometry
  2. 2026The Energy of Falsehood: Detecting Hallucinations via Diffusion Model Likelihoods
  3. 2025Confidence-Aware Routing for Large Language Model Reliability Enhancement: A Multi-Signal Approach to Pre-Generation Hallucination Mitigation
  4. 2025Mathematical Analysis of Hallucination Dynamics in Large Language Models: Uncertainty Quantification, Advanced Decoding, and Principled Mitigation
  5. 2026OSCAR: Orchestrated Self-verification and Cross-path Refinement
  6. 2025Hallucination Detection via Internal States and Structured Reasoning Consistency in Large Language Models
  7. 2025D2HScore: Reasoning-Aware Hallucination Detection via Semantic Breadth and Depth Analysis in LLMs
  8. 2026Anchored Confabulation: Partial Evidence Non-Monotonically Amplifies Confident Hallucination in LLMs