mlsanityData to 7 Oct 2026

Confidence-Aware Routing for Large Language Model Reliability Enhancement: A Multi-Signal Approach to Pre-Generation Hallucination Mitigation

arXiv 2510.01237 ↗First posted 23 Sep 2025cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Large Language Models suffer from hallucination, generating plausible yet factually incorrect content. Current mitigation strategies focus on post-generation correction, which is computationally expensive and fails to prevent unreliable content generation. We propose a confidence-aware routing system that proactively assesses model uncertainty before generation and redirects queries based on estimated reliability. Our approach combines three complementary signals: semantic alignment between internal representations and reference embeddings, internal convergence analysis across model layers, and learned confidence estimation. The unified confidence score determines routing to four pathways: local generation for high confidence, retrieval-augmented generation for medium confidence, larger models for low confidence, and human review for very low confidence. Evaluation on knowledge-intensive QA benchmarks demonstrates significant improvements in hallucination detection (0.74 vs. 0.42 baseline) while reducing computational costs by 40% compared to post-hoc methods. The F1 score improves from 0.61 to 0.82 with low false positive rates (0.09). This paradigm shift from reactive correction to proactive assessment offers a computationally efficient approach to LLM reliability enhancement.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 23 Sep 2025.

Builds on

23 of 31 references.

References · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  6. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  7. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  8. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  9. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  10. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  11. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  12. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
11 more
  1. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  2. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  3. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  4. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  5. 2015Weight Uncertainty in Neural Networkscited by 554
  6. 2022Memory-Based Model Editing at Scalecited by 443
  7. 2024Reducing hallucination in structured outputs via Retrieval-Augmented Generationcited by 92
  8. 2023A Survey on Uncertainty Quantification Methods for Deep Learningcited by 78
  9. 2024Hallucination Detection: Robustly Discerning Reliable Answers in Large Language Modelscited by 44
  10. 2024Large Language Model Confidence Estimation via Black-Box Accesscited by 14
  11. 2024Confidence Estimation for LLM-Based Dialogue State Trackingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Theoretical Foundations and Mitigation of Hallucination in Large Language Models
  2. 2025Monitoring Decoding: Mitigating Hallucination via Evaluating the Factuality of Partial Response during Generation
  3. 2025Mathematical Analysis of Hallucination Dynamics in Large Language Models: Uncertainty Quantification, Advanced Decoding, and Principled Mitigation
  4. 2026Alleviating Hallucination in Reasoning Tasks with Training-Free Uncertainty-Guided Steering
  5. 2025OnionEval: An Unified Evaluation of Fact-conflicting Hallucination for Small-Large Language Models
  6. 2026Domain-Specific Hallucination Detection in Large Language Models
  7. 2026Predictive Coding and Information Bottleneck for Hallucination Detection in Large Language Models
  8. 2026Hallucination Detection and Mitigation in Large Language Models