mlsanityData to 7 Oct 2026

Trust in One Round: Confidence Estimation for Large Language Models via Structural Signals

arXiv 2602.00977 ↗First posted 1 Feb 2026cs.CL cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly deployed in domains where errors carry high social, scientific, or safety costs. Yet standard confidence estimators, such as token likelihood, semantic similarity and multi-sample consistency, remain brittle under distribution shift, domain-specialised text, and compute limits. In this work, we present Structural Confidence, a single-pass, model-agnostic framework that enhances output correctness prediction based on multi-scale structural signals derived from a model's final-layer hidden-state trajectory. By combining spectral, local-variation, and global shape descriptors, our method captures internal stability patterns that are missed by probabilities and sentence embeddings. We conduct extensive, cross-domain evaluation across four heterogeneous benchmarks-FEVER (fact verification), SciFact (scientific claims), WikiBio-hallucination (biographical consistency), and TruthfulQA (truthfulness-oriented QA). Our Structural Confidence framework demonstrates strong performance compared with established baselines in terms of AUROC and AUPR. More importantly, unlike sampling-based consistency methods which require multiple stochastic generations and an auxiliary model, our approach uses a single deterministic forward pass, offering a practical basis for efficient, robust post-hoc confidence estimation in socially impactful, resource-constrained LLM applications.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 43 references that are in the map. First posted on arXiv 1 Feb 2026.

Builds on

23 of 43 references.

References · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2017On Calibration of Modern Neural Networkscited by 4,860
  4. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  5. 2022Language Models (Mostly) Know What They Knowcited by 1,783
  6. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  7. 2018On the Spectral Bias of Neural Networkscited by 1,321
  8. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
  9. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
  10. 2019Are Sixteen Heads Really Better than One?cited by 803
  11. 2018Predictive Uncertainty Estimation via Prior Networkscited by 555
  12. 2019Deep Ensembles: A Loss Landscape Perspectivecited by 438
11 more
  1. 2023A Survey of Hallucination in Large Foundation Modelscited by 365
  2. 2019Revealing the Dark Secrets of BERTcited by 300
  3. 2020On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselinescited by 254
  4. 2020Selective Question Answering under Domain Shiftcited by 228
  5. 2023Text Embeddings Reveal (Almost) As Much As Textcited by 189
  6. 2022Understanding The Robustness in Vision Transformerscited by 144
  7. 2021A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generationcited by 137
  8. 2023The geometry of hidden representations of large transformer modelscited by 108
  9. 2019BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performancecited by 89
  10. 2025Joint Evaluation of Answer and Reasoning Consistency for Hallucination Detection in Large Reasoning Modelscited by 13
  11. 2024Hidden Holes: topological aspects of language modelscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.