Distance Is All You Need: Radial Dispersion for Uncertainty Estimation in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Detecting uncertainty in large language models (LLMs) is essential for building reliable systems, yet many existing approaches are overly complex and depend on brittle semantic clustering or access to model internals. We introduce Radial Dispersion Score (RDS), a simple, training-free, fully model-agnostic uncertainty metric that measures the radial dispersion of sampled generations in embedding space. Specifically, given N sampled generations embedded on the unit hypersphere, RDS computes the total l1 distance from the empirical centroid, i.e., the mean embedding, providing a direct geometric signal of semantic variability. A lightweight probability-weighted variant further incorporates the model's own token probabilities when available, outperforming nine recent state-of-the-art baselines. Moreover, RDS naturally extends to effective per-sample uncertainty estimates that complement probability- and consistency-based methods while remaining lightweight for practical use. Across four challenging free-form question-answering datasets and four LLMs, our metrics achieve state-of-the-art hallucination detection performance, while remaining robust and scalable with respect to sample size and embedding choice. These results highlight the practical value of RDS and its contribution toward improving the trustworthiness of LLMs. Code is publicly available at https://github.com/manhitv/RDS.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 30 of its 38 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
30 of 38 references.
References · 30
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
18 more
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
- 2017Crowdsourcing Multiple Choice Science Questionscited by 742
- 2023The Falcon Series of Open Language Modelscited by 526
- 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 317
- 2023Generating with Confidence: Uncertainty Quantification for Black-box Large Language Modelscited by 286
- 2023Universal Self-Consistency for Large Language Model Generationcited by 198
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 182
- 2024Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic Similaritiescited by 156
- 2020Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Taskscited by 136
- 2023Decomposing Uncertainty for Large Language Models through Input Clarification Ensemblingcited by 113
- 2022Looking for a Needle in a Haystack: A Comprehensive Study of Hallucinations in Neural Machine Translationcited by 60
- 2024Integrate the Essence and Eliminate the Dross: Fine-Grained Self-Consistency for Free-Form Language Generationcited by 21
- 2025Geometric Uncertainty for Detecting and Correcting Hallucinations in LLMscited by 12
- 2021Understanding Neural Networks with Logarithm Determinant Entropy Estimatorcited by 10
- 2023Representation biases in sentence transformerscited by 7
- 2025Simple Yet Effective: An Information-Theoretic Approach to Multi-LLM Uncertainty Quantificationcited by 6
- 2025Probabilities Are All You Need: A Probability-Only Approach to Uncertainty Estimation in Large Language Modelscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.