Density Ridge Selective Prediction for LLM and VLM Hallucination Detection under Calibration Label Scarcity
On the map: Multimodal LLMs / vision-language models → Hallucination mitigation in LVLMs
Abstract (arXiv)
Hallucination detection in large language and vision-language models is increasingly framed as selective prediction, where a detector assigns a confidence score and abstains when confidence is low. Unsupervised sampling detectors (Semantic Entropy) avoid labels but plateau in quality, while supervised probes attain stronger in-distribution scores yet degrade sharply when calibration labels are scarce. We recover the response manifold of an LLM as the density ridge of a kernel density estimate built on a six-dimensional kinematic feature map of hidden state generation trajectories. A test generation is scored by the negated Euclidean distance from its projected feature point to the nearest ridge vertex, yielding a low-dimensional geometric skeleton of the stochastic output distribution. We evaluate against Semantic Entropy, topological methods, and log-probability on six QA benchmarks (HaluEval-QA, TriviaQA, GSM8K, POPE, ScienceQA, A-OKVQA) using eight text and vision LLMs in a deliberately label-scarce protocol (ncal=200 queries, N=5 generations). Our ridge-based score beats on AUROC with 5-20 points gain, while demonstrating tempered degradation under calibration-label scarcity.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Hallucination mitigation in LVLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 9 of its 15 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
9 of 15 references.
References · 9
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
- 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 288
- 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 259
- 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 250
- 2024Not All Language Model Features Are One-Dimensionally Linearcited by 212
- 2014Asymptotic theory for density ridgescited by 9
- 2026Beyond Scalars: Evaluating and Understanding LLM Reasoning via Geometric Progress and Stabilitycited by 5
- 2026MANATEE: Inference-Time Lightweight Diffusion Based Safety Defense for LLMscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025MTRE: Multi-Token Reliability Estimation for Hallucination Detection in VLMs
- 2026BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models
- 2025D2HScore: Reasoning-Aware Hallucination Detection via Semantic Breadth and Depth Analysis in LLMs
- 2026Beyond the Global Scores: Fine-Grained Token Grounding as a Robust Detector of LVLM Hallucinations
- 2026UHP Detection: LVLMs have their Unique Hallucination Pattern in the Consistency Space
- 2025HEDGE: Hallucination Estimation via Dense Geometric Entropy for VQA with Vision-Language Models
- 2026TRE: Training-Free Hallucination Detection for Diffusion Language Models
- 2025Steer LLM Latents for Hallucination Detection