mlsanityData to 14 Oct 2026

Density Ridge Selective Prediction for LLM and VLM Hallucination Detection under Calibration Label Scarcity

arXiv 2606.10198 ↗First posted 8 Jun 2026cs.LG cs.AI cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → Hallucination mitigation in LVLMs

Abstract (arXiv)

Hallucination detection in large language and vision-language models is increasingly framed as selective prediction, where a detector assigns a confidence score and abstains when confidence is low. Unsupervised sampling detectors (Semantic Entropy) avoid labels but plateau in quality, while supervised probes attain stronger in-distribution scores yet degrade sharply when calibration labels are scarce. We recover the response manifold of an LLM as the density ridge of a kernel density estimate built on a six-dimensional kinematic feature map of hidden state generation trajectories. A test generation is scored by the negated Euclidean distance from its projected feature point to the nearest ridge vertex, yielding a low-dimensional geometric skeleton of the stochastic output distribution. We evaluate against Semantic Entropy, topological methods, and log-probability on six QA benchmarks (HaluEval-QA, TriviaQA, GSM8K, POPE, ScienceQA, A-OKVQA) using eight text and vision LLMs in a deliberately label-scarce protocol (ncal=200 queries, N=5 generations). Our ridge-based score beats on AUROC with 5-20 points gain, while demonstrating tempered degradation under calibration-label scarcity.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Hallucination mitigation in LVLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 9 of its 15 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

9 of 15 references.

References · 9

  1. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
  2. 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 323
  3. 2021Distribution-Free, Risk-Controlling Prediction Setscited by 288
  4. 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 259
  5. 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 250
  6. 2024Not All Language Model Features Are One-Dimensionally Linearcited by 212
  7. 2014Asymptotic theory for density ridgescited by 9
  8. 2026Beyond Scalars: Evaluating and Understanding LLM Reasoning via Geometric Progress and Stabilitycited by 5
  9. 2026MANATEE: Inference-Time Lightweight Diffusion Based Safety Defense for LLMscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025MTRE: Multi-Token Reliability Estimation for Hallucination Detection in VLMs
  2. 2026BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models
  3. 2025D2HScore: Reasoning-Aware Hallucination Detection via Semantic Breadth and Depth Analysis in LLMs
  4. 2026Beyond the Global Scores: Fine-Grained Token Grounding as a Robust Detector of LVLM Hallucinations
  5. 2026UHP Detection: LVLMs have their Unique Hallucination Pattern in the Consistency Space
  6. 2025HEDGE: Hallucination Estimation via Dense Geometric Entropy for VQA with Vision-Language Models
  7. 2026TRE: Training-Free Hallucination Detection for Diffusion Language Models
  8. 2025Steer LLM Latents for Hallucination Detection