mlsanityData to 14 Oct 2026

Single-Pass Uncertainty Heads for Claim-Level Hallucination Detection in Persian Medical Language Models

arXiv 2610.03482 ↗First posted 2 Oct 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Hallucination detection is particularly important for medical language models, but repeated-sampling approaches are computationally expensive. A faster alternative is a single-pass uncertainty head that predicts hallucination risk from a frozen generator's internal signals. Existing uncertainty heads consume backbone-specific features and tokenization, motivating adaptation when the backbone or language changes. We study two Persian medical models, Gaokerena-V and Gaokerena-R, on a 168-question Iranian medical entrance examination. Across five generations per question, Gaokerena-V produces the same option on only 14 questions and Gaokerena-R on 37, compared with 168 for Med-Gemma, indicating substantial response variability in the Gaokerena models. We therefore adapt the LLM Uncertainty Head (LUH) framework to these models and construct two paired claim-level hallucination datasets directly in Persian, with 1,600 responses per backbone. Lightweight heads are trained on frozen-backbone attention maps and token probabilities. On held-out test splits, the heads achieve PR-AUCs of 0.4820 and 0.4652, corresponding to 2.30 and 2.66 times their respective random baselines, and ROC-AUCs of 0.7852 and 0.7810. The resulting detectors require neither retrieval nor repeated sampling at inference.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 14 references that are in the map. First posted on arXiv 2 Oct 2026.

Builds on

11 of 14 references.

References · 11

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  3. 2025MedGemma Technical Reportcited by 436
  4. 2024Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontiercited by 129
  5. 2025A Survey of Uncertainty Estimation Methods on Large Language Modelscited by 62
  6. 2024RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMscited by 43
  7. 2025Position: Uncertainty Quantification Needs Reassessment for Large-language Model Agentscited by 32
  8. 2025A Head to Predict and a Head to Question: Pre-trained Uncertainty Quantification Heads for Hallucination Detection in LLM Outputscited by 21
  9. 2024Multilingual Arbitrage: Optimizing Data Pools to Accelerate Multilingual Progresscited by 7
  10. 2025Leveraging Online Data to Enhance Medical Knowledge in a Small Persian Language Modelcited by 4
  11. 2025Enhancing Reasoning Skills in Small Persian Medical Language Models Can Outperform Large-Scale Data Trainingcited by 2

Built on by

Not cited yet.