Where Fake Citations Are Made: Tracing Field-Level Hallucination to Specific Neurons in LLMs
Not on the map. Why?
Abstract (arXiv)
LLMs frequently generate fictitious yet convincing citations, often expressing high confidence even when the underlying reference is wrong. We study this failure across 9 models and 108{,}000 generated references, and find that author names fail far more often than other fields across all models and settings. Citation style has no measurable effect, while reasoning-oriented distillation degrades recall. Probes trained on one field transfer at near-chance levels to the others, suggesting that hallucination signals do not generalize across fields. Building on this finding, we apply elastic-net regularization with stability selection to neuron-level CETT values of Qwen2.5-32B-Instruct and identify a sparse set of field-specific hallucination neurons (FH-neurons). Causal intervention further confirms their role: amplifying these neurons increases hallucination, while suppressing them improves performance across fields, with larger gains in some fields. These results suggest a lightweight approach to detecting and mitigating citation hallucination using internal model signals alone.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 31 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
11 of 31 references.
References · 11
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Qwen Technical Reportcited by 3,344
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2023The Internal State of an LLM Knows When It's Lyingcited by 659
- 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 259
- 2025H-Neurons: On the Existence, Impact, and Origin of Hallucination-Associated Neurons in LLMscited by 22
- 2026GhostCite: A Large-Scale Analysis of Citation Validity in the Age of Large Language Modelscited by 11
- 2026Shifting Uncertainty to Critical Moments: Towards Reliable Uncertainty Quantification for VLA Modelcited by 7
Built on by
Not cited yet.