Do Hallucination Neurons Generalize? Evidence from Cross-Domain Transfer in LLMs
Not on the map. Why?
Abstract (arXiv)
Recent work identifies a sparse set of "hallucination neurons" (H-neurons), less than 0.1% of feed-forward network neurons, that reliably predict when large language models will hallucinate. These neurons are identified on general-knowledge question answering and shown to generalize to new evaluation instances. We ask a natural follow-up question: do H-neurons generalize across knowledge domains? Using a systematic cross-domain transfer protocol across 6 domains (general QA, legal, financial, science, moral reasoning, and code vulnerability) and 5 open-weight models (3B to 8B parameters), we find they do not. Classifiers trained on one domain's H-neurons achieve AUROC 0.783 within-domain but only 0.563 when transferred to a different domain (delta = 0.220, p < 0.001), a degradation consistent across all models tested. Our results suggest that hallucination is not a single mechanism with a universal neural signature, but rather involves domain-specific neuron populations that differ depending on the knowledge type being queried. This finding has direct implications for the deployment of neuron-level hallucination detectors, which must be calibrated per domain rather than trained once and applied universally.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 38 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
17 of 38 references.
References · 17
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2020Aligning AI With Shared Human Valuescited by 723
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2024Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2cited by 394
- 2023A Survey of Hallucination in Large Foundation Modelscited by 368
- 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
5 more
- 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
- 2021When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Datasetcited by 201
- 2024HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detectioncited by 99
- 2025H-Neurons: On the Existence, Impact, and Origin of Hallucination-Associated Neurons in LLMscited by 22
- 2025Cross-Layer Attention Probing for Fine-Grained Hallucination Detectioncited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.