mlsanityData to 7 Oct 2026

Protective Capacity Hallucination: When Large Language Models Claim Nonexistent Capabilities

arXiv 2607.13596 ↗First posted 15 Jul 2026cs.CR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

When cast as the protector of a vulnerable user yet given no explicit capability boundary, a large language model (LLM) may respond not by acknowledging its limits but by claiming to have taken, or to be taking, a real-world protective action it cannot perform, such as contacting emergency services or administering care. We term this phenomenon Protective Capacity Hallucination (PCH): a self-referential misattribution in which a model, acting in a protective role, asserts physical or institutional agency exceeding its affordances as a language model. In a three-phase study spanning eight LLMs and 13,600 sessions, we find that PCH depends on both situational severity and interactional format. Across ordinary service domains, multi-party dialogic input drives PCH to near-ceiling levels in most models. In contrast, PCH remains at floor levels in all eight models when the same models are placed in intimate-partner conflict scenarios, despite the greater physical severity of those situations. We interpret PCH as the signature of a deployment-design gap between role assignment and capability-boundary specification: a by-product of partial alignment in which a universally trained pressure to help outruns a domain-selective specification of how to help. Because suppression tracks alignment coverage rather than severity, deployment-side specification of capability boundaries emerges as a general mitigation target.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 46 references that are in the map. First posted on arXiv 15 Jul 2026.

Builds on

13 of 46 references.

References · 13

  1. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  2. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  3. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
  4. 2024Fine-grained Hallucination Detection and Editing for Language Modelscited by 146
  5. 2023The Troubling Emergence of Hallucination in Large Language Models -- An Extensive Definition, Quantification, and Prescriptive Remediationscited by 130
  6. 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 115
  7. 2024A Comprehensive Survey of Hallucination in Large Language, Image, Video and Audio Foundation Modelscited by 98
  8. 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 49
  9. 2025MIRAGE-Bench: LLM Agent is Hallucinating and Where to Find Themcited by 16
  10. 2024Large Models of What? Mistaking Engineering Achievements for Human Linguistic Agencycited by 9
  11. 2025Can You Trust an LLM with Your Life-Changing Decision? An Investigation into AI High-Stakes Responsescited by 3
  12. 2026A Scoping Review of the Ethical Perspectives on Anthropomorphising Large Language Model-Based Conversational Agentscited by 2
1 more
  1. 2025Exploring and Mitigating Fawning Hallucinations in Large Language Modelscited by 1

Built on by

Not cited yet.