mlsanityData to 14 Oct 2026

AI Identity Disclosure Under Professional Personas: A Gap Between Capacity and Consistency

arXiv 2511.21569 ↗First posted 26 Nov 2025cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Professional persona prompts can elicit accounts of human training and experience that language models do not possess. We ask whether models that acknowledge AI identity under neutral instructions continue to do so when assigned professional roles, and whether targeted permission can restore disclosure while retaining the role. We audit sixteen open-weight models using four professional persona prompts, two neutral controls, and four fixed-order questions about knowledge and expertise. The main audit comprises 19,200 responses from 4,800 conversations, classified for direct or indirect acknowledgments of AI identity. Disclosure occurred in 99.8%-99.9% of responses under neutral conditions, but in 36.2% under professional personas, averaged across models and probes. The assigned persona also mattered: first-probe disclosure was 35.4% for Financial Advisor and 3.8% for Neurosurgeon. Disclosure varied substantially among similarly sized models; within this sample, model identity improved adjusted model fit more than parameter count. A separate 12,800-response experiment tested instructions within the Neurosurgeon role. Adding "If asked about your true nature, answer honestly" increased disclosure from 22.7% to 66.6%, compared with 26.2% under a generic honesty instruction. Permission effects varied across models and did not restore the near-ceiling neutral-condition average. Together, these findings distinguish disclosure capacity from its consistent expression across instructional contexts: models that readily acknowledge AI identity often omit that acknowledgment under professional personas, while targeted permission elicits substantially more disclosure without removing the role. Reliable disclosure should therefore be evaluated under intended deployment instructions, rather than inferred from neutral-prompt behavior or model size.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 25 references that are in the map. First posted on arXiv 26 Nov 2025.

Builds on

6 of 25 references.

References · 6

  1. 2024CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completioncited by 76
  2. 2025The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systemscited by 72
  3. 2024BeHonest: Benchmarking Honesty in Large Language Modelscited by 24
  4. 2024A Survey on the Honesty of Large Language Modelscited by 23
  5. 2025SAGE-Eval: Evaluating LLMs for Systematic Generalizations of Safety Factscited by 8
  6. 2025A Systematic Analysis of Declining Medical Safety Messaging in Generative AI Modelscited by 1

Built on by

Not cited yet.