mlsanityData to 7 Oct 2026

Breaking the Illusion of Identity in LLM Tooling

arXiv 2604.07398 ↗First posted 8 Apr 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) in research and development toolchains produce output that triggers attribution of agency and understanding -- a cognitive illusion that degrades verification behavior and trust calibration. No existing mitigation provides a systematic, deployable constraint set for output register. This paper proposes seven output-side rules, each targeting a documented linguistic mechanism, and validates them empirically. In 780 two-turn conversations (constrained vs. default register, 30 tasks, 13 replicates, 1560 API calls), anthropomorphic markers dropped from 1233 to 33 (>97% reduction, p < 0.001), outputs were 49% shorter by word count, and adapted AnthroScore confirmed the shift toward machine register (-1.94 vs. -0.96, p < 0.001). The rules are implemented as a configuration-file system prompt requiring no model modification; validation uses a single model (Claude Sonnet 4). Output quality under the constrained register was not evaluated. The mechanism is extensible to other domains.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 42 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

19 of 42 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  5. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  7. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  8. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  9. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  10. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  11. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
  12. 2024The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructionscited by 441
7 more
  1. 2022Talking About Large Language Modelscited by 174
  2. 2024What Large Language Models Know and What People Think They Knowcited by 109
  3. 2022Human heuristics for AI-generated language are flawedcited by 104
  4. 2023Mirages: On Anthropomorphism in Dialogue Systemscited by 30
  5. 2024AnthroScore: A Computational Linguistic Measure of Anthropomorphismcited by 27
  6. 2025A Taxonomy of Linguistic Expressions That Contribute To Anthropomorphism of Language Technologiescited by 14
  7. 2025Dehumanizing Machines: Mitigating Anthropomorphic Behaviors in Text Generation Systemscited by 11

Built on by

Not cited yet.