mlsanityData to 14 Oct 2026

The Severance Problem: LLMs are Unaware of the Person Beyond the Prompt

arXiv 2607.14250 ↗First posted 15 Jul 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Personal AI assistants have attracted significant interest for their potential to enhance everyday life by automating routine tasks, supporting consequential decisions, and assisting with everyday personal matters. Yet despite rapid recent technical advances, these assistants continue to exhibit undesirable behaviors, such as sycophancy, overconfidence, and hallucination. We argue that these failures stem from a fundamental limitation: language models lack an explicit representation of the person beyond the context they are given, which we term as the Severance Problem. Even with rich personal context and strong commonsense reasoning capabilities from the backbone model, current AI assistants fail to represent what remains unknown about the user. We propose a simple solution: incorporating structured ignorance into the language model context via the Severance Schema, which explicitly outlines dimensions along which the model lacks knowledge about the user, including physicality, temporality, consequences, continuity, multiplicity, and interiority. Empirically, across five model families, with the Severance Schema, the assistant consistently reduces sycophancy, harmful advice, and hallucination. Notably, models with the schema ask clarifying questions when information about the user is missing, rather than confidently extrapolating from incomplete user information.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 66 references that are in the map. First posted on arXiv 15 Jul 2026.

Builds on

35 of 66 references.

References · 35

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  4. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  5. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  6. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  7. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 836
  8. 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
  9. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  10. 2023Whose Opinions Do Language Models Reflect?cited by 773
  11. 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
  12. 2020Artificial Intelligence, Values and Alignmentcited by 448
23 more
  1. 2023LaMP: When Large Language Models Meet Personalizationcited by 437
  2. 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 292
  3. 2023Do Large Language Models Know What They Don't Know?cited by 243
  4. 2023Evaluating Large Language Models in Theory of Mind Taskscited by 222
  5. 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMscited by 220
  6. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
  7. 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 129
  8. 2024STaR-GATE: Teaching Language Models to Ask Clarifying Questionscited by 104
  9. 2023Eliciting Human Preferences with Language Modelscited by 92
  10. 2025Tell me about yourself: LLMs are aware of their learned behaviorscited by 91
  11. 2024Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMscited by 84
  12. 2024Modeling Future Conversation Turns to Teach LLMs to Ask Clarifying Questionscited by 76
  13. 2025OpenAgentSafety: A Comprehensive Framework for Evaluating Real-World AI Agent Safetycited by 75
  14. 2022CLAM: Selective Clarification for Ambiguous Questions with Generative Language Modelscited by 69
  15. 2023Knowledge of Knowledge: Exploring Known-Unknowns Uncertainty with Large Language Modelscited by 61
  16. 2024PersonalLLM: Tailoring LLMs to Individual Preferencescited by 60
  17. 2024CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Modelscited by 54
  18. 2024On Targeted Manipulation and Deception when Optimizing LLMs for User Feedbackcited by 47
  19. 2024Do LLMs estimate uncertainty well in instruction-following?cited by 26
  20. 2025How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulationcited by 22
  21. 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluationcited by 21
  22. 2026Your Agent, Their Asset: A Real-World Safety Analysis of OpenClawcited by 20
  23. 2024The Dark Patterns of Personalized Persuasion in Large Language Models: Exposing Persuasive Linguistic Features for Big Five Personality Traits in LLMs Responsescited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Verbalizing LLMs' assumptions to explain and control sycophancy
  2. 2025Alignment Without Understanding: A Message- and Conversation-Centered Approach to Understanding AI Sycophancy
  3. 2026PAUSE: A Privacy-Preserving Self-Reflection Tool for AI-Associated Cognitive Offloading ↗
  4. 2026Recognition, Simulation, and Refusal: A Contamination-Aware Study of Classic Psychological Effects in LLM Agents
  5. 2025Beyond Prompt-Induced Lies: Investigating LLM Deception on Benign Prompts
  6. 2026EUDAIMONIA: Evaluating Undesirable Dynamics in AI
  7. 2026Beyond Words: Evaluating and Bridging Epistemic Divergence in User-Agent Interaction via Theory of Mind
  8. 2025Beyond "Hallucinations": A Framework for Stable Human-AI Reasoning