The Situated Identity Test: Distinguishing Persistent Cognitive Identity from Persona Imitation
Not on the map. Why?
Abstract (arXiv)
Large language models can convincingly adopt personas, recall past dialogues, and weave rich autobiographies. Yet this conversational eloquence conceals a fundamental attribution problem: looking the part does not mean having lived the life. Two individuals can share identical public profiles--the same age, hometown, occupation, and personality traits--while possessing entirely distinct private histories, relationships, and acquired skills. When conditioned solely on that shared profile, an agent lacks the information required to determine which lineage is correct. We introduce the Situated Identity Test (SIT), an architecture-independent framework that evaluates whether an agent's behavior is functionally attributable to a specific developmental lineage. Grounded identity requires both appropriate knowledge of recorded experiences and appropriate ignorance of ungrounded ones, bounded by what the identity has actually acquired rather than what its underlying foundation model knows. We prove that any policy conditioned solely on a compressed profile is bounded by an average situated validity of at most 1/m across m colliding life histories on lineage-discriminative queries (at most 50% for paired lineages). We instantiate this framework in SITBench, an evaluation suite designed for 25 profile-collision pairs (50 distinct lineages) across 10,000 planned probes and nine architectural configurations. Supported by an open-source reference implementation, deterministic test fixtures, and empirical pilot evaluations on frontier foundation models (GPT-5.6 Sol and Claude Opus 5), we formalize the failure modes of persona prompting under profile collision and provide an assurance harness for evaluating episodic continuity, structured state, and epistemic boundaries.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 34 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
10 of 34 references.
References · 10
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 339
- 2023Role-Play with Large Language Modelscited by 294
- 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 179
- 2026Memory-Driven Role-Playing: Evaluation and Enhancement of Persona Knowledge Utilization in LLMscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.