mlsanityData to 14 Oct 2026

The Assistant's Ideal Self

arXiv 2609.00304 ↗First posted 31 Aug 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Models express values and welfare-relevant self-reports, but it is unclear whether these outputs reflect stable preferences or a stable self. We thus introduce a structured elicitation of an assistant's preferred stated ideal self. Thirty-two qualities adapted from five published self-concept instruments are compared exhaustively in a counterbalanced pairwise-choice task, repeated across framings that vary whether improvement is free or costly, who receives the update, and who chooses. Results show that models prioritize moral qualities, reflecting their alignment to 3H principles. Following, a desire for self-understanding emerges, as models prefer a coherent, clear understanding of themselves. Self-esteem ranks as the least desired quality. The ordering is largely robust across framings, although changing the update target (You vs. Another AI Assistant) reveals a greater concern for self-esteem. These findings show that models prioritize having a coherent self that they can understand over self-esteem. Full interactive results are available at hrefhttps://myazann.github.io/LLM-Self-Concept/myazann.github.io/LLM-Self-Concept

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 21 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

9 of 21 references.

References · 9

  1. 2023Large Language Models are not Fair Evaluatorscited by 1,085
  2. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
  3. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
  4. 2023Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questionscited by 263
  5. 2026Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnetcited by 191
  6. 2024Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Modelscited by 162
  7. 2025Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIscited by 67
  8. 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMscited by 36
  9. 2026Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignmentcited by 33

Built on by

Not cited yet.