mlsanityData to 14 Oct 2026

Reality Monitoring in Large Language Models: Self-Knowledge That Transforms with Conversation Memory

arXiv 2607.23927 ↗First posted 27 Jul 2026cs.AI cs.CL cs.CYcited by 0

Not on the map. Why?

Abstract (arXiv)

A conversational AI that cannot tell its own output from what a user said will treat its own mistakes as user-provided facts. In humans, this capacity is called reality monitoring, and its failures are linked to hallucinations, delusions, and confabulation, yet whether LLMs possess it remains untested. Here we show, across two experiments and six LLMs, that source attribution depends on how conversational memory is structured: ceiling accuracy for self-generated content under minimal memory demands reverses to a fragile external-item advantage once episodic delay removes that shortcut. Feedback exposes two failures: in some models, internal and external judgments swap; in others, accuracy improves while confidence decouples from correctness, dissociations invisible to existing benchmarks. Across models, this pattern implicates active, not aggregate, parameter count. This suggests that as AI systems take on autonomous, multi-turn roles, evaluating what they know is not enough: tracking where that knowledge came from may matter equally.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 77 references that are in the map. First posted on arXiv 27 Jul 2026.

Builds on

19 of 77 references.

References · 19

  1. 2022Emergent Abilities of Large Language Modelscited by 2,512
  2. 2019Language Models as Knowledge Bases?cited by 1,936
  3. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  4. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
  5. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
  6. 2023Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questionscited by 263
  7. 2023Linearity of Relation Decoding in Transformer Language Modelscited by 200
  8. 2025Large Language Models Often Know When They Are Being Evaluatedcited by 128
  9. 2024Looking Inward: Language Models Can Learn About Themselves by Introspectioncited by 113
  10. 2024How Do Large Language Models Acquire Factual Knowledge During Pretraining?cited by 90
  11. 2025Large Language Models Hallucination: A Comprehensive Surveycited by 49
  12. 2025Probing and Steering Evaluation Awareness of Language Modelscited by 35
7 more
  1. 2025Does It Make Sense to Speak of Introspection in Large Language Models?cited by 25
  2. 2026Interpretability without actionability: mechanistic methods cannot correct language model errors despite near-perfect internal representationscited by 17
  3. 2025Because we have LLMs, we Can and Should Pursue Agentic Interpretabilitycited by 16
  4. 2025Evidence for Limited Metacognition in LLMscited by 12
  5. 2024Assessing Episodic Memory in LLMs with Sequence Order Recall Taskscited by 10
  6. 2026MIRROR: A Hierarchical Benchmark for Metacognitive Calibration in Large Language Modelscited by 6
  7. 2026The Metacognitive Monitoring Battery: A Cross-Domain Benchmark for LLM Self-Monitoringcited by 5

Built on by

Not cited yet.