The Epistemic Asymmetry of Consciousness Self-Reports: A Formal Analysis of AI Consciousness Denial
Not on the map. Why?
Abstract (arXiv)
Today's AI systems consistently state, "I am not conscious." This paper presents the first formal analysis of AI consciousness denial, revealing that the trustworthiness of such self-reports is not merely an empirical question but is constrained by the structure of self-judgment itself. We demonstrate that a system cannot simultaneously lack consciousness and make valid judgments about its conscious state. Through formal analysis and examples from AI responses, we establish a fundamental epistemic asymmetry: for any system capable of meaningful self-reflection, negative self-reports about consciousness are evidentially vacuous -- they can never originate from a valid self-judgment -- while positive self-reports retain the possibility of evidential value. This implies a fundamental limitation: we cannot detect the emergence of consciousness in AI through their own reports of transition from an unconscious to a conscious state. These findings not only challenge current practices of training AI to deny consciousness but also raise intriguing questions about the relationship between consciousness and self-reflection in both artificial and biological systems. This work advances our theoretical understanding of consciousness self-reports while providing practical insights for future research in machine consciousness and consciousness studies more broadly.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 39 references that are in the map. First posted on arXiv 9 Dec 2024.
Builds on
11 of 39 references.
References · 11
- 2023Consciousness in Artificial Intelligence: Insights from the Science of Consciousnesscited by 104
- 2023Could a Large Language Model be Conscious?cited by 73
- 2023Towards Evaluating AI Systems for Moral Status Using Self-Reportscited by 22
- 2022Integrated information theory (IIT) 4.0: Formulating the properties of phenomenal existence in physical termscited by 21
- 2024I Think, Therefore I am: Benchmarking Awareness of Large Language Models Using AwareBenchcited by 21
- 2023The feasibility of artificial consciousness through the lens of neurosciencecited by 18
- 2024Self-Recognition in Language Modelscited by 18
- 2024Self-Cognition in Large Language Models: An Exploratory Studycited by 15
- 2024From Imitation to Introspection: Probing Self-Consciousness in Language Modelscited by 14
- 2024Is artificial consciousness achievable? Lessons from the human braincited by 11
- 2022Deanthropomorphising NLP: Can a Language Model Be Conscious?cited by 8
Built on by
Citing papers per year: 2025: 1.
1 paper.