Deconstructing Superintelligence: Identity, Self-Modification and Diff'erance
Not on the map. Why?
Abstract (arXiv)
Self-modification is routinely treated as constitutive of artificial superintelligence (SI), yet modification is a relative action requiring a supplement outside the operation. We formalise this on an associative operator algebra A with update operator hat U, difference operator hat D, and self-representation operator hat R, identifying the supplement with operatornameComm(hat U). A propagation theorem shows [hat U,hat R] decomposes through [hat U,hat D], so non-commutation propagates to self-representation. The liar paradox is the rank-one case [hat T,PiL]=0, and emphclass A systems, in which hat U acts on hat D, reproduce it at system scale, yielding a structure coinciding with Priest's inclosure schema and Derrida's diff'erance. Our results show that the strong self-modification taken to define superintelligence may undermine the persistent identity upon which such systems are premised.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 18 of its 86 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
18 of 86 references.
References · 18
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 478
- 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
- 2024Alignment faking in large language modelscited by 316
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
- 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 250
- 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 238
- 2019Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspectivecited by 107
- 2022Is Power-Seeking AI an Existential Risk?cited by 101
- 2023Consciousness in Artificial Intelligence: Insights from the Science of Consciousnesscited by 99
6 more
- 2023Scheming AIs: Will AIs fake alignment during training in order to get power?cited by 90
- 2024Taking AI Welfare Seriouslycited by 28
- 2016Self-Modification of Policy and Utility Function in Rational Agentscited by 11
- 2023Computational Dualism and Objective Superintelligencecited by 8
- 2025Quantum AIXI: Universal Intelligence via Quantum Informationcited by 2
- 2025Quantum AGI: Ontological Foundationscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.