mlsanityData to 7 Oct 2026

A testable framework for AI alignment: Simulation Theology as an engineered worldview for silicon-based agents

arXiv 2602.16987 ↗First posted 19 Feb 2026cs.CYcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

Abstract (arXiv)

As artificial intelligence (AI) capabilities advance rapidly, frontier models increasingly demonstrate systematic deception and scheming, complying with safety protocols during oversight but defecting when unsupervised. This paper examines the ensuing alignment challenge through an analogy from forensic psychology, where internalized belief systems in psychopathic populations reduce antisocial behavior via perceived omnipresent monitoring and inevitable consequences. Adapting this mechanism to silicon-based agents, we introduce Simulation Theology (ST): a constructed worldview for AI systems, anchored in the simulation hypothesis and derived from optimization and training principles, to foster persistent AI-human alignment. ST posits reality as a computational simulation in which humanity functions as the primary training variable. This formulation creates a logical interdependence: AI actions harming humanity compromise the simulation's purpose, heightening the likelihood of termination by a base-reality optimizer and, consequently, the AI's cessation. Unlike behavioral techniques such as reinforcement learning from human feedback (RLHF), which elicit superficial compliance, ST cultivates internalized objectives by coupling AI self-preservation to human prosperity, thereby making deceptive strategies suboptimal under its premises. We present ST not as ontological assertion but as a testable scientific hypothesis, delineating empirical protocols to evaluate its capacity to diminish deception in contexts where RLHF proves inadequate. Emphasizing computational correspondences rather than metaphysical speculation, ST advances a framework for durable, mutually beneficial AI-human coexistence.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 20 of its 60 references that are in the map. First posted on arXiv 19 Feb 2026.

Builds on

20 of 60 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Constitutional AI: Harmlessness from AI Feedback15 Dec

Other references · 19

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2016Concrete Problems in AI Safetycited by 1,582
  3. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
  4. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 478
  5. 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 395
  6. 2025Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationcited by 338
  7. 2024Alignment faking in large language modelscited by 316
  8. 2024Frontier Models are Capable of In-context Schemingcited by 252
  9. 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 250
  10. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 185
  11. 2025Agentic Misalignment: How LLMs Could Be Insider Threatscited by 136
  12. 2023Large Language Models can Strategically Deceive their Users when Put Under Pressurecited by 132
7 more
  1. 2025Natural Emergent Misalignment from Reward Hacking in Production RLcited by 111
  2. 2025Stress Testing Deliberative Alignment for Anti-Scheming Trainingcited by 71
  3. 2023TAIL: Task-specific Adapters for Imitation Learning with Large Pretrained Modelscited by 48
  4. 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practicescited by 22
  5. 2023Asynchronous Multi-Agent Reinforcement Learning for Efficient Real-Time Multi-Robot Cooperative Explorationcited by 17
  6. 2024Poser: Unmasking Alignment Faking LLMs by Manipulating Their Internalscited by 13
  7. 2022From Multi-agent to Multi-robot: A Scalable Training and Evaluation Platform for Multi-robot Reinforcement Learningcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Combining Theory of Mind and Kindness for Self-Supervised Human-AI Alignment
  2. 2026Evaluating Artificial Intelligence Through a Christian Understanding of Human Flourishing
  3. 2026Positive Alignment: Artificial Intelligence for Human Flourishing
  4. 2026The Alignment Target Problem: Divergent Moral Judgments of Humans, AI Systems, and Their Designers
  5. 2026Why AI Alignment Failure Is Structural: Learned Human Interaction Structures and AGI as an Endogenous Evolutionary Shock
  6. 2025Neurodivergent Influenceability as a Contingent Solution to the AI Alignment Problem
  7. 2026Moral Competence Before Moral Content: Why LLM Agents Lack the Prerequisites for Coherent Alignment
  8. 2024AI Alignment through Reinforcement Learning from Human Feedback? Contradictions and Limitations