mlsanityData to 14 Oct 2026

The Alignment Trap: Complexity Barriers

arXiv 2506.10304 ↗First posted 12 Jun 2025cs.AI cs.CC cs.CYcited by 2

Not on the map. Why?

Abstract (arXiv)

This paper argues that AI alignment is not merely difficult, but is founded on a fundamental logical contradiction. We first establish The Enumeration Paradox: we use machine learning precisely because we cannot enumerate all necessary safety rules, yet making ML safe requires examples that can only be generated from the very enumeration we admit is impossible. This paradox is then confirmed by a set of five independent mathematical proofs, or "pillars of impossibility." Our main results show that: (1) Geometric Impossibility: The set of safe policies has measure zero, a necessary consequence of projecting infinite-dimensional world-context requirements onto finite-dimensional models. (2) Computational Impossibility: Verifying a policy's safety is coNP-complete, even for non-zero error tolerances. (3) Statistical Impossibility: The training data required for safety (abundant examples of rare disasters) is a logical contradiction and thus unobtainable. (4) Information-Theoretic Impossibility: Safety rules contain more incompressible, arbitrary information than any feasible network can store. (5) Dynamic Impossibility: The optimization process for increasing AI capability is actively hostile to safety, as the gradients for the two objectives are generally anti-aligned. Together, these results demonstrate that the pursuit of safe, highly capable AI is not a matter of overcoming technical hurdles, but of confronting fundamental, interlocking barriers. The paper concludes by presenting a strategic trilemma that these impossibilities force upon the field. A formal verification of the core theorems in Lean4 is currently in progress.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 9 of its 30 references that are in the map. First posted on arXiv 12 Jun 2025.

Builds on

9 of 30 references.

References · 9

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  3. 2016Concrete Problems in AI Safetycited by 1,642
  4. 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 744
  5. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
  6. 2023AI Alignment: A Comprehensive Surveycited by 263
  7. 2022Inverse scaling can become U-shapedcited by 76
  8. 2024Adversarial Robustness Limits via Scaling-Law and Human-Alignment Studiescited by 38
  9. 2021Impossibility Results in AI: A Surveycited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.