mlsanityData to 7 Oct 2026

Incompleteness of AI Safety Verification via Kolmogorov Complexity

arXiv 2604.04876 ↗First posted 6 Apr 2026cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Ensuring that artificial intelligence (AI) systems satisfy formal safety and policy constraints is a central challenge in safety-critical domains. While limitations of verification are often attributed to combinatorial complexity and model expressiveness, we show that they arise from intrinsic information-theoretic limits. We formalize policy compliance as a verification problem over encoded system behaviors and analyze it using Kolmogorov complexity. We prove an incompleteness result: for any fixed sound computably enumerable verifier, there exists a threshold beyond which true policy-compliant instances cannot be certified once their complexity exceeds that threshold. Consequently, no finite formal verifier can certify all policy-compliant instances of arbitrarily high complexity. This reveals a fundamental limitation of AI safety verification independent of computational resources, and motivates proof-carrying approaches that provide instance-level correctness guarantees.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 6 of its 15 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

6 of 15 references.

References · 6

  1. 2016Concrete Problems in AI Safetycited by 1,582
  2. 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
  3. 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
  4. 2016Safety Verification of Deep Neural Networkscited by 262
  5. 2025Robust AI Security and Alignment: A Sisyphean Endeavor?cited by 3
  6. 2026Hermes Seal: Zero-Knowledge Assurance for Autonomous Vehicle Communicationscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.