Incompleteness of AI Safety Verification via Kolmogorov Complexity
Not on the map. Why?
Abstract (arXiv)
Ensuring that artificial intelligence (AI) systems satisfy formal safety and policy constraints is a central challenge in safety-critical domains. While limitations of verification are often attributed to combinatorial complexity and model expressiveness, we show that they arise from intrinsic information-theoretic limits. We formalize policy compliance as a verification problem over encoded system behaviors and analyze it using Kolmogorov complexity. We prove an incompleteness result: for any fixed sound computably enumerable verifier, there exists a threshold beyond which true policy-compliant instances cannot be certified once their complexity exceeds that threshold. Consequently, no finite formal verifier can certify all policy-compliant instances of arbitrarily high complexity. This reveals a fundamental limitation of AI safety verification independent of computational resources, and motivates proof-carrying approaches that provide instance-level correctness guarantees.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 6 of its 15 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
6 of 15 references.
References · 6
- 2016Concrete Problems in AI Safetycited by 1,582
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
- 2016Safety Verification of Deep Neural Networkscited by 262
- 2025Robust AI Security and Alignment: A Sisyphean Endeavor?cited by 3
- 2026Hermes Seal: Zero-Knowledge Assurance for Autonomous Vehicle Communicationscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.