mlsanityData to 14 Oct 2026

Convex-Analytic View of Query Selection for Safety Verification of Markov Decision Processes

arXiv 2610.17541 ↗First posted 13 Oct 2026math.OC cs.AI cs.LOcited by 0

Not on the map. Why?

Abstract (arXiv)

Safety verification of a Markov decision process (MDP) asks whether the probabilities of reaching several failure states jointly lie in a convex safe region under every scheduler. Watanabe and Unno (2026) prove safety by refining an outer approximation of the failure probabilities, where each query bounds a nonnegative weighted sum of the probabilities. Their rule selects weights by the largest Euclidean violation. We present a unified framework to measure violation in an explicitly chosen error unit: directions are scored by the support-function gap between the outer approximation and the safe region, normalized by the support function of the unit. We show that the maximal score, when positive, equals the smallest enlargement of the safe region in multiples of that unit that contains the outer approximation. The Euclidean unit recovers the earlier rule; two new rules are generated by the unit cube and the safe region itself. We experimentally evaluate how the choice of measurement rule affects the performance of safety verification for MDPs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 33 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

5 of 33 references.

References · 5

  1. 2020The Probabilistic Model Checker Stormcited by 66
  2. 2023A Practitioner's Guide to MDP Model Checking Algorithmscited by 10
  3. 2019Optimistic Value Iterationcited by 8
  4. 2018Sound Value Iterationcited by 6
  5. 2024Compositional Value Iteration with Pareto Cachingcited by 1

Built on by

Not cited yet.