mlsanityData to 14 Oct 2026

Analyzing Value Functions of States in Parametric Markov Chains

arXiv 2504.17020 ↗First posted 23 Apr 2025cs.LO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Parametric Markov chains (pMC) are used to model probabilistic systems with unknown or partially known probabilities. Although (universal) pMC verification for reachability properties is known to be coETR-complete, there have been efforts to approach it using potentially easier-to-check properties such as asking whether the pMC is monotonic in certain parameters. In this paper, we first reduce monotonicity to asking whether the reachability probability from a given state is never less than that of another given state. Recent results for the latter property imply an efficient algorithm to collapse same-value equivalence classes, which in turn preserves verification results and monotonicity. We implement our algorithm to collapse "trivial" equivalence classes in the pMC and show empirical evidence for the following: First, the collapse gives reductions in size for some existing benchmarks and significant reductions on some custom benchmarks; Second, the collapse speeds up existing algorithms to check monotonicity and parameter lifting, and hence can be used as a fast pre-processing step in practice.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 33 references that are in the map. First posted on arXiv 23 Apr 2025.

Builds on

8 of 33 references.

References · 8

  1. 2017A storm is Coming: A Modern Probabilistic Model Checkercited by 34
  2. 2017Parametric Markov Chains: PCTL Complexity and Fraction-free Gaussian Eliminationcited by 11
  3. 2020The Complexity of Reachability in Parametric Markov Decision Processescited by 10
  4. 2019Are Parametric Markov Chains Monotonic?cited by 6
  5. 2021Gradient-Descent for Randomized Controllers under Partial Observabilitycited by 6
  6. 2017Reachability in Augmented Interval Markov Chainscited by 4
  7. 2017The Complexity of Graph-Based Reductions for Reachability in Markov Decision Processescited by 4
  8. 2023Graph-Based Reductions for Parametric and Weighted MDPscited by 2

Built on by

Not cited yet.