Parameter Synthesis for Markov Models: Faster Than Ever
Not on the map. Why?
Abstract (arXiv)
We propose a simple technique for verifying probabilistic models whose transition probabilities are parametric. The key is to replace parametric transitions by nondeterministic choices of extremal values. Analysing the resulting parameter-free model using off-the-shelf means yields (refinable) lower and upper bounds on probabilities of regions in the parameter space. The technique outperforms the existing analysis of parametric Markov chains by several orders of magnitude regarding both run-time and scalability. Its beauty is its applicability to various probabilistic models. It in particular provides the first sound and feasible method for performing parameter synthesis of Markov decision processes.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Feb 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 1; 2023: 1; 2024: 1; 2025: 1; 2026: 4.
12 papers.
- 2024Robust Markov Decision Processes: A Place Where AI and Formal Methods Meetcited by 18
- 2021Convex Optimization for Parameter Synthesis in MDPscited by 8
- 2022Abstraction-Refinement for Hierarchical Probabilistic Modelscited by 5
- 2021Fine-Tuning the Odds in Bayesian Networkscited by 3
- 2021Inductive Synthesis for Probabilistic Programs Reaches New Horizonscited by 2
- 2025Best-Effort Policies for Robust Markov Decision Processescited by 1
- 2026Robust Parameter Learning for Uncertain MDPscited by 1
- 2021Adversarial Robustness Verification and Attack Synthesis in Stochastic Systemscited by 0
- 2023Finding an ε-close Variation of Parameters in Bayesian Networkscited by 0
- 2026Robustness Analysis of POMDP Policies to Observation Perturbationscited by 0
- 2026PAC Approximation and DIRECT Optimization for Parametric Markov Modelscited by 0
- 2026Supermartingale Certificates for Parametric MDPscited by 0
- 2026Supermartingale Certificates for Parametric MDPs11 Sep 2026
- 2026PAC Approximation and DIRECT Optimization for Parametric Markov Models3 Aug 2026
- 2026Robust Parameter Learning for Uncertain MDPs2 May 2026
- 2026Robustness Analysis of POMDP Policies to Observation Perturbations23 Apr 2026
- 2025Best-Effort Policies for Robust Markov Decision Processes11 Aug 2025
- 2024Robust Markov Decision Processes: A Place Where AI and Formal Methods Meet18 Nov 2024
- 2023Finding an ε-close Variation of Parameters in Bayesian Networks17 May 2023
- 2022Abstraction-Refinement for Hierarchical Probabilistic Models6 Jun 2022
- 2021Adversarial Robustness Verification and Attack Synthesis in Stochastic Systems5 Oct 2021
- 2021Convex Optimization for Parameter Synthesis in MDPs30 Jun 2021
- 2021Fine-Tuning the Odds in Bayesian Networks29 May 2021
- 2021Inductive Synthesis for Probabilistic Programs Reaches New Horizons29 Jan 2021