Parameter Synthesis in Markov Models: A Gentle Survey
Not on the map. Why?
Abstract (arXiv)
This paper surveys the analysis of parametric Markov models whose transitions are labelled with functions over a finite set of parameters. These models are symbolic representations of uncountable many concrete probabilistic models, each obtained by instantiating the parameters. We consider various analysis problems for a given logical specification varphi: do all parameter instantiations within a given region of parameter values satisfy varphi?, which instantiations satisfy varphi and which ones do not?, and how can all such instantiations be characterised, either exactly or approximately? We address theoretical complexity results and describe the main ideas underlying state-of-the-art algorithms that established an impressive leap over the last decade enabling the fully automated analysis of models with millions of states and thousands of parameters.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Jul 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 1; 2026: 4.
10 papers.
- 2024Robust Markov Decision Processes: A Place Where AI and Formal Methods Meetcited by 18
- 2024Imprecise Probabilities Meet Partial Observability: Game Semantics for Robust POMDPscited by 7
- 2023Efficient Sensitivity Analysis for Parametric Robust Markov Chainscited by 2
- 2024What should be observed for optimal reward in POMDPs?cited by 2
- 2025Data-Efficient Safe Policy Improvement Using Parametric Structurecited by 2
- 2023MM Algorithms to Estimate Parameters in Continuous-time Markov Chainscited by 0
- 2026Scaling Observation-aware Planning in Uncertain Domainscited by 0
- 2026Tensor Probabilistic Model Checking of Finite-Horizon Markov Chains (Extended Version)cited by 0
- 2026PAC Approximation and DIRECT Optimization for Parametric Markov Modelscited by 0
- 2026Supermartingale Certificates for Parametric MDPscited by 0
- 2026Supermartingale Certificates for Parametric MDPs11 Sep 2026
- 2026PAC Approximation and DIRECT Optimization for Parametric Markov Models3 Aug 2026
- 2026Tensor Probabilistic Model Checking of Finite-Horizon Markov Chains (Extended Version)1 Aug 2026
- 2026Scaling Observation-aware Planning in Uncertain Domains21 May 2026
- 2025Data-Efficient Safe Policy Improvement Using Parametric Structure21 Jul 2025
- 2024Robust Markov Decision Processes: A Place Where AI and Formal Methods Meet18 Nov 2024
- 2024What should be observed for optimal reward in POMDPs?17 May 2024
- 2024Imprecise Probabilities Meet Partial Observability: Game Semantics for Robust POMDPs8 May 2024
- 2023Efficient Sensitivity Analysis for Parametric Robust Markov Chains1 May 2023
- 2023MM Algorithms to Estimate Parameters in Continuous-time Markov Chains16 Feb 2023