Approximate Abstractions of Markov Chains with Interval Decision Processes (Extended Version)
Not on the map. Why?
Abstract (arXiv)
This work introduces a new abstraction technique for reducing the state space of large, discrete-time labelled Markov chains. The abstraction leverages the semantics of interval Markov decision processes and the existing notion of approximate probabilistic bisimulation. Whilst standard abstractions make use of abstract points that are taken from the state space of the concrete model and which serve as representatives for sets of concrete states, in this work the abstract structure is constructed considering abstract points that are not necessarily selected from the states of the concrete model, rather they are a function of these states. The resulting model presents a smaller one-step bisimulation error, when compared to a like-sized, standard Markov chain abstraction. We outline a method to perform probabilistic model checking, and show that the computational complexity of the new method is comparable to that of standard abstractions based on approximate probabilistic bisimulations.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 3; 2023: 1.
4 papers.
- 2023Robust Control for Dynamical Systems With Non-Gaussian Noise via Formal Abstractionscited by 16
- 2022Verified Probabilistic Policies for Deep Reinforcement Learningcited by 6
- 2022Formal Controller Synthesis for Markov Jump Linear Systems with Uncertain Dynamicscited by 1
- 2022Mode Reduction for Markov Jump Systemscited by 0
- 2023Robust Control for Dynamical Systems With Non-Gaussian Noise via Formal Abstractions4 Jan 2023
- 2022Formal Controller Synthesis for Markov Jump Linear Systems with Uncertain Dynamics1 Dec 2022
- 2022Mode Reduction for Markov Jump Systems5 May 2022
- 2022Verified Probabilistic Policies for Deep Reinforcement Learning10 Jan 2022