Permissive Controller Synthesis for Probabilistic Systems
Not on the map. Why?
Abstract (arXiv)
We propose novel controller synthesis techniques for probabilistic systems modelled using stochastic two-player games: one player acts as a controller, the second represents its environment, and probability is used to capture uncertainty arising due to, for example, unreliable sensors or faulty system components. Our aim is to generate robust controllers that are resilient to unexpected system changes at runtime, and flexible enough to be adapted if additional constraints need to be imposed. We develop a permissive controller synthesis framework, which generates multi-strategies for the controller, offering a choice of control actions to take at each time step. We formalise the notion of permissivity using penalties, which are incurred each time a possible control action is disallowed by a multi-strategy. Permissive controller synthesis aims to generate a multi-strategy that minimises these penalties, whilst guaranteeing the satisfaction of a specified system property. We establish several key results about the optimality of multi-strategies and the complexity of synthesising them. Then, we develop methods to perform permissive controller synthesis using mixed integer linear programming and illustrate their effectiveness on a selection of case studies.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Apr 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 1; 2024: 1; 2025: 4; 2026: 6.
17 papers.
Sort:
By area:
- 2022Safe Reinforcement Learning via Shielding under Partial Observabilitycited by 56
- 2022COOL-MC: A Comprehensive Tool for Reinforcement Learning and Model Checkingcited by 19
- 2022Targeted Adversarial Attacks on Deep Reinforcement Learning Policies via Model Checkingcited by 5
- 2024Probabilistic Model Checking of Stochastic Reinforcement Learning Policiescited by 5
- 2022Shielding in Resource-Constrained Goal POMDPscited by 4
- 2026Formally Verifying and Explaining Sepsis Treatment Policies with COOL-MCcited by 3
- 2025Co-Activation Graph Analysis of Safety-Verified and Explainable Deep Reinforcement Learning Policiescited by 2
- 2025Compositional shield synthesis for safe reinforcement learning in partial observabilitycited by 2
- 2026Robust Probabilistic Shielding for Safe Offline Reinforcement Learningcited by 2
- 2026Shields to Guarantee Probabilistic Safety in MDPscited by 2
- 2021Multi-Objective Controller Synthesis with Uncertain Human Preferencescited by 1
- 2023Deductive Controller Synthesis for Probabilistic Hyperpropertiescited by 1
5 more
- 2025Formal Verification of Noisy Quantum Reinforcement Learning Policiescited by 0
- 2025Translating the Rashomon Effect to Sequential Decision-Making Taskscited by 0
- 2026COOL-MC: Verifying and Explaining RL Policies for Platelet Inventory Managementcited by 0
- 2026COOL-MC: Verifying and Explaining RL Policies for Multi-bridge Network Maintenancecited by 0
- 2026Sample-Efficient Learning of Probabilistic Causes for Reachability in Markov Decision Processes with Probabilistic Guaranteescited by 0
- 2026Sample-Efficient Learning of Probabilistic Causes for Reachability in Markov Decision Processes with Probabilistic Guarantees29 Jun 2026
- 2026Shields to Guarantee Probabilistic Safety in MDPs11 May 2026
- 2026Robust Probabilistic Shielding for Safe Offline Reinforcement Learning11 May 2026
- 2026COOL-MC: Verifying and Explaining RL Policies for Multi-bridge Network Maintenance8 Mar 2026
- 2026COOL-MC: Verifying and Explaining RL Policies for Platelet Inventory Management2 Mar 2026
- 2026Formally Verifying and Explaining Sepsis Treatment Policies with COOL-MC16 Feb 2026
- 2025Translating the Rashomon Effect to Sequential Decision-Making Tasks19 Dec 2025
- 2025Formal Verification of Noisy Quantum Reinforcement Learning Policies1 Dec 2025
- 2025Compositional shield synthesis for safe reinforcement learning in partial observability15 Sep 2025
- 2025Co-Activation Graph Analysis of Safety-Verified and Explainable Deep Reinforcement Learning Policies6 Jan 2025
- 2024Probabilistic Model Checking of Stochastic Reinforcement Learning Policies27 Mar 2024
- 2023Deductive Controller Synthesis for Probabilistic Hyperproperties10 Jul 2023
5 more
- 2022Targeted Adversarial Attacks on Deep Reinforcement Learning Policies via Model Checking10 Dec 2022
- 2022Shielding in Resource-Constrained Goal POMDPs28 Nov 2022
- 2022COOL-MC: A Comprehensive Tool for Reinforcement Learning and Model Checking15 Sep 2022
- 2022Safe Reinforcement Learning via Shielding under Partial Observability2 Apr 2022
- 2021Multi-Objective Controller Synthesis with Uncertain Human Preferences10 May 2021
- 2024Probabilistic Model Checking of Stochastic Reinforcement Learning Policiescited by 5
- 2026Formally Verifying and Explaining Sepsis Treatment Policies with COOL-MCcited by 3
- 2025Co-Activation Graph Analysis of Safety-Verified and Explainable Deep Reinforcement Learning Policiescited by 2
- 2025Compositional shield synthesis for safe reinforcement learning in partial observabilitycited by 2
- 2025Formal Verification of Noisy Quantum Reinforcement Learning Policiescited by 0
- 2026COOL-MC: Verifying and Explaining RL Policies for Multi-bridge Network Maintenancecited by 0
- 2026COOL-MC: Verifying and Explaining RL Policies for Multi-bridge Network Maintenance8 Mar 2026
- 2026Formally Verifying and Explaining Sepsis Treatment Policies with COOL-MC16 Feb 2026
- 2025Formal Verification of Noisy Quantum Reinforcement Learning Policies1 Dec 2025
- 2025Compositional shield synthesis for safe reinforcement learning in partial observability15 Sep 2025
- 2025Co-Activation Graph Analysis of Safety-Verified and Explainable Deep Reinforcement Learning Policies6 Jan 2025
- 2024Probabilistic Model Checking of Stochastic Reinforcement Learning Policies27 Mar 2024
- 2022Safe Reinforcement Learning via Shielding under Partial Observabilitycited by 56
- 2022COOL-MC: A Comprehensive Tool for Reinforcement Learning and Model Checkingcited by 19
- 2022Targeted Adversarial Attacks on Deep Reinforcement Learning Policies via Model Checkingcited by 5
- 2022Shielding in Resource-Constrained Goal POMDPscited by 4
- 2026Shields to Guarantee Probabilistic Safety in MDPscited by 2
- 2021Multi-Objective Controller Synthesis with Uncertain Human Preferencescited by 1
- 2023Deductive Controller Synthesis for Probabilistic Hyperpropertiescited by 1
- 2025Translating the Rashomon Effect to Sequential Decision-Making Taskscited by 0
- 2026COOL-MC: Verifying and Explaining RL Policies for Platelet Inventory Managementcited by 0
- 2026Sample-Efficient Learning of Probabilistic Causes for Reachability in Markov Decision Processes with Probabilistic Guaranteescited by 0
- 2026Sample-Efficient Learning of Probabilistic Causes for Reachability in Markov Decision Processes with Probabilistic Guarantees29 Jun 2026
- 2026Shields to Guarantee Probabilistic Safety in MDPs11 May 2026
- 2026COOL-MC: Verifying and Explaining RL Policies for Platelet Inventory Management2 Mar 2026
- 2025Translating the Rashomon Effect to Sequential Decision-Making Tasks19 Dec 2025
- 2023Deductive Controller Synthesis for Probabilistic Hyperproperties10 Jul 2023
- 2022Targeted Adversarial Attacks on Deep Reinforcement Learning Policies via Model Checking10 Dec 2022
- 2022Shielding in Resource-Constrained Goal POMDPs28 Nov 2022
- 2022COOL-MC: A Comprehensive Tool for Reinforcement Learning and Model Checking15 Sep 2022
- 2022Safe Reinforcement Learning via Shielding under Partial Observability2 Apr 2022
- 2021Multi-Objective Controller Synthesis with Uncertain Human Preferences10 May 2021