The Probabilistic Model Checker Storm
Not on the map. Why?
Abstract (arXiv)
We present the probabilistic model checker Storm. Storm supports the analysis of discrete- and continuous-time variants of both Markov chains and Markov decision processes. Storm has three major distinguishing features. It supports multiple input languages for Markov models, including the JANI and PRISM modeling languages, dynamic fault trees, generalized stochastic Petri nets, and the probabilistic guarded command language. It has a modular set-up in which solvers and symbolic engines can easily be exchanged. Its Python API allows for rapid prototyping by encapsulating Storm's fast and scalable algorithms. This paper reports on the main features of Storm and explains how to effectively use them. A description is provided of the main distinguishing functionalities of Storm. Finally, an empirical evaluation of different configurations of Storm on the QComp 2019 benchmark set is presented.
Key facts. Cited by 66 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 9; 2023: 11; 2024: 13; 2025: 14; 2026: 15.
66 papers.
Sort:
By area:
- 2022Safe Reinforcement Learning via Shielding under Partial Observabilitycited by 56
- 2023Closed-loop Analysis of Vision-based Autonomous Systems: A Case Studycited by 18
- 2024Robust Markov Decision Processes: A Place Where AI and Formal Methods Meetcited by 18
- 2022LCRL: Certified Policy Synthesis via Logically-Constrained Reinforcement Learningcited by 11
- 2023Solving Long-run Average Reward Robust MDPs via Stochastic Gamescited by 10
- 2025We'll Fix it in Post: Improving Text-to-Video Generation with Neuro-Symbolic Feedbackcited by 10
- 2021Distillation of RL Policies with Formal Guarantees via Variational Abstraction of Markov Decision Processes (Technical Report)cited by 9
- 2024Safety-Oriented Pruning and Interpretation of Reinforcement Learning Policiescited by 9
- 2024Neuro-Symbolic Evaluation of Text-to-Video Models using Formal Verificationcited by 9
- 2025NeuS-QA: Grounding Long-Form Video Understanding in Temporal Logic and Neuro-Symbolic Reasoningcited by 8
- 2024Pessimistic Iterative Planning with RNNs for Robust POMDPscited by 7
- 2022Abstraction-Refinement for Hierarchical Probabilistic Modelscited by 6
38 more
- 2024Unifying Qualitative and Quantitative Safety Verification of DNN-Controlled Systemscited by 6
- 2024Enhancing RL Safety with Counterfactual LLM Reasoningcited by 6
- 2022Under-Approximating Expected Total Rewards in POMDPscited by 5
- 2022Discrete-Event Controller Synthesis for Autonomous Systems with Deep-Learning Perception Componentscited by 5
- 2022Targeted Adversarial Attacks on Deep Reinforcement Learning Policies via Model Checkingcited by 5
- 2024Probabilistic Model Checking of Stochastic Reinforcement Learning Policiescited by 5
- 20241-2-3-Go! Policy Synthesis for Parameterized Markov Decision Processes via Decision-Tree Learning and Generalizationcited by 5
- 2024Learning Explainable and Better Performing Representations of POMDP Strategiescited by 4
- 2024Playing Games with your PET: Extending the Partial Exploration Tool to Stochastic Gamescited by 4
- 2021Leaving Goals on the Pitch: Evaluating Decision Making in Soccercited by 3
- 2025Turn-based Multi-Agent Reinforcement Learning Model Checkingcited by 3
- 2025Scenario-based Compositional Verification of Autonomous Systems with Neural Perceptioncited by 3
- 2026Formally Verifying and Explaining Sepsis Treatment Policies with COOL-MCcited by 3
- 2021Task-Guided Inverse Reinforcement Learning Under Partial Informationcited by 2
- 2023Efficient Sensitivity Analysis for Parametric Robust Markov Chainscited by 2
- 2023Graph-Based Reductions for Parametric and Weighted MDPscited by 2
- 2023Analyzing Intentional Behavior in Autonomous Agents under Uncertaintycited by 2
- 2023Learning-Based Approaches to Predictive Monitoring with Conformal Statistical Guaranteescited by 2
- 2024What should be observed for optimal reward in POMDPs?cited by 2
- 2025Co-Activation Graph Analysis of Safety-Verified and Explainable Deep Reinforcement Learning Policiescited by 2
- 2025Compositional shield synthesis for safe reinforcement learning in partial observabilitycited by 2
- 2025Automated Generation of MDPs Using Logic Programming and LLMs for Robotic Applicationscited by 2
- 2026RT-NeuS: Towards Real-Time Neuro-Symbolic Video Understanding via Adaptive Temporal Verificationcited by 2
- 2026Shields to Guarantee Probabilistic Safety in MDPscited by 2
- 2022Task-Guided IRL in POMDPs that Scalescited by 1
- 2023Deductive Controller Synthesis for Probabilistic Hyperpropertiescited by 1
- 2023Formally-Sharp DAgger for MCTS: Lower-Latency Monte Carlo Tree Search using Data Aggregation with Formal Methodscited by 1
- 2025Accelerating Policy Synthesis in Large-Scale MDPs via Hierarchical Adaptive Refinementcited by 1
- 2025Bounded PCTL Model Checking of Large Language Model Outputscited by 1
- 2025Verifying Memoryless Sequential Decision-making of Large Language Modelscited by 1
- 2026Easy-to-Use Shielding for Reinforcement Learningcited by 1
- 2021Efficient Strategy Synthesis for MDPs with Resource Constraintscited by 0
- 2022On the Verification of Belief Programscited by 0
- 2022Formally Verified Solution Methods for Infinite-Horizon Markov Decision Processescited by 0
- 2023Wasserstein Auto-encoded MDPs: Formal Verification of Efficiently Distilled RL Policies with Many-sided Guaranteescited by 0
- 2023Finding an ε-close Variation of Parameters in Bayesian Networkscited by 0
- 2023Improving Probabilistic Bisimulation for MDPs Using Machine Learningcited by 0
- 2024Expectation vs. Reality: Towards Verification of Psychological Gamescited by 0
50 most cited of 66 All 66 (JSON)
- 2026Convex-Analytic View of Query Selection for Safety Verification of Markov Decision Processes13 Oct 2026
- 2026Automated Testing of LLM-Based Post Hoc Explainers Using Model Checking as an Oracle31 Aug 2026
- 2026PAC Approximation and DIRECT Optimization for Parametric Markov Models3 Aug 2026
- 2026Tensor Probabilistic Model Checking of Finite-Horizon Markov Chains (Extended Version)1 Aug 2026
- 2026Property-driven Causal Abstractions for Markov Decision Processes29 Jul 2026
- 2026dtControl2+varepsilon: Trading Optimality for Explainability in MDPs via Decision Trees28 Jul 2026
- 2026Explainably Safe Reinforcement Learning3 Jun 2026
- 2026Easy-to-Use Shielding for Reinforcement Learning2 Jun 2026
- 2026Scaling Observation-aware Planning in Uncertain Domains21 May 2026
- 2026Synthesizing POMDP Policies: Sampling Meets Model-checking via Learning14 May 2026
- 2026Shields to Guarantee Probabilistic Safety in MDPs11 May 2026
- 2026COOL-MC: Verifying and Explaining RL Policies for Multi-bridge Network Maintenance8 Mar 2026
38 more
- 2026COOL-MC: Verifying and Explaining RL Policies for Platelet Inventory Management2 Mar 2026
- 2026RT-NeuS: Towards Real-Time Neuro-Symbolic Video Understanding via Adaptive Temporal Verification26 Feb 2026
- 2026Formally Verifying and Explaining Sepsis Treatment Policies with COOL-MC16 Feb 2026
- 2025Translating the Rashomon Effect to Sequential Decision-Making Tasks19 Dec 2025
- 2025Formal Verification of Noisy Quantum Reinforcement Learning Policies1 Dec 2025
- 2025Automated Generation of MDPs Using Logic Programming and LLMs for Robotic Applications28 Nov 2025
- 2025Verifying Memoryless Sequential Decision-making of Large Language Models8 Oct 2025
- 2025LogSTOP: Temporal Scores over Prediction Sequences for Matching and Retrieval7 Oct 2025
- 2025Bounded PCTL Model Checking of Large Language Model Outputs23 Sep 2025
- 2025NeuS-QA: Grounding Long-Form Video Understanding in Temporal Logic and Neuro-Symbolic Reasoning22 Sep 2025
- 2025Compositional shield synthesis for safe reinforcement learning in partial observability15 Sep 2025
- 2025Accelerating Policy Synthesis in Large-Scale MDPs via Hierarchical Adaptive Refinement21 Jun 2025
- 2025Value Iteration with Guessing for Markov Chains and Markov Decision Processes10 May 2025
- 2025Scenario-based Compositional Verification of Autonomous Systems with Neural Perception29 Apr 2025
- 2025We'll Fix it in Post: Improving Text-to-Video Generation with Neuro-Symbolic Feedback24 Apr 2025
- 2025Turn-based Multi-Agent Reinforcement Learning Model Checking6 Jan 2025
- 2025Co-Activation Graph Analysis of Safety-Verified and Explainable Deep Reinforcement Learning Policies6 Jan 2025
- 2024Neuro-Symbolic Evaluation of Text-to-Video Models using Formal Verification22 Nov 2024
- 2024Using Formal Models, Safety Shields and Certified Control to Validate AI-Based Train Systems21 Nov 2024
- 2024Robust Markov Decision Processes: A Place Where AI and Formal Methods Meet18 Nov 2024
- 2024Expectation vs. Reality: Towards Verification of Psychological Games8 Nov 2024
- 20241-2-3-Go! Policy Synthesis for Parameterized Markov Decision Processes via Decision-Tree Learning and Generalization23 Oct 2024
- 2024Safety-Oriented Pruning and Interpretation of Reinforcement Learning Policies16 Sep 2024
- 2024Enhancing RL Safety with Counterfactual LLM Reasoning16 Sep 2024
- 2024Pessimistic Iterative Planning with RNNs for Robust POMDPs16 Aug 2024
- 2024What should be observed for optimal reward in POMDPs?17 May 2024
- 2024Playing Games with your PET: Extending the Partial Exploration Tool to Stochastic Games6 May 2024
- 2024Unifying Qualitative and Quantitative Safety Verification of DNN-Controlled Systems2 Apr 2024
- 2024Probabilistic Model Checking of Stochastic Reinforcement Learning Policies27 Mar 2024
- 2024Learning Explainable and Better Performing Representations of POMDP Strategies15 Jan 2024
- 2023Solving Long-run Average Reward Robust MDPs via Stochastic Games21 Dec 2023
- 2023Learning-Based Approaches to Predictive Monitoring with Conformal Statistical Guarantees4 Dec 2023
- 2023Formally-Sharp DAgger for MCTS: Lower-Latency Monte Carlo Tree Search using Data Aggregation with Formal Methods15 Aug 2023
- 2023Improving Probabilistic Bisimulation for MDPs Using Machine Learning30 Jul 2023
- 2023Deductive Controller Synthesis for Probabilistic Hyperproperties10 Jul 2023
- 2023Analyzing Intentional Behavior in Autonomous Agents under Uncertainty4 Jul 2023
- 2023Finding an ε-close Variation of Parameters in Bayesian Networks17 May 2023
- 2023Graph-Based Reductions for Parametric and Weighted MDPs9 May 2023
50 newest of 66 All 66 (JSON)
- 2024Safety-Oriented Pruning and Interpretation of Reinforcement Learning Policiescited by 9
- 2024Unifying Qualitative and Quantitative Safety Verification of DNN-Controlled Systemscited by 6
- 2024Probabilistic Model Checking of Stochastic Reinforcement Learning Policiescited by 5
- 2026Formally Verifying and Explaining Sepsis Treatment Policies with COOL-MCcited by 3
- 2025Co-Activation Graph Analysis of Safety-Verified and Explainable Deep Reinforcement Learning Policiescited by 2
- 2025Compositional shield synthesis for safe reinforcement learning in partial observabilitycited by 2
- 2026Easy-to-Use Shielding for Reinforcement Learningcited by 1
- 2025Formal Verification of Noisy Quantum Reinforcement Learning Policiescited by 0
- 2026COOL-MC: Verifying and Explaining RL Policies for Multi-bridge Network Maintenancecited by 0
- 2026Explainably Safe Reinforcement Learningcited by 0
- 2026Explainably Safe Reinforcement Learning3 Jun 2026
- 2026Easy-to-Use Shielding for Reinforcement Learning2 Jun 2026
- 2026COOL-MC: Verifying and Explaining RL Policies for Multi-bridge Network Maintenance8 Mar 2026
- 2026Formally Verifying and Explaining Sepsis Treatment Policies with COOL-MC16 Feb 2026
- 2025Formal Verification of Noisy Quantum Reinforcement Learning Policies1 Dec 2025
- 2025Compositional shield synthesis for safe reinforcement learning in partial observability15 Sep 2025
- 2025Co-Activation Graph Analysis of Safety-Verified and Explainable Deep Reinforcement Learning Policies6 Jan 2025
- 2024Safety-Oriented Pruning and Interpretation of Reinforcement Learning Policies16 Sep 2024
- 2024Unifying Qualitative and Quantitative Safety Verification of DNN-Controlled Systems2 Apr 2024
- 2024Probabilistic Model Checking of Stochastic Reinforcement Learning Policies27 Mar 2024
- 2021Task-Guided Inverse Reinforcement Learning Under Partial Informationcited by 2
- 2022Task-Guided IRL in POMDPs that Scalescited by 1
- 2022Task-Guided IRL in POMDPs that Scales30 Dec 2022
- 2021Task-Guided Inverse Reinforcement Learning Under Partial Information28 May 2021
- 2022Safe Reinforcement Learning via Shielding under Partial Observabilitycited by 56
- 2023Closed-loop Analysis of Vision-based Autonomous Systems: A Case Studycited by 18
- 2024Robust Markov Decision Processes: A Place Where AI and Formal Methods Meetcited by 18
- 2022LCRL: Certified Policy Synthesis via Logically-Constrained Reinforcement Learningcited by 11
- 2023Solving Long-run Average Reward Robust MDPs via Stochastic Gamescited by 10
- 2025We'll Fix it in Post: Improving Text-to-Video Generation with Neuro-Symbolic Feedbackcited by 10
- 2021Distillation of RL Policies with Formal Guarantees via Variational Abstraction of Markov Decision Processes (Technical Report)cited by 9
- 2024Neuro-Symbolic Evaluation of Text-to-Video Models using Formal Verificationcited by 9
- 2024Pessimistic Iterative Planning with RNNs for Robust POMDPscited by 7
- 2022Abstraction-Refinement for Hierarchical Probabilistic Modelscited by 6
- 2022Under-Approximating Expected Total Rewards in POMDPscited by 5
- 2022Discrete-Event Controller Synthesis for Autonomous Systems with Deep-Learning Perception Componentscited by 5
12 most cited of 51 All 51 (JSON)
- 2026Convex-Analytic View of Query Selection for Safety Verification of Markov Decision Processes13 Oct 2026
- 2026Automated Testing of LLM-Based Post Hoc Explainers Using Model Checking as an Oracle31 Aug 2026
- 2026PAC Approximation and DIRECT Optimization for Parametric Markov Models3 Aug 2026
- 2026Tensor Probabilistic Model Checking of Finite-Horizon Markov Chains (Extended Version)1 Aug 2026
- 2026Property-driven Causal Abstractions for Markov Decision Processes29 Jul 2026
- 2026dtControl2+varepsilon: Trading Optimality for Explainability in MDPs via Decision Trees28 Jul 2026
- 2026Scaling Observation-aware Planning in Uncertain Domains21 May 2026
- 2026Synthesizing POMDP Policies: Sampling Meets Model-checking via Learning14 May 2026
- 2026Shields to Guarantee Probabilistic Safety in MDPs11 May 2026
- 2026COOL-MC: Verifying and Explaining RL Policies for Platelet Inventory Management2 Mar 2026
- 2025Translating the Rashomon Effect to Sequential Decision-Making Tasks19 Dec 2025
- 2025Automated Generation of MDPs Using Logic Programming and LLMs for Robotic Applications28 Nov 2025
12 newest of 51 All 51 (JSON)