# MultiGain: A controller synthesis tool for MDPs with multiple mean-payoff objectives

arXiv: https://arxiv.org/abs/1501.03093 · HTML: https://mlsanity.com/paper/1501.03093/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Jan 2015.

## Built on by (most cited first, 3 of 3)

- [LTL-Constrained Steady-State Policy Synthesis](https://mlsanity.com/paper/2105.14894/) (2021)
- [MULTIGAIN 2.0: MDP controller synthesis for multiple mean-payoff, LTL and steady-state constraints](https://mlsanity.com/paper/2305.16752/) (2023)
- [Multiple Mean-Payoff Optimization under Local Stability Constraints](https://mlsanity.com/paper/2412.13369/) (2024)

## Abstract (arXiv)

We present MultiGain, a tool to synthesize strategies for Markov decision processes (MDPs) with multiple mean-payoff objectives. Our models are described in PRISM, and our tool uses the existing interface and simulator of PRISM. Our tool extends PRISM by adding novel algorithms for multiple mean-payoff objectives, and also provides features such as (i)~generating strategies and exploring them for simulation, and checking them with respect to other properties; and (ii)~generating an approximate Pareto curve for two mean-payoff objectives. In addition, we present a new practical algorithm for the analysis of MDPs with multiple mean-payoff objectives under memoryless strategies.