# Optimizing the Expected Mean Payoff in Energy Markov Decision Processes

arXiv: https://arxiv.org/abs/1607.00678 · HTML: https://mlsanity.com/paper/1607.00678/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Jul 2016.

## Built on by (most cited first, 1 of 1)

- [Shielding in Resource-Constrained Goal POMDPs](https://mlsanity.com/paper/2211.15349/) (2022)

## Abstract (arXiv)

Energy Markov Decision Processes (EMDPs) are finite-state Markov decision processes where each transition is assigned an integer counter update and a rational payoff. An EMDP configuration is a pair s(n), where s is a control state and n is the current counter value. The configurations are changed by performing transitions in the standard way. We consider the problem of computing a safe strategy (i.e., a strategy that keeps the counter non-negative) which maximizes the expected mean payoff.