# Finite-Horizon Constrained MDPs With Both Additive And Multiplicative Utilities

arXiv: https://arxiv.org/abs/2303.07834 · HTML: https://mlsanity.com/paper/2303.07834/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Mar 2023.

## Built on by (most cited first, 1 of 1)

- [What type of inference is planning?](https://mlsanity.com/paper/2406.17863/) (2024)

## Abstract (arXiv)

This paper considers the problem of finding a solution to the finite horizon constrained Markov decision processes (CMDP) where the objective as well as constraints are sum of additive and multiplicative utilities. Towards solving this, we construct another CMDP, with only additive utilities under a restricted set of policies, whose optimal value is equal to that of the original CMDP. Furthermore, we provide a finite dimensional bilinear program (BLP) whose value equals the CMDP value and whose solution provides the optimal policy. We also suggest an algorithm to solve this BLP.