# Robust Optimal Control Using Conditional RiskMappings in Infinite Horizon

arXiv: https://arxiv.org/abs/1806.00983 · HTML: https://mlsanity.com/paper/1806.00983/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Jun 2018.

## Built on by (most cited first, 2 of 2)

- [Markov Decision Processes under Model Uncertainty](https://mlsanity.com/paper/2206.06109/) (2022)
- [Q-Learning under Finite Model Uncertainty](https://mlsanity.com/paper/2407.04259/) (2024)

## Abstract (arXiv)

We use one-step conditional risk mappings to formulate a risk averse version of a total cost problem on a controlled Markov process in discrete time infinite horizon. The nonnegative one step costs are assumed to be lower semi-continuous but not necessarily bounded. We derive the conditions for the existence of the optimal strategies and solve the problem explicitly by giving the robust dynamic programming equations under very mild conditions. We further give an ε-optimal approximation to the solution and illustrate our algorithm in two examples of optimal investment and LQ regulator problems.