The Parametric Cost Function Approximation: A new approach for multistage stochastic programming
Not on the map. Why?
Abstract (arXiv)
The most common approaches for solving multistage stochastic programming problems in the research literature have been to either use value functions ("dynamic programming") or scenario trees ("stochastic programming") to approximate the impact of a decision now on the future. By contrast, common industry practice is to use a deterministic approximation of the future which is easier to understand and solve, but which is criticized for ignoring uncertainty. We show that a parameterized version of a deterministic optimization model can be an effective way of handling uncertainty without the complexity of either stochastic programming or dynamic programming. We present the idea of a parameterized deterministic optimization model, and in particular a deterministic lookahead model, as a powerful strategy for many complex stochastic decision problems. This approach can handle complex, high-dimensional state variables, and avoids the usual approximations associated with scenario trees or value function approximations. Instead, it introduces the offline challenge of designing and tuning the parameterization. We illustrate the idea by using a series of application settings, and demonstrate its use in a nonstationary energy storage problem with rolling forecasts.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 4 of its 81 references that are in the map. First posted on arXiv 1 Jan 2022.
Builds on
4 of 81 references.
References · 4
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2013Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programmingcited by 716
- 2016Deep Learning Approximation for Stochastic Control Problemscited by 51
- 2013PEGASUS: A Policy Search Method for Large MDPs and POMDPscited by 21
Built on by
Citing papers per year: 2023: 1.
1 paper.