Stochastic Dynamic Programming Models and Applications

Abstract We start with a short comparison of deterministic and stochastic dynamic programming models followed by a deterministic dynamic programming example and several extensions, which convert it to a stochastic one. We then present several applications and highlight some properties of stochastic dynamic programming formulations.