Stochastic control; structure of sequential decision processes; stochastic inventory models; recursive computation of optimal policies; discrete parameter finite Markov decision processes; various optimality criteria; computation by policy improvement and other methods; existence of optimal stationary policies; stopping-rule problems; examples from financial management, maintenance and reliability, search, queuing and shortest path.

Prerequisite: MTHSC 803