Examples in Markov decision processes - v. 2

This title provides 80 examples illustrating the theory of controlled discrete-time Markov processes.

Except for applications of the theory of real-life problems like stock exchange, queues, gambling, optimal search etc., the main attention is paid to counter-intuitive, unexpected properties of optimization problems.