Contains excellent and exact implementation of Markov Dec. Processes using Policy Iteration and Value Itreration from the book Perter Norvig for AI.-Contains excellent and exact implementation of Markov Dec. Processes using Policy Iteration and Value Itreration　from the book Perter Norvig for AI.