This work describes the results and developments of recent work in the area of controlled Markov chains. The topics covered in this book include ergodic control in dynamic programming, adaptive control in the Kumar-Becker-Lin scheme and the discounted cost problem.