Strong consistency of a modified maximum likelihood estimator for controlled Markov chains

[1]  V. Borkar,et al.  Adaptive control of Markov chains, I: Finite parameter set , 1979 .

[2]  P. Mandl,et al.  Estimation and control in Markov chains , 1974, Advances in Applied Probability.

[3]  Michel Loève,et al.  Probability Theory I , 1977 .