Markov Chain Nur Aini Masruroh. Discrete Time Markov Chains Consider a stochastic process {Xn, n=0, 1, 2, …} that takes on a finite or countable number.
