

Definitions:
We saw two ways that we can try to find a steadystate vector:
We studied three examples in this module. In two of the examples, the Markov chain converged to the steadystate vector. In the third example, we saw a Markov chain that did not converge. However, the Markov matrix did have a steadystate vector.

