Steady State
¢ For any ergodic Markov chain, there is a
unique long-term visit rate for each state
l Over a long period, we’ll visit each state in
proportion to this rate
l It doesn’t matter where we start