Markov chains
¢
Clearly, for all i,
¢
Markov chains are abstractions of
random walks
A
C
P
ik:
_________________
_________________
_________________
B