Probability vectors
A probability (row) vector x = (x1, … xn)
tells us where the walk is at any point
E.g., (000…1…000) means we’re in state i.
1
i
n
More generally, the vector x = (x1, … xn) means the
walk is in state i with probability xi.