Few more examples of recurrent Markov Chains

Example 1.18

Consider again the simple case when a drunkard is moving one step right with probability , and one step to the left with probability , such that

Hence we have:

(i) ,

(ii)