Module 1:Concepts of Random walks, Markov Chains, Markov Processes
  Lecture 3:Markov Chains
 

Example 1.20
Can you say something of three dimensional random walk of the form, which is illustrated below, in the case when we have

(i) Probability of moving up

(ii) Probability of moving down

(iii) Probability of moving right

(iv) Probability of moving left

(v) Probability of moving front

(vi) Probability of moving back

Such that , and