Module 1:Concepts of Random walks, Markov Chains, Markov Processes
Lecture 4:Markov Process
Note
S
olve the problem for
, in which case you will have
(i)
(ii)
, and
, in which case you will have
, and
