Module 1:Concepts of Random walks, Markov Chains, Markov Processes
  Lecture 4:Markov Process
 

Assignment 1.10

Consider the problem (you have already solved a part of it) as given, in which there are three (3) outcomes, such that the outcomes of any trails are dependent on the outcomes of the previous trial, and the transition probability matrix is given as . There are three (3) states given by 0, 1, 2, such that ,  and , and . With this information find (i) , (ii) , (iii)  and (iv) , where .

Assignment 1.11

Consider the problem (you have already solved a part of it) as given, in which there are three (3) outcomes, such that the outcomes of any trails are dependent on the outcomes of the previous trial, and the transition probability matrix is given as . Assume that we know that there are three (3) states given by -1, 0, +1, such that ,  and , such that . With this information find (i) , (ii) , (iii)  and (iv) , where .

Assignment 1.12

Assume we have a sequence of random walks such that the transition probability matrix is give as , such that the outcomes of any trails are dependent on the outcomes of the previous trial and , . Also consider that , such that sum of the probability (at the initial stage, t=0) is exactly equal to 1, i.e,,  (sum of row elements is exactly equal to 1), and it is also always true that the sum of the realized values of the states at any t=n is exactly equal to six (6), i.e., , where . Given this set of information, find the general formulae for (i) , such that , (ii) , (iii) , (iv)  & , where .