Assignment 1.6

Consider the same problem as given above and consider it having three (3) outcomes, such that the outcomes of any trails are dependent on the outcomes of the previous trial. The transition probability matrix is considered as . We also know that there are three states given by 0, 1, 2, such that ,  and , and . With this information find (i) ,  and , (ii)  and .

Assignment 1.7

Consider a different problem where we also three (3) outcomes, such that the outcomes of any trails are dependent on the outcomes of the previous trials. The transition probability matrix is given and it is . Assume that we know that there are three states given by -1, 0, +1, such that ,  and , such that . Given this set of information, find (i) ,  and ,
(ii)  and .