Module 3:Branching process, Application of Markov chains, Markov Processes with discrete and                 continuous state space
  Lecture 11:Application of Markov Process
 

Example 3.1


Let , , , i.e., ,  and

, such that

. Hence we can find

.

Given this we are interested to find the probability of extinction and that is definitely not 1. Furthermore we have:

 

 

 , i.e., , i.e.,  and .

Hence the probability of ultimate extinction is 0.6