Module 1:Concepts of Random walks, Markov Chains, Markov Processes
  Lecture 3:Markov Chains
 

If one pays attention to (i), then this formulae would change the moment we have the following diagram
,which is given below

such that

Now going back to our original problem we solve using Stirling's formula or approximation
(whichis ) we obta

(i) ,


(ii)

 


Now  and the value of  is maximum iff when . Remember that this can be extended to
the case of .