N-stage transition probability

Few relevant information which is important

Classification of the states of a Markov Chain

Recurrence

Wald's Equations

Examples

Transition probability matrices of a Markov chain

Periodicity

Generating functions