Module 1:Concepts of Random walks, Markov Chains, Markov Processes
  Lecture 3:Markov Chains
 

Graph representation of Markov chain

Steady state graphical representation of Markov chains (depending on any order of the Markov chain)

Examples of (i) Graph colouring problem, (ii) stochastic network flows (oil flow, gas flow, information/data flow, etc.), (iii) network flows (maximum flow, minimum cut etc.), etc.