Module 1:Concepts of Random walks, Markov Chains, Markov Processes
  Lecture 4:Markov Process

The Lecture Contains :

Markov-Bernoulli Chain

Note

Assignments

Random Walks which are correlated

Actual examples of Markov Chains

Examples

Use of Eigen values and eigen vectors to calculate higher transition probabilities

Theorem

Simulated Annealing (based on Metropolis Algorithm)

Concept of Markov Chain Monte Carlo (MCMC) method