Classification of states of a Markov Chain
State is said to be accessible from state if from some integer , , where denotes the stage transition.
Thus diagrammatically we may denote it simply as , which means that is accessible from state . On the other hand two states and which are accessible to each other are said to communicate and the way to mark it schematically is
The three characteristics which define equivalence relationship when two states communicate are
- Reflexcive : Which is implied by
- Symmetric : Which is denoted by
- Transitive : Which means that
|