prove that if state i is recurrent and does not communicate
prove that if state i is recurrent and does not communicate with state j, then Pij=0
Solution
Pij is the probability for both i and j state.
It is given that i is recurrent but does not communicate with state j.
Hence their intersection is a null set.
It follows that
Pij =0
