Solve a 50 state portion of the infinite Markov Chain to obt

Solve a 50 state portion of the infinite Markov Chain to obtain a value for n

Report pi_i for i = 1,

Solution

State i =4

P_i,i+1

P_i,i+2

P_i,i+3

.80

.1

.1

State i =5

P_i,i+2

P_i,i+3

.9

.1

State i =6

P_i,i+3

1.00

After this this will become 1 for i, i+4, (i,i+5)

So for 50th state pi,50 = 1.00

n =3.