Hands-On Markov Models with Python
上QQ阅读APP看书,第一时间看更新

Expected number of visits

As is evident from the name, the expected number of visits for any state i is the number of times the system is expected to be in that state. Also, a given state i is recurrent if and only if the expected number of visits to i is infinite: