Hands-On Markov Models with Python
上QQ阅读APP看书,第一时间看更新

Steady-state analysis and limiting distributions

In a Markov chain, vector π is called the stationary distribution if ? j ∈ s satisfies the following conditions:

The stationary distribution is one of the most important properties of Markov chains, and we will talk about it in much more detail in later sections of this chapter.