数学
马尔可夫链
马尔可夫过程
马尔可夫链的例子
马尔可夫性质
马尔可夫链混合时间
马尔可夫模型
马尔可夫更新过程
变阶马尔可夫模型
组合数学
链条(单位)
加性马尔可夫链
吸收马尔可夫链
作者
Michael C.H. Choi,Pierre Patie
摘要
The aim of this paper is to develop a general theory for the class of skip-free Markov chains on denumerable state space. This encompasses their potential theory via an explicit characterization of their potential kernel expressed in terms of the family of fundamental excessive functions, which are defined by means of the theory of the Martin boundary. We also describe their fluctuation theory generalizing the celebrated fluctuations identities that were obtained by using the Wiener-Hopf factorization for the specific skip-free random walks. We proceed by resorting to the concept of similarity to identify the class of skip-free Markov chains whose transition operator has only real and simple eigenvalues. We manage to find a set of sufficient and easy-to-check conditions on the one-step transition probability for a Markov chain to belong to this class. We also study several properties of this class including their spectral expansions given in terms of a Riesz basis, derive a necessary and sufficient condition for this class to exhibit a separation cutoff, and give a tighter bound on its convergence rate to stationarity than existing results.
科研通智能强力驱动
Strongly Powered by AbleSci AI