关键词: 马尔科夫链, 离散事件系统, 连续时间参数, 遍历性, Kolmogorov向后方程或向前方程

Abstract: In this paper，results of Markov chain are used under the circumstances of the automaton model which belongs to logical level of Discrete Event System （DES） to analyze the steady states and transient states of the Markov model of DES，respectively based on four conditions of discrete-time parameter and continuous-time parameter.A simpler decision rule of system ergodic property which applies both to the conditions of discrete-time parameter and continuous-time parameter is presented through an example.The transient states of DES which under the condition of continuous-time parameter are analyzed and computed based on Kolmogorov backward equation or forward equation.Methods of computing steady-state distribution of the birth and death process model is presented.In addition，the relationship between statistic property level and logical level of the DECS is still discussed.

Key words: Markov chain, Discrete Event System（DES）, continuous-time parameter, ergodic property, Kolmogorov backward equation or forward equation