Transient Behavior of CTMCs
Published Online: 15 FEB 2011
Copyright © 2010 John Wiley & Sons, Inc. All rights reserved.
Wiley Encyclopedia of Operations Research and Management Science
How to Cite
Distefano, S. and Trivedi, K. S. 2011. Transient Behavior of CTMCs. Wiley Encyclopedia of Operations Research and Management Science. .
- Published Online: 15 FEB 2011
Since their first specification, Markov models have been widely used for modeling many kinds of systems, in different environments, in application fields, and with different purposes. The success of the formalism of Markov chains is due to the simplicity and the effectiveness in (analytically) evaluating discrete state-space systems, providing both transient and steady-state analyses. But the Markovian assumption often limits the applicability of Markov chains. This limitation can be overcome by nonhomogeneous Markov chains and phase type distributions, allowing us to model more general behaviors. This further enhances the importance and the effectiveness of Markov chains and related formalisms. In this article, we focus on the transient behavior of Markov models, providing an overview of their solution techniques.
- homogeneous and nonhomogeneous Markov chains;
- piecewise approximation;
- phase type expansion