Markov Renewal Processes
Published Online: 14 JAN 2011
Copyright © 2010 John Wiley & Sons, Inc. All rights reserved.
Wiley Encyclopedia of Operations Research and Management Science
How to Cite
Ziya, S. 2011. Markov Renewal Processes. Wiley Encyclopedia of Operations Research and Management Science. .
- Published Online: 14 JAN 2011
A Markov renewal process is a vector valued counting process that keeps track of the number of certain types of events associated with a stochastic process. It is a generalization of a renewal process in that a Markov renewal process with a single-dimensional state representation is a renewal process. In this article, we first define Markov renewal sequences, which are at the core of Markov renewal processes. Then, we give a formal description of Markov renewal processes and provide a number of examples where these processes appear.
- renewal process;
- Markov renewal sequence;
- Markov renewal process;
- stochastic process;
- stochastic vector process