4. Continuous-Time Markov Chains

  1. Henk C. Tijms

Published Online: 27 DEC 2004

DOI: 10.1002/047001363X.ch4

A First Course in Stochastic Models

A First Course in Stochastic Models

How to Cite

Tijms, H. C. (2003) Continuous-Time Markov Chains, in A First Course in Stochastic Models, John Wiley & Sons, Ltd, Chichester, UK. doi: 10.1002/047001363X.ch4

Author Information

  1. Vrije Universiteit, Amsterdam, The Netherlands

Publication History

  1. Published Online: 27 DEC 2004
  2. Published Print: 14 MAR 2003

ISBN Information

Print ISBN: 9780471498803

Online ISBN: 9780470013632

SEARCH

Keywords:

  • infinitesimal transition rates;
  • flow rate equation approach;
  • ergodic theorems for continuous-time Markov chains

Summary

This chapter contains sections titled:

  • Introduction

  • The Model

  • The Flow Rate Equation Method

  • Ergodic Theorems

  • Markov Processes on a Semi-infinite Strip

  • Transient State Probabilities

  • Transient Distribution of Cumulative Rewards

  • Exercises

  • Bibliographic Notes

  • References