3. Discrete-Time Markov Chains

  1. Henk C. Tijms

Published Online: 27 DEC 2004

DOI: 10.1002/047001363X.ch3

A First Course in Stochastic Models

A First Course in Stochastic Models

How to Cite

Tijms, H. C. (2003) Discrete-Time Markov Chains, in A First Course in Stochastic Models, John Wiley & Sons, Ltd, Chichester, UK. doi: 10.1002/047001363X.ch3

Author Information

  1. Vrije Universiteit, Amsterdam, The Netherlands

Publication History

  1. Published Online: 27 DEC 2004
  2. Published Print: 14 MAR 2003

ISBN Information

Print ISBN: 9780471498803

Online ISBN: 9780470013632

SEARCH

Keywords:

  • continuous-time Markov processes;
  • discrete-time Markov chain;
  • Markov's proof and exponential convergence

Summary

This chapter contains sections titled:

  • Introduction

  • The Model

  • Transient Analysis

  • The Equilibrium Probabilities

  • Computation of the Equilibrium Probabilities

  • Theoretical Considerations

  • Exercises

  • Bibliographic Notes

  • References