Chapter 7. Semi-Markov Decision Processes

  1. Henk C. Tijms

Published Online: 27 DEC 2004

DOI: 10.1002/047001363X.ch7

A First Course in Stochastic Models

A First Course in Stochastic Models

How to Cite

Tijms, H. C. (2003) Semi-Markov Decision Processes, in A First Course in Stochastic Models, John Wiley & Sons, Ltd, Chichester, UK. doi: 10.1002/047001363X.ch7

Author Information

  1. Vrije Universiteit, Amsterdam, The Netherlands

Publication History

  1. Published Online: 27 DEC 2004
  2. Published Print: 14 MAR 2003

ISBN Information

Print ISBN: 9780471498803

Online ISBN: 9780470013632

SEARCH

Keywords:

  • semi-Markov decision model;
  • value-iteration method;
  • optimization of queues

Summary

This chapter contains sections titled:

  • Introduction

  • The Semi-Markov Decision Model

  • Algorithms for an Optimal Policy

  • Value Iteration and Fictitious Decisions

  • Optimization of Queues

  • One-step Policy Improvement

  • Exercises

  • Bibliographic Notes

  • References