5. Infinite-Horizon Models: Foundations

  1. Martin L. Puterman

Published Online: 27 MAY 2008

DOI: 10.1002/9780470316887.ch5

Markov Decision Processes: Discrete Stochastic Dynamic Programming

Markov Decision Processes: Discrete Stochastic Dynamic Programming

How to Cite

Puterman, M. L. (1994) Infinite-Horizon Models: Foundations, in Markov Decision Processes: Discrete Stochastic Dynamic Programming, John Wiley & Sons, Inc., Hoboken, NJ, USA. doi: 10.1002/9780470316887.ch5

Author Information

  1. University of British Columbia

Publication History

  1. Published Online: 27 MAY 2008
  2. Published Print: 15 APR 1994

ISBN Information

Print ISBN: 9780471619772

Online ISBN: 9780470316887

SEARCH

Keywords:

  • Markov policies;
  • decision sets;
  • performance measure;
  • infinite-horizon models;
  • Markov decision process

Summary

The prelims comprise:

  • The Value of a Policy

  • The Expected Total Reward Criterion

  • The Expected Total Discounted Reward Criterion

  • Optimality Criteria

  • Markov Policies

  • Vector Notation for Markov Decision Processes