Search Results

There are 112087 results for: content related to: Discrete-Time Markov Chains

  1. Continuous-Time Markov Chains

    A First Course in Stochastic Models

    Henk C. Tijms, Pages: 141–186, 2004

    Published Online : 27 DEC 2004, DOI: 10.1002/047001363X.ch4

  2. Discrete Time Markov Chains and Extensions

    Bayesian Analysis of Stochastic Process Models

    David Rios Insua, Fabrizio Ruggeri, Michael P. Wiper, Pages: 43–81, 2012

    Published Online : 8 APR 2012, DOI: 10.1002/9780470975916.ch3

  3. Discrete and Continuous Markov Processes

    Queueing Modelling Fundamentals: With Applications in Communication Networks, Second Edition

    Chee-Hock Ng, Boon-Hee Soong, Pages: 71–102, 2008

    Published Online : 7 APR 2008, DOI: 10.1002/9780470994672.ch3

  4. Discrete-Time Markov Decision Processes

    A First Course in Stochastic Models

    Henk C. Tijms, Pages: 233–277, 2004

    Published Online : 27 DEC 2004, DOI: 10.1002/047001363X.ch6

  5. Continuous-Time Markov Chains

    Markov Chains

    Bruno Sericola, Pages: 89–190, 2013

    Published Online : 9 AUG 2013, DOI: 10.1002/9781118731543.ch2

  6. Introduction to Stochastic Processes

    Introduction to Probability and Stochastic Processes with Applications

    Liliana Blanco Castañeda, Viswanathan Arunachalam, Selvamuthu Dharmaraja, Pages: 339–415, 2012

    Published Online : 11 JUL 2012, DOI: 10.1002/9781118344972.ch9

  7. Markov Chains Theory

    Principles of Communications Networks and Systems

    Nevio Benvenuto, Michele Zorzi, Pages: 431–516, 2011

    Published Online : 7 SEP 2011, DOI: 10.1002/9781119978589.ch7

  8. Discrete-Time Markov Chains

    Markov Chains

    Bruno Sericola, Pages: 1–87, 2013

    Published Online : 9 AUG 2013, DOI: 10.1002/9781118731543.ch1

  9. Continuous-Time Markov Chains

    Introduction to Stochastic Processes With R

    Robert P. Dobrow, Pages: 265–319, 2016

    Published Online : 16 MAR 2016, DOI: 10.1002/9781118740712.ch7

  10. Modeling and Analysis of Stochastic Systems, Second Edition by Vidyadhar G. Kulkarni

    International Statistical Review

    Volume 78, Issue 3, December 2010, Page: 467, David J. Hand

    Version of Record online : 28 DEC 2010, DOI: 10.1111/j.1751-5823.2010.00122_21.x

  11. Markov Chains

    An Introduction to Communication Network Analysis

    George Kesidis, Pages: 35–82, 2007

    Published Online : 22 JAN 2007, DOI: 10.1002/9780470168684.ch2

  12. PRICING AND SEMIMARTINGALE REPRESENTATIONS OF VULNERABLE CONTINGENT CLAIMS IN REGIME-SWITCHING MARKETS

    Mathematical Finance

    Volume 24, Issue 2, April 2014, Pages: 250–288, Agostino Capponi, José E. Figueroa-López and Jeffrey Nisen

    Version of Record online : 19 JUN 2012, DOI: 10.1111/j.1467-9965.2012.00533.x

  13. Continuous-time markov decision processes with nonzero terminal reward

    Naval Research Logistics Quarterly

    Volume 31, Issue 2, June 1984, Pages: 265–274, Kyung Y. Jo

    Version of Record online : 10 OCT 2006, DOI: 10.1002/nav.3800310208

  14. Effect of vitamin A deficiency on respiratory infection: Causal inference for a discretely observed continuous time non-stationary Markov process

    Canadian Journal of Statistics

    Volume 40, Issue 4, December 2012, Pages: 646–662, Mingyuan Zhang and Dylan S. Small

    Version of Record online : 18 OCT 2012, DOI: 10.1002/cjs.11161

  15. Uniformization in Markov Decision Processes

    Standard Article

    Wiley Encyclopedia of Operations Research and Management Science

    Oguzhan Alagoz and Mehmet U.S. Ayvaci

    Published Online : 15 FEB 2011, DOI: 10.1002/9780470400531.eorms0934

  16. ASYMPTOTIC TESTS FOR THE CONTINUOUS TIME MARKOV BRANCHING PROCESS WITH IMMIGRATION

    Australian Journal of Statistics

    Volume 25, Issue 1, April 1983, Pages: 47–57, Irene L. Hudson

    Version of Record online : 26 FEB 2008, DOI: 10.1111/j.1467-842X.1983.tb01195.x

  17. Queueing Theory

    Difference and Differential Equations with Applications in Queueing Theory

    Aliakar M Haghighi, Dimitar Mishev, Pages: 267–357, 2013

    Published Online : 2 JUL 2013, DOI: 10.1002/9781118400678.ch5

  18. You have full text access to this Open Access content
    Avoiding the curse of dimensionality in dynamic stochastic games

    Quantitative Economics

    Volume 3, Issue 1, March 2012, Pages: 53–93, Ulrich Doraszelski and Kenneth L. Judd

    Version of Record online : 14 MAR 2012, DOI: 10.3982/QE153

  19. Uniformization

    Markov Chains

    Bruno Sericola, Pages: 235–286, 2013

    Published Online : 9 AUG 2013, DOI: 10.1002/9781118731543.ch4

  20. Asymptotic Behavior of Continuous-Time Markov Chains

    Standard Article

    Wiley Encyclopedia of Operations Research and Management Science

    Eylem Tekin

    Published Online : 14 JAN 2011, DOI: 10.1002/9780470400531.eorms0063