Continuous-Time Markov Decision Processes

Theory and Applications

By: Xianping Guo, Onésimo Hernández-Lerma

Write A Review

Paperback | 14 March 2012

At a Glance

Paperback
254 Pages

Dimensions(cm)
23.37 x 15.49 x 1.35

Paperback

$139.00

or 4 interest-free payments of $34.75 with

Ships in 5 to 7 business days

Continuous-time Markov decision processes (MDPs), also known as controlled Markov chains, are used for modeling decision-making problems that arise in operations research (for instance, inventory, manufacturing, and queueing systems), computer science, communications engineering, control of populations (such as fisheries and epidemics), and management science, among many other fields. This volume provides a unified, systematic, self-contained presentation of recent developments on the theory and applications of continuous-time MDPs. The MDPs in this volume include most of the cases that arise in applications, because they allow unbounded transition and reward/cost rates. Much of the material appears for the first time in book form.

Industry Reviews

From the reviews:

"The book consists of 12 chapters. ... this is the first monograph on continuous-time Markov decision process. ... This is an important book written by leading experts on a mathematically rich topic which has many applications to engineering, business, and biological problems. ... scholars and students interested in developing the theory of continuous-time Markov decision Processes or working on their applications should have this book." (E. A. Feinberg, Mathematical Reviews, Issue 2011 b)

Shipping

	Standard Shipping	Express Shipping
Metro postcodes:	$9.99	$14.95
Regional postcodes:	$9.99	$14.95
Rural postcodes:	$9.99	$14.95

Orders over $79.00 qualify for free shipping.

How to return your order

At Booktopia, we offer hassle-free returns in accordance with our returns policy. If you wish to return an item, please get in touch with Booktopia Customer Care.

Additional postage charges may be applicable.