+612 9045 4394
 
CHECKOUT
Further Topics on Discrete-Time Markov Control Processes : APPLICATIONS OF MATHEMATICS - Onesimo Hernandez-Lerma

Further Topics on Discrete-Time Markov Control Processes

APPLICATIONS OF MATHEMATICS

Hardcover

Published: 22nd June 1999
Ships: 7 to 10 business days
7 to 10 business days
RRP $430.99
$298.25
31%
OFF
or 4 easy payments of $74.56 with Learn more

Other Available Formats (Hide)

  • Paperback View Product Published: 12th October 2012
    $204.16

This book is devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes. Interest is mainly confined to MCPs with Borel state and control spaces, and possibly unbounded costs. The book follows on from the authors earlier volume in this area, however, an important feature of the present volume is that it is essentially self-contained and can be read independently of the first volume, because although both volumes deal with similar classes of markov control processes the assumptions on the control models are usually different. This volume allows cost functions to take positive or negative values, as needed in some applications. The control model studied is sufficiently general to include virtually all the usual discrete-time stochastic control models that appear in applications to engineering, economics, mathematical population processes, operations research, and management science.

Preface
Ergodicity and Poisson's Equationp. 1
Discounted Dynamic Programming with Weighted Normsp. 39
The Expected Total Cost Criterionp. 75
Undiscounted Cost Criteriap. 117
Sample Path Average Costp. 163
The Linear Programming Approachp. 203
Referencesp. 251
Abbreviationsp. 263
Glossary of notationp. 265
Indexp. 271
Table of Contents provided by Blackwell. All Rights Reserved.

ISBN: 9780387986944
ISBN-10: 0387986944
Series: APPLICATIONS OF MATHEMATICS
Audience: Professional
Format: Hardcover
Language: English
Number Of Pages: 277
Published: 22nd June 1999
Publisher: Springer-Verlag New York Inc.
Country of Publication: US
Dimensions (cm): 24.77 x 16.51  x 1.91
Weight (kg): 0.57