+612 9045 4394
Markov Decision Processes - D. J. White

Markov Decision Processes

Hardcover Published: 8th April 1993
ISBN: 9780471936275
Number Of Pages: 238

Share This Book:


or 4 easy payments of $158.44 with Learn more
Ships in 7 to 10 business days

This text is based on a course given for PhD systems engineers at the University of Virginia in 1987. The appraoch, and level of mathematics used, is intended for the mathematically-minded postrgraduate students in such areas as systems engineering, indudtrial engineering, management science and operations research, and for final-year mathematicians and statisticians. It is not intended to be a research reference text, although reference is given to some key texts and papers for those wishing to pursue research in this area. It is intended as a basic text, covering some of the fundamentals involved in the manner in which Markov decision problems may be properly formulated and solutions, or properties of such solutions, determined.

A General Framework for Markov Decision Processes.


Linear Programming Formulations for Markov Decision Processes.

Semi-Markov Decision Processes.

Partially Observable and Adaptive Markov Decision Processes.

Further Aspects of Markov Decision Processes.

Some Markov Decision Process Problems, Formulations and Optimality Equations.


Solutions to Exercises.


ISBN: 9780471936275
ISBN-10: 0471936278
Audience: Tertiary; University or College
Format: Hardcover
Language: English
Number Of Pages: 238
Published: 8th April 1993
Country of Publication: GB
Dimensions (cm): 23.6 x 15.5  x 2.3
Weight (kg): 0.41
Edition Number: 1