Get Free Shipping on orders over $89
Markov Decision Processes and Reinforcement Learning - Martin L. Puterman

Markov Decision Processes and Reinforcement Learning

By: Martin L. Puterman, Timothy C. Y. Chan

Hardcover | 31 July 2026

At a Glance

Hardcover


$359.75

or 4 interest-free payments of $89.94 with

 or 

Available: 31st July 2026

Preorder. Will ship when available.

This book offers a comprehensive introduction to Markov decision process and reinforcement learning fundamentals using common mathematical notation and language. Its goal is to provide a solid foundation that enables readers to engage meaningfully with these rapidly evolving fields. Topics covered include finite and infinite horizon models, partially observable models, value function approximation, simulation-based methods, Monte Carlo methods, and Q-learning. Rigorous mathematical concepts and algorithmic developments are supported by numerous worked examples. As an up-to-date successor to Martin L. Puterman's influential 1994 textbook, this volume assumes familiarity with probability, mathematical notation, and proof techniques. It is ideally suited for students, researchers, and professionals in operations research, computer science, engineering, and economics.

More in Optimisation

The Infinite Game : From the bestselling author of Start With Why - Simon Sinek
The Selfish Gene : 40th Anniversary Edition - Richard Dawkins

RRP $32.95

$26.99

18%
OFF
Game Theory : 2nd edition - Eilon  Solan

RRP $113.95

$96.75

15%
OFF
On the Edge : The Art of Risking Everything - Nate Silver

RRP $36.99

$29.75

20%
OFF
Blackjack Mathematics for Non-Mathematicians - Mark Bollman
Swarm Optimization for Biomedical Applications - Nanda Dulal  Jana

RRP $96.99

$86.99

10%
OFF