Get Free Shipping on orders over $79
Partially Observed Markov Decision Processes : Filtering, Learning and Controlled Sensing - Vikram Krishnamurthy
eTextbook alternate format product

Instant online reading.
Don't wait for delivery!

Partially Observed Markov Decision Processes

Filtering, Learning and Controlled Sensing

By: Vikram Krishnamurthy

Hardcover | 5 June 2025

At a Glance

Hardcover


RRP $192.95

$170.75

12%OFF

or 4 interest-free payments of $42.69 with

 or 

Ships in 5 to 7 business days

Covering formulation, algorithms and structural results and linking theory to real-world applications in controlled sensing (including social learning, adaptive radars and sequential detection), this book focuses on the conceptual foundations of partially observed Markov decision processes (POMDPs). It emphasizes structural results in stochastic dynamic programming, enabling graduate students and researchers in engineering, operations research, and economics to understand the underlying unifying themes without getting weighed down by mathematical technicalities. In light of major advances in machine learning over the past decade, this edition includes a new Part V on inverse reinforcement learning as well as a new chapter on non-parametric Bayesian inference (for Dirichlet processes and Gaussian processes), variational Bayes and conformal prediction.

More in Probability & Statistics

Implementing R for Statistics - Christophe  Chesneau

RRP $180.95

$165.75

Introduction to Medical Statistics : 4th edition - Martin Bland

RRP $72.55

$62.75

14%
OFF
Rationality : What It Is, Why It Seems Scarce, Why It Matters - Steven Pinker
Research Methods and Statistics in Psychology : 8th Edition - Hugh Coolican
Sampling Theory and Practice - Casey Murphy
Practical Statistics - Nancy Maxwell

$437.75

Foundations of Statistics - Everett Davies
Mathematical Statistics with Applications : 7th Edition - Dennis Wackerly
Statistics for The Behavioral Sciences : 10th Edition - Frederick J. Gravetter