Get Free Shipping on orders over $0
Partially Observed Markov Decision Processes : Filtering, Learning and Controlled Sensing - Vikram Krishnamurthy
eTextbook alternate format product

Instant online reading.
Don't wait for delivery!

Partially Observed Markov Decision Processes

Filtering, Learning and Controlled Sensing

By: Vikram Krishnamurthy

Hardcover | 5 June 2025 | Edition Number 2

At a Glance

Hardcover


RRP $192.95

$170.75

12%OFF

or 4 interest-free payments of $42.69 with

 or 

Ships in 15 to 25 business days

Covering formulation, algorithms and structural results and linking theory to real-world applications in controlled sensing (including social learning, adaptive radars and sequential detection), this book focuses on the conceptual foundations of partially observed Markov decision processes (POMDPs). It emphasizes structural results in stochastic dynamic programming, enabling graduate students and researchers in engineering, operations research, and economics to understand the underlying unifying themes without getting weighed down by mathematical technicalities. In light of major advances in machine learning over the past decade, this edition includes a new Part V on inverse reinforcement learning as well as a new chapter on non-parametric Bayesian inference (for Dirichlet processes and Gaussian processes), variational Bayes and conformal prediction.

More in Probability & Statistics

The Maths Book : Big Ideas Simply Explained - DK

RRP $45.00

$35.75

21%
OFF
Statistics and Data Handling for Biologists : A Student's Guide - Neil Millar
Introductory Statistics - Sheldon M. Ross

$300.99

Foundations of Statistics - Everett Davies
Sampling Theory and Practice - Casey Murphy
Practical Statistics - Nancy Maxwell

$448.75

Research Methods and Statistics in Psychology : 8th Edition - Hugh Coolican
Naked Statistics : Stripping the Dread from the Data - Charles Wheelan
The Book Of Why : New Science Of Cause And Effect - Judea Pearl

RRP $26.99

$22.99

15%
OFF
The Art of Statistics : Learning from Data - David Spiegelhalter

RRP $26.99

$22.99

15%
OFF
The Signal and the Noise : The Art and Science of Prediction - Nate Silver
Rationality : What It Is, Why It Seems Scarce, Why It Matters - Steven Pinker
The Black Swan : The Impact of the Highly Improbable - Nassim Nicholas Taleb
Introduction to Medical Statistics : 4th edition - Martin Bland

RRP $93.95

$81.75

13%
OFF
Causal Inference : What If - Miguel A. Hernan

RRP $94.99

$81.75

14%
OFF
Mathematical Statistics with Applications : 7th Edition - Dennis Wackerly
Calling Bullshit : The Art of Scepticism in a Data-Driven World - Carl T. Bergstrom