Free shipping on orders over $79 * - Limited time only - *T&Cs apply
Track My Order
Help Centre
Likes
My Wish ListsLogin / Join
Booktopia
Australia's local bookstore
Get Free Shipping on orders over $0
Understanding Markov Chains : Examples and Applications - Nicolas Privault

Understanding Markov Chains

Examples and Applications

By: Nicolas Privault

eText | 18 May 2026 | Edition Number 3

At a Glance

eText

$84.99

or 4 interest-free payments of $21.25 with

 or 

Instant online reading in your Booktopia eTextbook Library *

Why choose an eTextbook?

Instant Access *

Purchase and read your book immediately

Read Aloud

Listen and follow along as Bookshelf reads to you

Study Tools

Built-in study tools like highlights and more

* eTextbooks are not downloadable to your eReader or an app and can be accessed via web browsers only. You must be connected to the internet and have no technical issues with your device or browser that could prevent the eTextbook from operating.

This book provides an undergraduate-level introduction to discrete and continuous-time Markov chains and their applications, with a particular focus on the first step analysis technique and its applications to the computation of average hitting times and ruin probabilities. It also discusses classical topics such as recurrence and transience, stationary and limiting distributions, as well as branching processes. It starts by examining in detail two important examples (gambling processes and random walks) before presenting the general theory in the subsequent chapters. It also provides an introduction to discrete-time martingales and their relation to ruin probabilities and mean exit times, together with a chapter on spatial Poisson processes. The concepts presented are illustrated by examples, 150 exercises and 22 problems with their solutions.

This book is a revised and expanded version of the previous edition, and includes additional exercises and problems with complete solutions. As in the previous book, all exercises and problems are solved in detail, with many graphs and explanatory figures.

on
Desktop
Tablet
Mobile

You Can Find This eBook In

Non-FictionMathematicsProbability & Statistics

More in Probability & Statistics

All of Regression - Isabella Verdinelli

eTEXT

All of Regression

eText

$104.95

Bayesian Workflow - Andrew Gelman

eTEXT

Bayesian Workflow

eText

$116.60

This product is categorised by