Get Free Shipping on orders over $79
Understanding Markov Chains : Examples and Applications - Nicolas Privault

Understanding Markov Chains

Examples and Applications

By: Nicolas Privault

eText | 3 August 2018 | Edition Number 2

At a Glance

eText


$64.99

or 4 interest-free payments of $16.25 with

 or 

Instant online reading in your Booktopia eTextbook Library *

Why choose an eTextbook?

Instant Access *

Purchase and read your book immediately

Read Aloud

Listen and follow along as Bookshelf reads to you

Study Tools

Built-in study tools like highlights and more

* eTextbooks are not downloadable to your eReader or an app and can be accessed via web browsers only. You must be connected to the internet and have no technical issues with your device or browser that could prevent the eTextbook from operating.

This book provides an undergraduate-level introduction to discrete and continuous-time Markov chains and their applications, with a particular focus on the first step analysis technique and its applications to average hitting times and ruin probabilities. It also discusses classical topics such as recurrence and transience, stationary and limiting distributions, as well as branching processes. It first examines in detail two important examples (gambling processes and random walks) before presenting the general theory itself in the subsequent chapters. It also provides an introduction to discrete-time martingales and their relation to ruin probabilities and mean exit times, together with a chapter on spatial Poisson processes. The concepts presented are illustrated by examples, 138 exercises and 9 problems with their solutions.

on
Desktop
Tablet
Mobile

Other Editions and Formats

PDF

Published: 13th August 2013

Instant online reading in your Booktopia eTextbook Library *

More in Probability & Statistics

An Introduction to Stochastic Modeling - Gabriel Lord

eBOOK

RRP $145.41

$130.99

10%
OFF
untitled - TBC ANZ

eBOOK

$31.99