
At a Glance
364 Pages
23.39 x 15.6 x 1.91
Paperback
$249.00
or 4 interest-free payments of $62.25 with
 orÂShips in 5 to 7 business days
This paperback edition is a reprint of the 2001 Springer edition.
This book provides a self-contained and up-to-date treatment of the Monte Carlo method and develops a common framework under which various Monte Carlo techniques can be "standardized" and compared. Given the interdisciplinary nature of the topics and a moderate prerequisite for the reader, this book should be of interest to a broad audience of quantitative researchers such as computational biologists, computer scientists, econometricians, engineers, probabilists, and statisticians. It can also be used as the textbook for a graduate-level course on Monte Carlo methods. Many problems discussed in the alter chapters can be potential thesis topics for masters' or Ph.D. students in statistics or computer science departments.
Jun Liu is Professor of Statistics at Harvard University, with a courtesy Professor appointment at Harvard Biostatistics Department. Professor Liu was the recipient of the 2002 COPSS Presidents' Award, the most prestigious one for statisticians and given annually by five leading statistical associations to one individual under age 40. He was selected as a Terman Fellow by Stanford University in 1995, as a Medallion Lecturer by the Institute of Mathematical Statistics (IMS) in 2002, and as a Bernoulli Lecturer by the International Bernoulli Society in 2004. He was elected to the IMS Fellow in 2004 and Fellow of the American Statistical Association in 2005. He and co-workers have published more than 130 research articles and book chapters on Bayesian modeling and computation, bioinformatics, genetics, signal processing, stochastic dynamic systems, Monte Carlo methods, and theoretical statistics.
"An excellent survey of current Monte Carlo methods. The applications amply demonstrate the relevance of this approach to modern computing. The book is highly recommended." (Mathematical Reviews)
"This book provides comprehensive coverage of Monte Carlo methods, and in the process uncovers and discusses commonalities among seemingly disparate techniques that arose in various areas of application. ... The book is well organized; the flow of topics follows a logical development. ... The coverage is up-to-date and comprehensive, and so the book is a good resource for people conducting research on Monte Carlo methods. ... The book would be an excellent supplementary text for a course in scientific computing ... ." (SIAM Review)
"The strength of this book is in bringing together advanced Monte Carlo (MC) methods developed in many disciplines. ... Throughout the book are examples of techniques invented, or reinvented, in different fields that may be applied elsewhere. ... Those interested in using MC to solve difficult problems will find many ideas, collected from a variety of disciplines, and references for further study." (Technometrics)
Industry Reviews
From the reviews:
MATHEMATICAL REVIEWS
"This book is an excellent survey of current Monte Carlo methods. A strength of the book is the inclusion of a number of applications to current scientific problems. The applications amply demonstrate the relevance of this approach to modern computing. There is a fairly thorough coverage of wide variety of Monte Carlo algorithms that have arisen in diverse fields such as physics, chemistry, biology, etc., and the relationship among them. The book is highly recommended."
SHORT BOOK REVIEWS
"This is a worthwhile reference to recent advances in sequential Monte Carlo, primarily Bayesian and Markov Chain methods. To those with an interest in these topics, it is worth a read."
"This well written book discusses why Monte Carlo techniques are needed, the importance of Monte Carlo in bioinformatics, target tracking in nonlinear dynamic systems, in missing data analysis ... . The references are exhaustive. I enjoyed reading this book and learned a lot about the genetic applications of Monte Carlo techniques. I recommend this book highly to statisticians and geneticists." (Ramalingam Shanmugam, Journal of Statistical Computation and Simulation, Vol. 74 (8), 2004)
"Markov chain Monte Carlo ... was introduced to tackle more sophisticated and realistic statistical models as in the Bayesian approach of statistics. The author is well known in the area of MCMC methods ... . The book is written in a proper style ... . It provides an actual view of theoretical developments complemented by applications ... . It may be highly recommended for scientists and graduate students who want to gain some insight in either the theory or application of advanced Monte Carlo methods." (Ernst Stadlober, Metrika, February, 2004)
"This book provides comprehensive coverage of Monte Carlo methods, and in the process uncovers and discusses commonalities among seemingly disparate techniques that arose invarious areas of application. ... The book is well organized; the flow of topics follows a logical development. ... The coverage is up-to-date and comprehensive, and so the book is a good resource for people conducting research on Monte Carlo methods. ... The book would be an excellent supplementary text for a course in scientific computing ... ." (James E. Gentle, SIAM Review, Vol. 44 (3), 2002)
"The strength of this book is in bringing together advanced Monte Carlo (MC) methods developed in many disciplines. ... Throughout the book are examples of techniques invented, or reinvented, in different fields that may be applied elsewhere. ... Monte Carlo Strategies in Scientific Computing offers a large ... variety of methods and examples. Those interested in using MC to solve difficult problems will find many ideas, collected from a variety of disciplines, and references for further study." (Tim Hesterberg, Technometrics, Vol. 44 (4), 2002)
"This recent addition to the Monte Carlo literature is divided into 13 chapters and an appendix. It provides both the methodology and the underlying theory for applying Monte Carlo techniques to a broad range of problems. ... In the Appendix the author outlines the basics in probability theory and statistical inference procedures. ... this book is a valuable and recommended reference to Monte Carlo methods; particularly it draws the attention to recent work in sequential Monte Carlo." (Radu Theodorescu, Zentralblatt MATH, Vol. 991, 2002)
"The book gives a good introduction to current Monte Carlo methods and explains the terminology on a moderate level of abstraction. It becomes clear that any specific problem needs a tailored algorithm to be efficient. This is the reason for the emergence of variance reduction methods, importance sampling, rejection, sequential MC, Metropolis algorithms, Gibbs samplers, Markov Chain MC (MCMC), or hybrid MC with molecular dynamics. ... it is one of the first attempts to showthe general principles behind an apparent zoo of methods." (W. Wiechert, Simulation News Europe, Issue 34, 2002)
"The book targets a broader topic, namely all Monte Carlo methods. ... No prior MCMC knowledge is assumed, and the topics are introduced and motivated along the way. ... The book mentions plenty of real life situations where the techniques discussed ... may be applied. ... this book is sure to help the aspiring student eager to peep into the world of Monte Carlo. At the same time its extensive bibliography and references will make it useful as a handbook for the more advanced researcher." (Arnab Chakraborty, Sankhya: Indian Journal of Statistics, Vol. 64 (1B), 2002)
"This book is an introduction to Monte Carlo methods for graduate students and researchers in applied fields, and can be used by graduate students in mathematics for a first contact with the domain or for some insight into the possible applications of Monte Carlo methods. In this book, the focus of the Monte Carlo methods presented is the evaluation of some high-dimensional integrals, such as an average property of physical systems." (Gabriel Stoltz, Mathematical Reviews, Issue 2010 b)| Preface | p. vii |
| Introduction and Examples | p. 1 |
| The Need of Monte Carlo Techniques | p. 1 |
| Scope and Outline of the Book | p. 3 |
| Computations in Statistical Physics | p. 7 |
| Molecular Structure Simulation | p. 9 |
| Bioinformatics: Finding Weak Repetitive Patterns | p. 10 |
| Nonlinear Dynamic System: Target Tracking | p. 14 |
| Hypothesis Testing for Astronomical Observations | p. 16 |
| Bayesian Inference of Multilevel Models | p. 18 |
| Monte Carlo and Missing Data Problems | p. 19 |
| Basic Principles: Rejection, Weighting, and Others | p. 23 |
| Generating Simple Random Variables | p. 23 |
| The Rejection Method | p. 24 |
| Variance Reduction Methods | p. 26 |
| Exact Methods for Chain-Structured Models | p. 28 |
| Dynamic programming | p. 29 |
| Exact simulation | p. 30 |
| Importance Sampling and Weighted Sample | p. 31 |
| An example | p. 31 |
| The basic idea | p. 33 |
| The "rule of thumb" for importance sampling | p. 34 |
| Concept of the weighted sample | p. 36 |
| Marginalization in importance sampling | p. 37 |
| Example: Solving a linear system | p. 38 |
| Example: A Bayesian missing data problem | p. 40 |
| Advanced Importance Sampling Techniques | p. 42 |
| Adaptive importance sampling | p. 42 |
| Rejection and weighting | p. 43 |
| Sequential importance sampling | p. 46 |
| Rejection control in sequential importance sampling | p. 48 |
| Application of SIS in Population Genetics | p. 49 |
| Problems | p. 51 |
| Theory of Sequential Monte Carlo | p. 53 |
| Early Developments: Growing a Polymer | p. 55 |
| A simple model of polymer: Self-avoid walk | p. 55 |
| Growing a polymer on the square lattice | p. 56 |
| Limitations of the growth method | p. 59 |
| Sequential Imputation for Statistical Missing Data Problems | p. 60 |
| Likelihood computation | p. 60 |
| Bayesian computation | p. 62 |
| Nonlinear Filtering | p. 64 |
| A General Framework | p. 67 |
| The choice of the sampling distribution | p. 69 |
| Normalizing constant | p. 69 |
| Pruning, enrichment, and resampling | p. 71 |
| More about resampling | p. 72 |
| Partial rejection control | p. 75 |
| Marginalization, look-ahead, and delayed estimate | p. 76 |
| Problems | p. 77 |
| Sequential Monte Carlo in Action | p. 79 |
| Some Biological Problems | p. 79 |
| Molecular Simulation | p. 79 |
| Inference in population genetics | p. 81 |
| Finding motif patterns in DNA sequences | p. 84 |
| Approximating Permanents | p. 90 |
| Counting 0-1 Tables with Fixed Margins | p. 92 |
| Bayesian Missing Data Problems | p. 94 |
| Murray's data | p. 94 |
| Nonparametric Bayes analysis of binomial data | p. 95 |
| Problems in Signal Processing | p. 98 |
| Target tracking in clutter and mixture Kalman filter | p. 98 |
| Digital signal extraction in fading channels | p. 102 |
| Problems | p. 103 |
| Metropolis Algorithm and Beyond | p. 105 |
| The Metropolis Algorithm | p. 106 |
| Mathematical Formulation and Hastings's Generalization | p. 111 |
| Why Does the Metropolis Algorithm Work? | p. 112 |
| Some Special Algorithms | p. 114 |
| Random-walk Metropolis | p. 114 |
| Metropolized independence sampler | p. 115 |
| Configurational bias Monte Carlo | p. 116 |
| Multipoint Metropolis Methods | p. 117 |
| Multiple independent proposals | p. 118 |
| Correlated multipoint proposals | p. 120 |
| Reversible Jumping Rule | p. 122 |
| Dynamic Weighting | p. 124 |
| Output Analysis and Algorithm Efficiency | p. 125 |
| Problems | p. 127 |
| The Gibbs Sampler | p. 129 |
| Gibbs Sampling Algorithms | p. 129 |
| Illustrative Examples | p. 131 |
| Some Special Samplers | p. 133 |
| Slice sampler | p. 133 |
| Metropolized Gibbs sampler | p. 133 |
| Hit-and-run algorithm | p. 134 |
| Data Augmentation Algorithm | p. 135 |
| Bayesian missing data problem | p. 135 |
| The original DA algorithm | p. 136 |
| Connection with the Gibbs sampler | p. 137 |
| An example: Hierarchical Bayes model | p. 138 |
| Finding Repetitive Motifs in Biological Sequences | p. 139 |
| A Gibbs sampler for detecting subtle motifs | p. 140 |
| Alignment and classification | p. 141 |
| Covariance Structures of the Gibbs Sampler | p. 143 |
| Data Augmentation | p. 143 |
| Autocovariances for the random-scan Gibbs sampler | p. 144 |
| More efficient use of Monte Carlo samples | p. 146 |
| Collapsing and Grouping in a Gibbs Sampler | p. 146 |
| Problems | p. 151 |
| Cluster Algorithms for the Ising Model | p. 153 |
| Ising and Potts Model Revisit | p. 153 |
| The Swendsen-Wang Algorithm as Data Augmentation | p. 154 |
| Gonvergence Analysis and Generalization | p. 155 |
| The Modification by Wolff | p. 157 |
| Further Generalization | p. 157 |
| Discussion | p. 158 |
| Problems | p. 159 |
| General Conditional Sampling | p. 161 |
| Partial Resampling | p. 161 |
| Case Studies for Partial Resampling | p. 163 |
| Gaussian random field model | p. 163 |
| Texture synthesis | p. 165 |
| Inference with multivariate t-distribution | p. 169 |
| Transformation Group and Generalized Gibbs | p. 171 |
| Application: Parameter Expansion for Data Augmentation | p. 174 |
| Some Examples in Bayesian Inference | p. 176 |
| Probit regression | p. 176 |
| Monte Carlo bridging for stochastic differential equation | p. 178 |
| Problems | p. 181 |
| Molecular Dynamics and Hybrid Monte Carlo | p. 183 |
| Basics of Newtonian Mechanics | p. 184 |
| Molecular Dynamics Simulation | p. 185 |
| Hybrid Monte Carlo | p. 189 |
| Algorithms Related to HMC | p. 192 |
| Langevin-Euler Moves | p. 192 |
| Generalized hybrid Monte Carlo | p. 193 |
| Surrogate transition method | p. 194 |
| Multipoint Strategies for Hybrid Monte Carlo | p. 195 |
| Neal's window method | p. 195 |
| Multipoint method | p. 197 |
| Application of HMC in Statistics | p. 198 |
| Indirect observation model | p. 199 |
| Estimation in the stochastic volatility model | p. 201 |
| Multilevel Sampling and Optimization Methods | p. 205 |
| Umbrella Sampling | p. 206 |
| Simulated Annealing | p. 209 |
| Simulated Tempering | p. 210 |
| Parallel Tempering | p. 212 |
| Generalized Ensemble Simulation | p. 215 |
| Multicanonical sampling | p. 216 |
| The 1/k-ensemble method | p. 217 |
| Comparison of algorithms | p. 218 |
| Tempering with Dynamic Weighting | p. 219 |
| Ising model simulation at sub-critical temperature | p. 221 |
| Neural network training | p. 222 |
| Population-Based Monte Carlo Methods | p. 225 |
| Adaptive Direction Sampling: Snooker Algorithm | p. 226 |
| Conjugate Gradient Monte Carlo | p. 227 |
| Evolutionary Monte Carlo | p. 228 |
| Evolutionary movements in binary-coded space | p. 230 |
| Evolutionary movements in continuous space | p. 231 |
| Some Further Thoughts | p. 233 |
| Numerical Examples | p. 235 |
| Simulating from a bimodal distribution | p. 235 |
| Comparing algorithms for a multimodal example | p. 236 |
| Variable selection with binary-coded EMC | p. 237 |
| Bayesian neural network training | p. 239 |
| Problems | p. 242 |
| Markov Chains and Their Convergence | p. 245 |
| Basic Properties of a Markov Chain | p. 245 |
| Chapman-Kolmogorov equation | p. 247 |
| Convergence to stationarity | p. 248 |
| Coupling Method for Card Shuffling | p. 250 |
| Random-to-top shuffling | p. 250 |
| Riffle shuffling | p. 251 |
| Convergence Theorem for Finite-State Markov Chains | p. 252 |
| Coupling Method for General Markov Chain | p. 254 |
| Geometric Inequalities | p. 256 |
| Basic setup | p. 257 |
| Poincare inequality | p. 257 |
| Example: Simple random walk on a graph | p. 259 |
| Cheeger's inequality | p. 261 |
| Functional Analysis for Markov Chains | p. 263 |
| Forward and backward operators | p. 264 |
| Convergence rate of Markov chains | p. 266 |
| Maximal correlation | p. 267 |
| Behavior of the Averages | p. 269 |
| Selected Theoretical Topics | p. 271 |
| MCMC Convergence and Convergence Diagnostics | p. 271 |
| Iterative Conditional Sampling | p. 273 |
| Data augmentation | p. 273 |
| Random-scan Gibbs sampler | p. 275 |
| Comparison of Metropolis-Type Algorithms | p. 277 |
| Peskun's ordering | p. 277 |
| Comparing schemes using Peskun's ordering | p. 279 |
| Eigenvalue Analysis for the Independence Sampler | p. 281 |
| Perfect Simulation | p. 284 |
| A Theory for Dynamic Weighting | p. 287 |
| Definitions | p. 287 |
| Weight behavior under different scenarios | p. 288 |
| Estimation with weighted samples | p. 291 |
| A simulation study | p. 292 |
| Basics in Probability and Statistics | p. 295 |
| Basic Probability Theory | p. 295 |
| Experiments, events, and probability | p. 295 |
| Univariate random variables and their properties | p. 296 |
| Multivariate random variable | p. 298 |
| Convergence of random variables | p. 300 |
| Statistical Modeling and Inference | p. 301 |
| Parametric statistical modeling | p. 301 |
| Frequentist approach to statistical inference | p. 302 |
| Bayesian methodology | p. 304 |
| Bayes Procedure and Missing Data Formalism | p. 306 |
| The joint and posterior distributions | p. 306 |
| The missing data problem | p. 308 |
| The Expectation-Maximization Algorithm | p. 310 |
| References | p. 313 |
| Author Index | p. 333 |
| Subject Index | p. 338 |
| Table of Contents provided by Ingram. All Rights Reserved. |
ISBN: 9780387763699
ISBN-10: 0387763694
Series: Springer Series in Statistics
Published: 28th January 2008
Format: Paperback
Language: English
Number of Pages: 364
Audience: General Adult
Publisher: Springer Nature B.V.
Country of Publication: US
Dimensions (cm): 23.39 x 15.6 x 1.91
Weight (kg): 0.5
Shipping
| Standard Shipping | Express Shipping | |
|---|---|---|
| Metro postcodes: | $9.99 | $14.95 |
| Regional postcodes: | $9.99 | $14.95 |
| Rural postcodes: | $9.99 | $14.95 |
Orders over $89.00 qualify for free shipping.
How to return your order
At Booktopia, we offer hassle-free returns in accordance with our returns policy. If you wish to return an item, please get in touch with Booktopia Customer Care.
Additional postage charges may be applicable.
Defective items
If there is a problem with any of the items received for your order then the Booktopia Customer Care team is ready to assist you.
For more info please visit our Help Centre.
You Can Find This Book In
This product is categorised by
- Non-FictionMathematicsApplied MathematicsStochastics
- Non-FictionMathematicsProbability & Statistics
- Non-FictionReference, Information & Interdisciplinary SubjectsEncyclopaedias & Reference WorksReference Works
- Non-FictionScienceScience in GeneralPhilosophy of Science
- Non-FictionEconomicsEconometricsEconomic Statistics
- Non-FictionComputing & I.T.Computer Science
- Non-FictionSciencePhysicsMathematical Physics
- Non-FictionMathematicsCalculus & Mathematical AnalysisNumerical Analysis























