List of Symbols xv
Preface xvii
About the Companion Website xix
1 Introduction 1
1.1 Samples Versus Populations 3
1.2 Comments on Software 4
1.3 R Basics 5
1.3.1 Entering Data 6
1.3.2 Arithmetic Operations 10
1.3.3 Storage Types and Modes 12
1.3.4 Identifying and Analyzing Special Cases 17
1.4 R Packages 20
1.5 Access to Data Used in this Book 22
1.6 Accessing More Detailed Answers to the Exercises 23
1.7 Exercises 23
2 Numerical Summaries of Data 25
2.1 Summation Notation 26
2.2 Measures of Location 29
2.2.1 The Sample Mean 29
2.2.2 The Median 30
2.2.3 Sample Mean versus Sample Median 33
2.2.4 Trimmed Mean 34
2.2.5 R function mean, tmean, and median 35
2.3 Quartiles 36
2.3.1 R function idealf and summary 37
2.4 Measures of Variation 37
2.4.1 The Range 38
2.4.2 R function Range 38
2.4.3 Deviation Scores, Variance, and Standard Deviation 38
2.4.4 R Functions var and sd 40
2.4.5 The Interquartile Range 41
2.4.6 MAD and the Winsorized Variance 41
2.4.7 R Functions winvar, winsd, idealfIQR, and mad 44
2.5 Detecting Outliers 44
2.5.1 A Classic Outlier Detection Method 45
2.5.2 The Boxplot Rule 46
2.5.3 The MAD–Median Rule 47
2.5.4 R Functions outms, outbox, and out 47
2.6 Skipped Measures of Location 48
2.6.1 R Function MOM 49
2.7 Summary 49
2.8 Exercises 50
3 Plots Plus More Basics on Summarizing Data 53
3.1 Plotting Relative Frequencies 53
3.1.1 R Functions table, plot, splot, barplot, and cumsum 54
3.1.2 Computing the Mean and Variance Based on the Relative Frequencies 56
3.1.3 Some Features of the Mean and Variance 57
3.2 Histograms and Kernel Density Estimators 57
3.2.1 R Function hist 58
3.2.2 What Do Histograms Tell Us? 59
3.2.3 Populations, Samples, and Potential Concerns about Histograms 61
3.2.4 Kernel Density Estimators 64
3.2.5 R Functions Density and Akerd 64
3.3 Boxplots and Stem-and-Leaf Displays 65
3.3.1 R Function stem 67
3.3.2 Boxplot 67
3.3.3 R Function boxplot 68
3.4 Summary 68
3.5 Exercises 69
4 Probability and Related Concepts 71
4.1 The Meaning of Probability 71
4.2 Probability Functions 72
4.3 Expected Values, Population Mean and Variance 74
4.3.1 Population Variance 76
4.4 Conditional Probability and Independence 77
4.4.1 Independence and Dependence 78
4.5 The Binomial Probability Function 80
4.5.1 R Functions dbinom and pbinom 85
4.6 The Normal Distribution 85
4.6.1 Some Remarks about the Normal Distribution 88
4.6.2 The Standard Normal Distribution 89
4.6.3 Computing Probabilities for Any Normal Distribution 92
4.6.4 R Functions pnorm and qnorm 94
4.7 Nonnormality and The Population Variance 94
4.7.1 Skewed Distributions 97
4.7.2 Comments on Transforming Data 98
4.8 Summary 100
4.9 Exercises 101
5 Sampling Distributions 107
5.1 Sampling Distribution of ?p, the Proportion of Successes 108
5.2 Sampling Distribution of the Mean Under Normality 111
5.2.1 Determining Probabilities Associated with the Sample Mean 113
5.2.2 But Typically ? Is Not Known. Now What? 116
5.3 Nonnormality and the Sampling Distribution of the Sample Mean 116
5.3.1 Approximating the Binomial Distribution 117
5.3.2 Approximating the Sampling Distribution of the Sample Mean: The General Case 119
5.4 Sampling Distribution of the Median and 20% Trimmed Mean 123
5.4.1 Estimating the Standard Error of the Median 126
5.4.2 R Function msmedse 127
5.4.3 Approximating the Sampling Distribution of the Sample Median 128
5.4.4 Estimating the Standard Error of a Trimmed Mean 129
5.4.5 R Function trimse 130
5.4.6 Estimating the Standard Error When Outliers Are Discarded: A Technically Unsound Approach 130
5.5 The Mean Versus the Median and 20% Trimmed Mean 131
5.6 Summary 135
5.7 Exercises 136
6 Confidence Intervals 139
6.1 Confidence Interval for the Mean 139
6.1.1 Computing a Confidence Interval Given ?2 140
6.2 Confidence Intervals for the Mean Using s (? Not Known) 145
6.2.1 R Function t.test 148
6.3 A Confidence Interval for The Population Trimmed Mean 149
6.3.1 R Function trimci 150
6.4 Confidence Intervals for The Population Median 151
6.4.1 R Function msmedci 152
6.4.2 Underscoring a Basic Strategy 152
6.4.3 A Distribution-Free Confidence Interval for the Median Even When There Are Tied Values 153
6.4.4 R Function sint 154
6.5 The Impact of Nonnormality on Confidence Intervals 155
6.5.1 Student’s T and Nonnormality 155
6.5.2 Nonnormality and the 20% Trimmed Mean 161
6.5.3 Nonnormality and the Median 162
6.6 Some Basic Bootstrap Methods 163
6.6.1 The Percentile Bootstrap Method 163
6.6.2 R Functions trimpb 164
6.6.3 Bootstrap-t 164
6.6.4 R Function trimcibt 166
6.7 Confidence Interval for The Probability of Success 167
6.7.1 Agresti–Coull Method 169
6.7.2 Blyth’s Method 169
6.7.3 Schilling–Doi Method 170
6.7.4 R Functions acbinomci and binomLCO 170
6.8 Summary 172
6.9 Exercises 173
7 Hypothesis Testing 179
7.1 Testing Hypotheses about the Mean, ? Known 179
7.1.1 Details for Three Types of Hypotheses 180
7.1.2 Testing for Exact Equality and Tukey’s Three-Decision Rule 183
7.1.3 p-Values 184
7.1.4 Interpreting p-Values 186
7.1.5 Confidence Intervals versus Hypothesis Testing 187
7.2 Power and Type II Errors 187
7.2.1 Power and p-Values 191
7.3 Testing Hypotheses about the mean, ? Not Known 191
7.3.1 R Function t.test 193
7.4 Student’s T and Nonnormality 193
7.4.1 Bootstrap-t 195
7.4.2 Transforming Data 196
7.5 Testing Hypotheses about Medians 196
7.5.1 R Function msmedci and sintv2 197
7.6 Testing Hypotheses Based on a Trimmed Mean 198
7.6.1 R Functions trimci, trimcipb, and trimcibt 198
7.7 Skipped Estimators 200
7.7.1 R Function momci 200
7.8 Summary 201
7.9 Exercises 202
8 Correlation and Regression 207
8.1 Regression Basics 207
8.1.1 Residuals and a Method for Estimating the Median of Y Given X 209
8.1.2 R function qreg and Qreg 211
8.2 Least Squares Regression 212
8.2.1 R Functions lsfit, lm, ols, plot, and abline 214
8.3 Dealing with Outliers 215
8.3.1 Outliers among the Independent Variable 215
8.3.2 Dealing with Outliers among the Dependent Variable 216
8.3.3 R Functions tsreg and tshdreg 218
8.3.4 Extrapolation Can Be Dangerous 219
8.4 Hypothesis Testing 219
8.4.1 Inferences about the Least Squares Slope and Intercept 220
8.4.2 R Functions lm, summary, and ols 223
8.4.3 Heteroscedcasticity: Some Practical Concerns and How to Address Them 225
8.4.4 R Function olshc4 226
8.4.5 Outliers among the Dependent Variable: A Cautionary Note 227
8.4.6 Inferences Based on the Theil–Sen Estimator 227
8.4.7 R Functions regci and regplot 227
8.5 Correlation 229
8.5.1 Pearson’s Correlation 229
8.5.2 Inferences about the Population Correlation, ? 232
8.5.3 R Functions pcor and pcorhc4 234
8.6 Detecting Outliers When Dealing with Two or More Variables 235
8.6.1 R Functions out and outpro 236
8.7 Measures of Association: Dealing with Outliers 236
8.7.1 Kendall’s Tau 236
8.7.2 R Functions tau and tauci 239
8.7.3 Spearman’s Rho 240
8.7.4 R Functions spear and spearci 241
8.7.5 Winsorized and Skipped Correlations 242
8.7.6 R Functions scor, scorci, scorciMC, wincor, and wincorci 243
8.8 Multiple Regression 245
8.8.1 Least Squares Regression 245
8.8.2 Hypothesis Testing 246
8.8.3 R Function olstest 248
8.8.4 Inferences Based on a Robust Estimator 248
8.8.5 R Function regtest 249
8.9 Dealing with Curvature 249
8.9.1 R Function lplot and rplot 251
8.10 Summary 256
8.11 Exercises 257
9 Comparing Two Independent Groups 263
9.1 Comparing Means 264
9.1.1 The Two-Sample Student’s T Test 264
9.1.2 Violating Assumptions When Using Student’s T 266
9.1.3 Why Testing Assumptions Can Be Unsatisfactory 269
9.1.4 Interpreting Student’s T When It Rejects 270
9.1.5 Dealing with Unequal Variances: Welch’s Test 271
9.1.6 R Function t.test 273
9.1.7 Student’s T versus Welch’s Test 274
9.1.8 The Impact of Outliers When Comparing Means 275
9.2 Comparing Medians 276
9.2.1 A Method Based on the McKean–Schrader Estimator 276
9.2.2 A Percentile Bootstrap Method 277
9.2.3 R Functions msmed, medpb2, split, and fac2list 278
9.2.4 An Important Issue: The Choice of Method can Matter 279
9.3 Comparing Trimmed Means 280
9.3.1 R Functions yuen, yuenbt, and trimpb2 282
9.3.2 Skipped Measures of Location and Deleting Outliers 283
9.3.3 R Function pb2gen 283
9.4 Tukey’s Three-Decision Rule 283
9.5 Comparing Variances 284
9.5.1 R Function comvar2 285
9.6 Rank-Based (Nonparametric) Methods 285
9.6.1 Wilcoxon–Mann–Whitney Test 286
9.6.2 R Function wmw 289
9.6.3 Handling Heteroscedasticity 289
9.6.4 R Functions cid and cidv2 290
9.7 Measuring Effect Size 291
9.7.1 Cohen’s d 292
9.7.2 Concerns about Cohen’s d and How They Might Be Addressed 293
9.7.3 R Functions akp.effect, yuenv2, and med.effect 295
9.8 Plotting Data 296
9.8.1 R Functions ebarplot, ebarplot.med, g2plot, and boxplot 298
9.9 Comparing Quantiles 299
9.9.1 R Function qcomhd 300
9.10 Comparing Two Binomial Distributions 301
9.10.1 Improved Methods 302
9.10.2 R Functions twobinom and twobicipv 302
9.11 A Method for Discrete or Categorical Data 303
9.11.1 R Functions disc2com, binband, and splotg2 304
9.12 Comparing Regression Lines 305
9.12.1 Classic ANCOVA 307
9.12.2 R Function CLASSanc 307
9.12.3 Heteroscedastic Methods for Comparing the Slopes and Intercepts 309
9.12.4 R Functions olsJ2 and ols2ci 309
9.12.5 Dealing with Outliers among the Dependent Variable 311
9.12.6 R Functions reg2ci, ancGpar, and reg2plot 311
9.12.7 A Closer Look at Comparing Nonparallel Regression Lines 313
9.12.8 R Function ancJN 313
9.13 Summary 315
9.14 Exercises 316
10 Comparing More than Two Independent Groups 321
10.1 The ANOVA F Test 321
10.1.1 R Functions anova, anova1, aov, split, and fac2list 327
10.1.2 When Does the ANOVA F Test Perform Well? 329
10.2 Dealing with Unequal Variances: Welch’s Test 331
10.3 Comparing Groups Based on Medians 333
10.3.1 R Functions med1way and Qanova 333
10.4 Comparing Trimmed Means 334
10.4.1 R Functions t1way and t1waybt 335
10.5 Two-Way ANOVA 335
10.5.1 Interactions 338
10.5.2 R Functions anova and aov 341
10.5.3 Violating Assumptions 342
10.5.4 R Functions t2way and t2waybt 343
10.6 Rank-Based Methods 344
10.6.1 The Kruskal–Wallis Test 344
10.6.2 Method BDM 346
10.7 R Functions kruskal.test AND bdm 347
10.8 Summary 348
10.9 Exercises 349
11 Comparing Dependent Groups 353
11.1 The Paired T Test 354
11.1.1 When Does the Paired T Test Perform Well? 356
11.1.2 R Functions t.test and trimcibt 357
11.2 Comparing Trimmed Means and Medians 357
11.2.1 R Functions yuend, ydbt, and dmedpb 359
11.2.2 Measures of Effect Size 363
11.2.3 R Functions D.akp.effect and effectg 364
11.3 The SIGN Test 364
11.3.1 R Function signt 365
11.4 Wilcoxon Signed Rank Test 365
11.4.1 R Function wilcox.test 367
11.5 Comparing Variances 367
11.5.1 R Function comdvar 368
11.6 Dealing with More Than Two Dependent Groups 368
11.6.1 Comparing Means 369
11.6.2 R Function aov 369
11.6.3 Comparing Trimmed Means 370
11.6.4 R Function rmanova 371
11.6.5 Rank-Based Methods 371
11.6.6 R Functions friedman.test and bprm 373
11.7 Between-By-Within Designs 373
11.7.1 R Functions bwtrim and bw2list 373
11.8 Summary 375
11.9 Exercises 376
12 Multiple Comparisons 379
12.1 Classic Methods for Independent Groups 380
12.1.1 Fisher’s Least Significant Difference Method 380
12.1.2 R Function FisherLSD 382
12.2 The Tukey–Kramer Method 382
12.2.1 Some Important Properties of the Tukey–Kramer Method 384
12.2.2 R Functions TukeyHSD and T.HSD 385
12.3 Scheffe’s Method 386
12.3.1 R Function Scheffe 386
12.4 Methods That Allow Unequal Population Variances 387
12.4.1 Dunnett’s T3 Method and an Extension of Yuen’s Method for Comparing Trimmed Means 387
12.4.2 R Functions lincon, linconbt, and conCON 389
12.5 Anova Versus Multiple Comparison Procedures 391
12.6 Comparing Medians 391
12.6.1 R Functions msmed, medpb, and Qmcp 392
12.7 Two-Way Anova Designs 393
12.7.1 R Function mcp2atm 397
12.8 Methods For Dependent Groups 400
12.8.1 Bonferroni Method 400
12.8.2 Rom’s Method 401
12.8.3 Hochberg’s Method 403
12.8.4 R Functions rmmcp, dmedpb, and sintmcp 403
12.8.5 Controlling the False Discovery Rate 404
12.9 Summary 405
12.10 Exercises 406
13 Categorical Data 409
13.1 One-Way Contingency Tables 409
13.1.1 R Function chisq.test 413
13.1.2 Gaining Perspective: A Closer Look at the Chi-Squared Distribution 413
13.2 Two-Way Contingency Tables 414
13.2.1 McNemar’s Test 414
13.2.2 R Functions contab and mcnemar.test 417
13.2.3 Detecting Dependence 418
13.2.4 R Function chi.test.ind 422
13.2.5 Measures of Association 422
13.2.6 The Probability of Agreement 423
13.2.7 Odds and Odds Ratio 424
13.3 Logistic Regression 426
13.3.1 R Function logreg 428
13.3.2 A Confidence Interval for the Odds Ratio 429
13.3.3 R Function ODDSR.CI 429
13.3.4 Smoothers for Logistic Regression 429
13.3.5 R Functions rplot.bin and logSM 430
13.4 Summary 431
13.5 Exercises 432
AppendixA Solutions to Selected Exercises 435
Appendix B Tables 441
References 465
Index 473
