Linear Model and Extensions

Acronyms Symbols Useful R packages Preface I Introduction 1 Motivations for Statistical Models 2 Ordinary Least Squares with a Univariate Covariate II Ordinary Least Squares and Statistical Inference 3 Ordinary Least Squares with Multiple Covariates 4 Gauss-Markov Model and Gauss-Markov Theorem 5 Normal Linear Model: Inference and Prediction 6 Asymptotic Inference in OLS: Eicker-Huber-White (EHW) robust standard error III Interpretation of Ordinary Least Squares Based on Partial Regressions 7 Frisch-Waugh-Lovell Theorem 8 Applications of the Frisch-Waugh-Lovell Theorem 9 Cochran's Formula and Omitted-Variable Bias IV Model Fitting, Checking, and Misspecification 10 Multiple Correlation Coefficient 11 Leverage Scores and Leave-One-Out Formulas 12 Population Ordinary Least Squares and Misspecified Linear Model V Overfitting, Regularization, and Model Selection 13 Perils of Overfitting 14 Ridge Regression 15 Lasso VI Transformation and Weighting 16 Transformations in OLS 17 Interactions in OLS 18 Restricted OLS 19 Weighted Least Squares VII Generalized Linear Models 20 Logistic Regression for Binary Outcomes 21 Logistic Regressions for Categorical Outcomes 22 Regression Models for Count Outcomes 23 Generalized Linear Models: A Unification 24 Misspecified Generalized Linear Models: Restricted Mean Models and Sandwich Covariance Matrix 25 Generalized Estimating Equation for Correlated Multivariate Data VIII Beyond Modeling the Conditional Mean 26 Quantile Regression 27 Modeling Time-to-Event Outcomes IX Appendices A Linear Algebra B Random Variables C Limiting Theorems and Basic Asymptotics D M-Estimation and MLE Bibliography