presentation 7 3a multiple linear re gression
play

Presentation 7.3a: Multiple linear re- gression Murray Logan July - PDF document

Apr 18, 2023 •407 likes •551 views

-1- Presentation 7.3a: Multiple linear re- gression Murray Logan July 19, 2017 Table of contents 1 Theory 1 2 Centering data 3 3 Assumptions 5 4 Multiple linear models in R 7 5 Model selection 12 6 Worked Examples 13 1.

  1. -1- Presentation 7.3a: Multiple linear re- gression Murray Logan July 19, 2017 Table of contents 1 Theory 1 2 Centering data 3 3 Assumptions 5 4 Multiple linear models in R 7 5 Model selection 12 6 Worked Examples 13 1. Theory 1.1. Multiple Linear Regression 1.1.1. Additive model growth = intercept + temperature + nitrogen y i = β 0 + β 1 x i 1 + β 2 x i 2 + ... + β j x ij + ϵ i OR N ∑ y i = β 0 + β j x ji + ϵ i j =1: n 1.2. Multiple Linear Regression 1.2.1. Additive model growth = intercept + temperature + nitrogen y i = β 0 + β 1 x i 1 + β 2 x i 2 + ... + β j x ij + ϵ i - effect of one predictor holding the other(s) constant 1.3. Multiple Linear Regression 1.3.1. Additive model growth = intercept + temperature + nitrogen y i = β 0 + β 1 x i 1 + β 2 x i 2 + ... + β j x ij + ϵ i

  2. -2- Y X1 X2 3 22.7 0.9 2.5 23.7 0.5 6 25.7 0.6 5.5 29.1 0.7 9 22 0.8 8.6 29 1.3 12 29.4 1 1.4. Multiple Linear Regression 1.4.1. Additive model 3 = β 0 + ( β 1 × 22.7) + ( β 2 × 0.9) + ε 1 2.5 = β 0 + ( β 1 × 23.7) + ( β 2 × 0.5) + ε 2 6 = β 0 + ( β 1 × 25.7) + ( β 2 × 0.6) + ε 3 5.5 = β 0 + ( β 1 × 29.1) + ( β 2 × 0.7) + ε 4 + ( β 1 × 22) + ( β 2 × 0.8) 9 = β 0 + ε 5 + ( β 1 × 29) + ( β 2 × 1.3) 8.6 = β 0 + ε 6 + ( β 1 × 29.4) + ( β 2 × 1) 12 = β 0 + ε 7 1.5. Multiple Linear Regression 1.5.1. Multiplicative model growth = intercept + temp + nitro + temp × nitro y i = β 0 + β 1 x i 1 + β 2 x i 2 + β 3 x i 1 x i 2 + ... + ϵ i 1.6. Multiple Linear Regression 1.6.1. Multiplicative model 3 = β 0 + ( β 1 × 22.7) + ( β 2 × 0.9) + ( β 3 × 22.7 × 0.9) + ε 1 2.5 = β 0 + ( β 1 × 23.7) + ( β 2 × 0.5) + ( β 3 × 23.7 × 0.5) + ε 2 6 = β 0 + ( β 1 × 25.7) + ( β 2 × 0.6) + ( β 3 × 25.7 × 0.6) + ε 3 5.5 = β 0 + ( β 1 × 29.1) + ( β 2 × 0.7) + ( β 3 × 29.1 × 0.7) + ε 4 9 = β 0 + ( β 1 × 22) + ( β 2 × 0.8) + ( β 3 × 22 × 0.8) + ε 5 8.6 = β 0 + ( β 1 × 29) + ( β 2 × 1.3) + ( β 3 × 29 × 1.3) + ε 6 12 = β 0 + ( β 1 × 29.4) + ( β 2 × 1) + ( β 3 × 29.4 × 1) + ε 7

  3. -3- 2. Centering data 2.1. Multiple Linear Regression 2.1.1. Centering ● ● ● ● ● ● ● ● ● ● 20 ● ● ● ● ● ● ● ● ● ● 10 y 0 −10 −20 0 10 20 30 40 50 60 x 2.2. Multiple Linear Regression 2.2.1. Centering ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 47 48 49 50 51 52 53 54 2.3. Multiple Linear Regression

  4. -4- 2.3.1. Centering ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 47 48 49 50 51 52 53 54 2.4. Multiple Linear Regression 2.4.1. Centering ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 47 48 49 50 51 52 53 54 −3 −2 −1 0 1 2 3 4

  5. -5- 2.5. Multiple Linear Regression 2.5.1. Centering 24 ● ● ● ● 22 ● ● ● ● ● y 20 ● ● ● ● 18 ● ● ● ● ● 16 ● −4 −2 0 2 4 cx1 3. Assumptions 3.1. Multiple Linear Regression 3.1.1. Assumptions Normality, homog., linearity 3.2. Multiple Linear Regression 3.2.1. Assumptions (multi)collinearity

  6. -6- 3.3. Multiple Linear Regression 3.3.1. Variance inflation Strength of a relationship R 2 Strong when R 2 ≥ 0.8 3.4. Multiple Linear Regression 3.4.1. Variance inflation 1 var . inf = 1 − R 2 Collinear when var . inf > = 5 Some prefer > 3 3.5. Multiple Linear Regression 3.5.1. Assumptions (multi)collinearity library(car) # additive model - scaled predictors vif(lm(y ~ cx1 + cx2, data)) cx1 cx2 1.743817 1.743817 3.6. Multiple Linear Regression 3.6.1. Assumptions (multi)collinearity library(car) # additive model - scaled predictors vif(lm(y ~ cx1 + cx2, data))

  7. -7- cx1 cx2 1.743817 1.743817 # multiplicative model - raw predictors vif(lm(y ~ x1 * x2, data)) x1 x2 x1:x2 7.259729 5.913254 16.949468 3.7. Multiple Linear Regression 3.7.1. Assumptions # multiplicative model - raw predictors vif(lm(y ~ x1 * x2, data)) x1 x2 x1:x2 7.259729 5.913254 16.949468 # multiplicative model - scaled predictors vif(lm(y ~ cx1 * cx2, data)) cx1 cx2 cx1:cx2 1.769411 1.771994 1.018694 4. Multiple linear models in R 4.1. Model fitting Additive model y i = β 0 + β 1 x i 1 + β 2 x i 2 + ϵ i data.add.lm <- lm(y~cx1+cx2, data) 4.2. Model fitting Additive model y i = β 0 + β 1 x i 1 + β 2 x i 2 + ϵ i data.add.lm <- lm(y~cx1+cx2, data) Multiplicative model y i = β 0 + β 1 x i 1 + β 2 x i 2 + β 3 x i 1 x i 2 + ϵ i data.mult.lm <- lm(y~cx1+cx2+cx1:cx2, data) #OR data.mult.lm <- lm(y~cx1*cx2, data) 4.3. Model evaluation Additive model plot(data.add.lm)

  8. -8- Residuals vs Fitted Normal Q−Q 40 ● 40 ● ● ● ● 2 ● 2 ● ● ● ● ● ● ● Standardized residuals ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 1 ● ● ● ● ● ●● ● ● 1 ● ● ● ● ● ● ● ● ● ● Residuals ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 0 ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● 0 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● −1 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● −1 ● ● ● ● ● ● ● ● ● ● ● ● ● −2 ● ● ● ● ● ● ● 74 ● −2 ● ● 30 ● 74 30 ● −3 −2 −1 0 −2 −1 0 1 2 Fitted values Theoretical Quantiles Scale−Location Residuals vs Leverage 1.5 40 30 ● ● 74 ● ● 40 ● ● ● ● ● ● 2 ● 19 ● ● ● ● ● ● ● ● Standardized residuals ● ● ● ● ● Standardized residuals ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 1.0 ● 1 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 0 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 0.5 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● −1 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 10 ● ● −2 ● ● ● ● ● ● ● ● ● Cook's distance 0.0 −3 −2 −1 0 0.00 0.02 0.04 0.06 Fitted values Leverage 4.4. Model evaluation Multiplicative model plot(data.mult.lm) Residuals vs Fitted Normal Q−Q 2 ● 2 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● Standardized residuals ● ● ● ● ● ● ● ● ● 1 ● ● ● ● ● ● ● 1 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● Residuals ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 0 ● ● ● ● ● ● ● ● ● ● ● ● 0 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● −1 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● −1 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● −2 ● ● ● ● ● 59 74 ● ● 30 −2 7459 ● ● ● 30 −4 −3 −2 −1 0 1 2 −2 −1 0 1 2 Fitted values Theoretical Quantiles Scale−Location Residuals vs Leverage 1.5 30 ● ● ● 59 74 ● ● ● 2 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 19 ● ● ● 40 ● ● Standardized residuals ● ● ● ● Standardized residuals ● ● ● ● ● ● ● ● ● 1 ● ● ● ● ● ● ● ● 1.0 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 0 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ●● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 0.5 ● ● −1 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 84 ● −2 ● ● ● ● ● Cook's distance 0.0 −4 −3 −2 −1 0 1 2 0.00 0.05 0.10 0.15 0.20 Fitted values Leverage

Recommend

Presentation 7.3b: Multiple linear re- gression Murray Logan August 9, 2016 Table of contents

Presentation 7.3b: Multiple linear re- gression Murray Logan August 9, 2016 Table of contents

-1- Presentation 7.3b: Multiple linear re- gression Murray Logan August 9, 2016 Table of contents 1 Theory 1 2 Worked Examples 3 0.1. Preparations 0.1.1. Packages library(ggplot2) library(car) library(GGally) library(rstan)

372 views • 4 slides
Unit 7: Multiple linear regression 1. Introduction to multiple linear regression Sta 101 - Fall

Unit 7: Multiple linear regression 1. Introduction to multiple linear regression Sta 101 - Fall

Announcements Unit 7: Multiple linear regression 1. Introduction to multiple linear regression Sta 101 - Fall 2018 Project questions? Duke University, Department of Statistical Science Dr. Abrahamsen Slides posted at

537 views • 10 slides
Presentation 7.3a: Multiple linear regression Murray Logan 19 Jul 2017 Section 1 Theory

Presentation 7.3a: Multiple linear regression Murray Logan 19 Jul 2017 Section 1 Theory

Presentation 7.3a: Multiple linear regression Murray Logan 19 Jul 2017 Section 1 Theory Multiple Linear Regression l o d e e m i v d i t A d growth = intercept + temperature + nitrogen y i = 0 + 1 x i 1 + 2 x i 2 + ... +

641 views • 44 slides
Trendlines Simple Linear Regression Multiple Linear Regression Systematic Model

Trendlines Simple Linear Regression Multiple Linear Regression Systematic Model

Trendlines Simple Linear Regression Multiple Linear Regression Systematic Model Building Practical Issues Overfitting Categorical Variables Interaction Terms Non-linear Terms Linear y = a + bx Logarithmic

946 views • 65 slides
Section 3.2: Multiple Linear Regression II Jared S. Murray The University of Texas at Austin

Section 3.2: Multiple Linear Regression II Jared S. Murray The University of Texas at Austin

Section 3.2: Multiple Linear Regression II Jared S. Murray The University of Texas at Austin McCombs School of Business 1 Multiple Linear Regression: Inference and Understanding We can answer new questions with MLR: Are any of the

588 views • 36 slides
Linear Statistics Jung-Keun Lee and Woo-Hwan Kim ETRI Our contribution improved and extended

Linear Statistics Jung-Keun Lee and Woo-Hwan Kim ETRI Our contribution improved and extended

FSE 2020 Multiple Linear Cryptanalysis Using Linear Statistics Jung-Keun Lee and Woo-Hwan Kim ETRI Our contribution improved and extended approach of multiple linear cryptanalysis[BCQ04] (exploit dominant statistically independent linear

714 views • 30 slides
Multiple Linear Regression Often more than one predictor variable can be used to predict the

Multiple Linear Regression Often more than one predictor variable can be used to predict the

ST 370 Probability and Statistics for Engineers Multiple Linear Regression Often more than one predictor variable can be used to predict the value of a response variable. The basic approach of the simple linear regression model may be extended

204 views • 8 slides
Multiple Linear Regression The population model In a simple linear regression model, a single

Multiple Linear Regression The population model In a simple linear regression model, a single

Multiple Linear Regression The population model In a simple linear regression model, a single response measure- ment Y is related to a single predictor (covariate, regressor) X for each observation. The critical assumption of the model is

859 views • 49 slides
Week 3: Multiple Linear Regression Polynomials, log transformation, categorical variables,

Week 3: Multiple Linear Regression Polynomials, log transformation, categorical variables,

BUS41100 Applied Regression Analysis Week 3: Multiple Linear Regression Polynomials, log transformation, categorical variables, interactions &amp; main effects Max H. Farrell The University of Chicago Booth School of Business Multiple vs

916 views • 56 slides
Da Data ta My multiple linear regression analysis is based on Forest Fire due to recent

Da Data ta My multiple linear regression analysis is based on Forest Fire due to recent

Minaya 1 Yerandy Minaya Dr. Donghui Yan MTH 499 03 Project 1 MULTIPLE LINEAR REGRESSION IN R Da Data ta My multiple linear regression analysis is based on Forest Fire due to recent incidents that have happened in the U.S and also in my

272 views • 8 slides
Notation ^ y = b 0 + b 1 x 1 + b 2 x 2 + b 3 x 3 +. . .+ b k x k 0 = the y -intercept, or the

Notation ^ y = b 0 + b 1 x 1 + b 2 x 2 + b 3 x 3 +. . .+ b k x k 0 = the y -intercept, or the

Multiple Regression Multiple Regression Definition Definition Multiple Regression Equation Multiple Regression Equation A linear relationship between a dependent A linear relationship between a dependent variable y and two or more independent

453 views • 10 slides
The General Linear Model. April 22, 2008 Multiple regression Data: The Faroese Mercury Study

The General Linear Model. April 22, 2008 Multiple regression Data: The Faroese Mercury Study

The General Linear Model. April 22, 2008 Multiple regression Data: The Faroese Mercury Study Simple linear regression Confounding The multiple linear regression model Interpretation of parameters Model control

564 views • 39 slides
Lecture #5: Multiple Linear Regression Data Science 1 CS 109A, STAT 121A, AC 209A, E-109A Pavlos

Lecture #5: Multiple Linear Regression Data Science 1 CS 109A, STAT 121A, AC 209A, E-109A Pavlos

Lecture #5: Multiple Linear Regression Data Science 1 CS 109A, STAT 121A, AC 209A, E-109A Pavlos Protopapas Kevin Rader Margo Levine Rahul Dave Lecture Outline Review More on Model Evaluation Multiple Linear Regression Evaluating

585 views • 32 slides
Presentation 7.3b: Multiple linear regression Murray Logan 09 Aug 2016 library (GGally) library

Presentation 7.3b: Multiple linear regression Murray Logan 09 Aug 2016 library (GGally) library

Presentation 7.3b: Multiple linear regression Murray Logan 09 Aug 2016 library (GGally) library (ggplot2) library (gridExtra) library (dplyr) library (coda) library (brms) library (rstan) library (car) Preparations g e s c k a P a a D

180 views • 14 slides
Workshop 7: (Generalized) Linear models Murray Logan July 19, 2017 Table of contents 1

Workshop 7: (Generalized) Linear models Murray Logan July 19, 2017 Table of contents 1

-1- Workshop 7: (Generalized) Linear models Murray Logan July 19, 2017 Table of contents 1 Linear model Assumptions 1 2 Multiple (Genearalized) Linear Regression 15 3 Centering data 17 4 Assumptions 20 5 Multiple linear models

763 views • 38 slides
Multiple Linear Regression James H. Steiger Department of Psychology and Human Development

Multiple Linear Regression James H. Steiger Department of Psychology and Human Development

Introduction The Multiple Regression Model Setting Up a Multiple Regression Model Multiple Linear Regression James H. Steiger Department of Psychology and Human Development Vanderbilt University Multilevel Regression Modeling, 2009

709 views • 41 slides
Section 3.1: Multiple Linear Regression Jared S. Murray The University of Texas at Austin

Section 3.1: Multiple Linear Regression Jared S. Murray The University of Texas at Austin

Section 3.1: Multiple Linear Regression Jared S. Murray The University of Texas at Austin McCombs School of Business 1 The Multiple Regression Model Many problems involve more than one independent variable or factor which affects the

843 views • 24 slides
Overview IAML: Linear Regression The linear model Fitting the linear model to data

Overview IAML: Linear Regression The linear model Fitting the linear model to data

Overview IAML: Linear Regression The linear model Fitting the linear model to data Probabilistic interpretation of the error function Nigel Goddard School of Informatics Examples of regression problems Dealing with multiple

325 views • 10 slides
Multiple Regression and Logistic Regression I Dajiang Liu @PHS 525 Apr-14-2016 Multiple

Multiple Regression and Logistic Regression I Dajiang Liu @PHS 525 Apr-14-2016 Multiple

Multiple Regression and Logistic Regression I Dajiang Liu @PHS 525 Apr-14-2016 Multiple Regression Extends simple linear regression to the scenario where Multiple predictors are available Multiple regression often results in better

673 views • 17 slides
An evaluation of approaches for accommodating interactions and non-linear terms in multiple

An evaluation of approaches for accommodating interactions and non-linear terms in multiple

An evaluation of approaches for accommodating interactions and non-linear terms in multiple imputation of incomplete three-level data Rushani Wijesuriya Katherine J. Lee, Margarita Moreno-Betancur, John B. Carlin and Anurika P. De Silva

619 views • 27 slides
Multiple logistic regression Richard Erickson Instructor DataCamp Generalized Linear Models in

Multiple logistic regression Richard Erickson Instructor DataCamp Generalized Linear Models in

DataCamp Generalized Linear Models in R GENERALIZED LINEAR MODELS IN R Multiple logistic regression Richard Erickson Instructor DataCamp Generalized Linear Models in R Chapter overview Multiple logistic regression Formulas in R Model

759 views • 32 slides
Evaluation of approaches for accommodating interactions and non-linear terms in multiple

Evaluation of approaches for accommodating interactions and non-linear terms in multiple

Evaluation of approaches for accommodating interactions and non-linear terms in multiple imputation of incomplete three-level data Rushani Wijesuriya Prof Katherine Lee, Dr. Margarita Moreno-Betancur, Prof John Carlin and Dr. Anurika De Silva 26

372 views • 8 slides
Unit 7: Multiple Linear Regression Lecture 1: Introduction to MLR Statistics 101 Thomas

Unit 7: Multiple Linear Regression Lecture 1: Introduction to MLR Statistics 101 Thomas

Unit 7: Multiple Linear Regression Lecture 1: Introduction to MLR Statistics 101 Thomas Leininger June 20, 2013 Many variables in a model Weights of books volume (cm 3 ) weight (g) cover 1 800 885 hc 2 950 1016 hc 3 1050 1125 hc

291 views • 17 slides
Linear Models II Design of Experiments, Analysis of Variance and Multiple Regression

Linear Models II Design of Experiments, Analysis of Variance and Multiple Regression

Linear Models II Design of Experiments, Analysis of Variance and Multiple Regression http://bcf.isb-sib.ch/teaching/introStat/ EMBnet Course Introduction to Statistics for Biologists, Jan 2009 The research process Scientific

687 views • 29 slides

More recommend