Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

69
Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression

Transcript of Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

Page 1: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

Copyright © 2013 Pearson Education, Inc. All rights reserved

Chapter 11

Simple Linear Regression

Page 2: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

Copyright © 2013 Pearson Education, Inc. All rights reserved

11.1

Probabilistic Models

Page 3: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 3 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.1 Possible reaction times y for five different drug percentages x

Page 4: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 4 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 5: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 5 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 6: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 6 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.2 The straight-line model

Page 7: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 7 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 8: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

Copyright © 2013 Pearson Education, Inc. All rights reserved

11.2

Fitting the Model: The Least Squares Approach

Page 9: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 9 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Table 11.1

Page 10: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 10 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.3 Scatterplot for data in Table 11.1

Page 11: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 11 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.4 Visual straight line fitted to the data in Figure 11.3

Page 12: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 12 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Table 11.2

Page 13: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 13 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Definition

Page 14: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 14 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Formula

Page 15: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 15 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Table 11.3

Page 16: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 16 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.5 The line fitted to the data

ˆ .1 .7y x

Page 17: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 17 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Table 11.4

Page 18: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 18 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.6a SAS printout for the time-drug regression

Page 19: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 19 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.6b SPSS printout for the time-drug regression

Page 20: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 20 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.6c MINITAB printout for the time-drug regression

Page 21: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 21 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 22: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 22 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Table SIA11.1

Page 23: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 23 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure SIA11.1 MINITAB scatterplot of dowsing data

Page 24: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 24 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure SIA11.2 MINITAB simple linear regression for dowsing data

Page 25: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

Copyright © 2013 Pearson Education, Inc. All rights reserved

11.3

Model Assumptions

Page 26: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 26 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.7 The probability distribution of

Page 27: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 27 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 28: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 28 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.8 SAS printout for the time-drug regression

Page 29: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 29 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 30: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

Copyright © 2013 Pearson Education, Inc. All rights reserved

11.4

Assessing the Utility of the Model: Making Inferences about the Slope 1

Page 31: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 31 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.9 Graph of the straight-line model when the slope is zero, i.e., 0y

Page 32: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 32 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 33: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 33 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.10 Sampling distribution of 1̂

Page 34: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 34 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 35: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 35 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Definition

Page 36: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 36 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.11 Rejection region and calculated t value for testing versus

1: 0H 0 1: 0H

Page 37: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 37 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.12 MINITAB printout for the time-drug regression

Page 38: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 38 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 39: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 39 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 40: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 40 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Definition

Page 41: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 41 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.13 SPSS printout with 95% confidence intervals for the time-drug regression betas

Page 42: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 42 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure SIA11.3 MINITAB simple linear regression for dowsing data

Page 43: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

Copyright © 2013 Pearson Education, Inc. All rights reserved

11.5

The Coefficients of Correlation and Determination

Page 44: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 44 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 45: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 45 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.14 Values of r and their implications

Page 46: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 46 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Table 11.5

Page 47: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 47 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.15 MINITAB correlation printout and scatterplot for Example 11.4

Page 48: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 48 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 49: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 49 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Definition

Page 50: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 50 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.16 A comparison of the sum of squares of deviations for two models

Page 51: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 51 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 52: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 52 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Table 11.6

Page 53: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 53 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.17 Portion of SPSS printout for time-drug regression

Page 54: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 54 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 55: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 55 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure SIA11.4 MINITAB printouts with coefficients of correlation and determination for the dowsing data

Page 56: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

Copyright © 2013 Pearson Education, Inc. All rights reserved

Using the Model for Estimation and Prediction

11.6

Page 57: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 57 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.18 Estimated mean value and predicted individual value of reaction time y for x = 4

Page 58: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 58 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 59: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 59 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 60: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 60 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Procedure

Page 61: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 61 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.19 MINITAB printout giving 95% confidence interval for E(y) and 95% prediction interval for y

Page 62: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 62 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.20 Error in estimating the mean value of y for a given value of x

Page 63: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 63 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.21 Error in predicting a future value of y for a given value of x

Page 64: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 64 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.22 Confidence intervals for mean values and prediction intervals for new values

Page 65: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 65 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure SIA11.5 MINITAB prediction interval for dowsing data

Page 66: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

Copyright © 2013 Pearson Education, Inc. All rights reserved

A Complete Example

11.7

Page 67: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 67 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Table 11.7

Page 68: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 68 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.23 SAS printout for fire damage regression

Page 69: Copyright © 2013 Pearson Education, Inc. All rights reserved Chapter 11 Simple Linear Regression.

11 - 69 Copyright © 2013 Pearson Education, Inc.. All rights reserved.

Figure 11.24 MINITAB scatterplot with least squares line for fire damage regression analysis