Heteroscedasticity

16
HETEROSCEDASTICITY NATURE AND CONSEQUENCES PRESENTED BY MANEESH . P

Transcript of Heteroscedasticity

Page 1: Heteroscedasticity

HETEROSCEDASTICITY

NATURE AND CONSEQUENCES

PRESENTED BY

MANEESH . P

Page 2: Heteroscedasticity

A critical assumption of the classical linear regression model is that the disturbances ui have all the same variance, 2 . When this condition holds, the error

terms are homoscedastic, which means the errors have the same scatter regardless of the value of X.

When the scatter of the errors is different, varying depending on the value of one or more of the independent variables, the error terms

are heteroscedastic.

INTRoDUCTION

Page 3: Heteroscedasticity

Yi = 1 + 2Xi + Ui

Regression Model

Var(Ui) = 2Homoscedasticity:

Heteroscedasticity: Var(Ui) = i2

Or E(Ui2) = 2

Or E(Ui2) = i

2

i =1,2,… N

Page 4: Heteroscedasticity

One of the assumptions of the classical linear

regression (CLRM) is that the variance of ui, the

error term, is constant, or homoscedastic.

Reasons are many, including:

The presence of outliers in the data

Incorrect functional form of the regression model

Incorrect transformation of data

Mixing observations with different measures of scale

(such as mixing high-income households with low-

income households)

HETEROSCEDASTICITY

Page 5: Heteroscedasticity

Heteroscedasticity is a systematic pattern in the errors where the variances of the errors are not constant.

Heteroscedasticity occurs when the variance of the error terms differ across observations

HETEROSCEDASTICITY

Page 6: Heteroscedasticity

Heteroscedasticity implies that the variances (i.e. - the dispersion around the expected mean of zero) of the residuals are not constant, but that they are different for different observations. This causes a problem: if the variances are unequal, then the relative reliability of each observation (used in the regression analysis) is unequal. The larger the variance, the lower should be the importance (or weight) attached to that observation.

MEANING

Page 7: Heteroscedasticity

Suppose 100 students enroll in a typing class—some of which

have typing experience and some of which do not. After the

first class there would be a great deal of dispersion in the

number of typing mistakes. After the final class the dispersion

would be smaller . The error variance is non constant—it

falls as time increases..

EXAMPLE

Page 8: Heteroscedasticity

Xi

Yi

..

.

..

..

...

.

..

..

..

. .. .

.. ... .

. .

. .. .

.

...

..

.

.

Income

Consumption

HOMOSCEDASTIC PATTERN OF ERRORS

Page 9: Heteroscedasticity

Xi

Yi

.

... .

. .. .

..

.

.

.

.

..

..

.

..

.

..

...

.

..

..

..

.

..

..... .

..

Income

Consumption

HETEROSCEDASTIC PATTERN OF ERRORS

Page 10: Heteroscedasticity

.

X iX1 X2

f(Yi)

X3

..

Income

rich people

poor people

THE HETEROSCEDASTIC CASE

Page 11: Heteroscedasticity

ECON 7710, 2010

Identical distributions for observations i and j

Distribution for i

Distribution for j

Page 12: Heteroscedasticity

1. Ordinary least squares estimators still linear

and unbiased.

2. Ordinary least squares estimators

not efficient.

3. Usual formulas give incorrect standard

errors for least squares.

4. Confidence intervals and hypothesis tests

based on usual standard errors are wrong.

CONSEQUENCES OF HETEROSCEDASTICITY

Page 13: Heteroscedasticity

CONSEQUENCES OF USING OLS IN THE

PRESENCE OF HETEROSCEDASTICITY

OLS estimation still gives unbiased coefficient estimates, but theyare no longer BLUE.

This implies that if we still use OLS in the presence ofheteroscedasticity, our standard errors could be inappropriateand hence any inferences we make could be misleading.

The existence of heteroscedasticity in the error term of an equation violates Classical Assumption V, and the estimation of the equation with OLS has at least three consequences:

Page 14: Heteroscedasticity

Whether the standard errors calculated using the usualformulae are too big or too small will depend upon the formof the heteroscedasticity.

In the presence of heteroscedasticity, the variances of OLSestimators are not provided by the usual OLS formulas. Butif we persist in using the usual OLS formulas, the t and F testsbased on them can be highly mislead- ing, resulting inerroneous conclusions

Page 15: Heteroscedasticity

CONCLUSION

With heteroscedasticity, this error term variance is not constant

One of the assumption of OLS regression is that error terms have a constant variance across all value so f independent variable

More common in cross sectional data than time series data

Even if heteroscedasticity is present or suspected, whatever conclusions we draw or inferences we make may be very misleading.

Page 16: Heteroscedasticity