Omitted Variable Bias Methods of Economic Investigation Lecture 7 1.
Section 3. Simple Regression - Omitted Variable...
Transcript of Section 3. Simple Regression - Omitted Variable...
![Page 1: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/1.jpg)
Section 3. Simple Regression - Omitted Variable Bias
1. Sampling Properties of OLS estimators2. What’s a Covariance?3. More sampling properties of OLS
estimators4. Standard Errors of OLS estimators5. Confidence intervals6. CLT demonstration7. Omitted Variables and Omitted Variable
Bias (prelude to Section 4)
![Page 2: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/2.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-2
1. Sampling Properties of OLS estimators
Review: • Unbiased: E(b0) = β0, E(b1) = β1
• Consistent: plim(b0) = β0, plim(b1) = β1
New: • Asymptotically Normal by the CLT
![Page 3: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/3.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-3
Derivation
![Page 4: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/4.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-4
Derivation
![Page 5: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/5.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-5
2. What’s a Covariance?
![Page 6: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/6.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-6
3. Sampling Properties of OLS estimators (cont.)
![Page 7: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/7.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-7
Why asymptotically N(.)?
![Page 8: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/8.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-8
![Page 9: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/9.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-9
4. Standard Errors
• CLT: b1 approx ~ N(β1, V(b1))b0 approx ~ N(β0, V(b0))
• “Standard Errors” are consistent estimators of standard deviations of boand b1 . (S&W p. 133, 151,180).
• So “t-statistics” have a standard normal distribution.
![Page 10: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/10.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-10
5. Confidence Intervals
..and the same for β0
![Page 11: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/11.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-11
Confidence Intervals
Confidence intervals for β0,β1
![Page 12: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/12.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-12
6. CLT demonstrations using Stata
..and the same for b0
• Stata doesn’t mind running a regression a few thousand times, - which allows us to observe a sampling distribution for b1e.g., bootregh00.do
![Page 13: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/13.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-13
CLT in action: sampling distributions for b1
Frac
tion
n=20, 2000 repsb
-.1 -.05 0 .05
0
.128
Frac
tion
n=30, 2000 repsb
-.05 0 .05
0
.1075
Frac
tion
n=40, 2000 repsb
-.05 0 .05
0
.126
Note: In developing countriesthis slope is about -0.2 childrenper year of education. Vg
![Page 14: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/14.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-14
7. Omitted Variables and Omitted Variable Bias
• What if you left out an important variable?
• Many interesting relationships have more than 2 dimensions
• Multivariate regression:
![Page 15: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/15.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-15
7a. OLS Multivariate regression
Look familiar? Same criterion with more variables.
![Page 16: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/16.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-16
7b. Properties of OLS estimators in Multivariate Regression
• Consistent• Unbiased• Approximately N(.) in large samples• Claim:
![Page 17: Section 3. Simple Regression - Omitted Variable Biaseconweb.ucsd.edu/~elib/120b/less8_simplereg_ovb.pdf · Section 3. Simple Regression - Omitted Variable Bias 1. Sampling Properties](https://reader034.fdocuments.us/reader034/viewer/2022042605/5a7a9aac7f8b9a8d558d7f74/html5/thumbnails/17.jpg)
Copyright © 2003 by Pearson Education, Inc. 4-17
7c. Omitted Variable “Bias”
• Short regressiony = b0
s + b1s x1 + eS (SR)
• Long regressiony = b0
L + b1L x1 + b2
L x2 + eL (LR) • Claim:
b1s = b1
L + b2L b21 ,
b21 is slope of a regression of x2 on x1