Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.
-
Upload
jacob-skinner -
Category
Documents
-
view
216 -
download
1
Transcript of Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.
![Page 1: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/1.jpg)
1
Fixed Effects ModelsEvaluation Research (8521)
Prof. Jesse Lecy
![Page 2: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/2.jpg)
WHY PANEL DATA IS BETTER
![Page 3: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/3.jpg)
Is this program effective?
Outcome(more isbetter)
O1 x O2
Program
Time=1 Time=2
![Page 4: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/4.jpg)
What about now?
Outcome(more isbetter)
Treatment: O1 x O2
Control: O1 O2
Program
Time=1 Time=2
Control Group
Treatment Group
![Page 5: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/5.jpg)
What about now?
Outcome(more isbetter)
Treatment: O1 x O2
Control: O1 O2
Program
Time=1 Time=2
Treatment Group
![Page 6: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/6.jpg)
What about now?
Outcome(more isbetter)
Treatment: O1 x O2
Control: O1 O2
Program
Time=1 Time=2
Control Group
Treatment Group
![Page 7: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/7.jpg)
The context –
the initial level of outcomes for treatment and control groups
– is important !
![Page 8: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/8.jpg)
And Group Structure Matters
When individuals are isolated by geography or institution they develop differently. This geographic / group structure matters a great deal in social sciences.
![Page 9: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/9.jpg)
NOW FOR FIXED EFFECTS MODELSWhat would this same concept look like in regression terms?
![Page 10: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/10.jpg)
8 9 10 11 12
91
01
11
21
3
Return on Investments to Infrastructure by State, 1970-1986
Public Infrastructure (log)
Gro
ss E
con
om
ic A
ctiv
ity (
log
)
Each color represents data from a state over the 17-year study period.
Levels of spending and levels of economic development represent the specific characteristics of a group (a state in this case).
What is our inference about the policy impact of increased infrastructure spending when we use all of the data together, and does it change when we take into account group structure.
(data from Baltagi & Pinnoi 1995)
![Page 11: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/11.jpg)
Heterogeneity Bias
Bias that results when you try to determine the impact of a program or policy and you don’t take into account group structure.
![Page 12: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/12.jpg)
Differences Between “Levels” and Changes in Levels
• If you are looking at the relationship between foreign aid and the standard of living within a country, there is a large potential for bias because the countries that receive the most aid are going to be the poorest countries.
• As a result, if you regress the standard of living onto aid – simply looking at the levels of living standards and the levels of foreign aid – you will incorrectly conclude that foreign aid actually hurts nations.
• If we think about it more like an experiment, we would want to randomly assign levels of aid to different countries to see if it helps. That is not politically feasible, so instead we might think of a different experiment. What if we took all of the countries that are receiving aid, and we randomly assign them a one-unit increase or a one-unit decrease in aid. So they still receive close to the same levels of aid as the previous year, but they get a small boost or a small shock.
• We are moving from an examination of the “levels” of foreign aid to changes in foreign aid.
![Page 13: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/13.jpg)
LivingStandards
Aid
This is what the “levels” data will look like. Note that poor countries NEED the most aid, so the direction of causality is opposite of what this regression suggests. We cannot interpret the slope as a program impact here.
![Page 14: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/14.jpg)
LivingStandards
Aid
This is what the “levels” data will look like. Note that poor countries NEED the most aid, so the direction of causality is opposite of what this regression suggests. We cannot interpret the slope as a program impact here.
Change in Living
Standard
Change in Aid
If we look at changes in the levels of aid for one specific country, we can look at how that change either increases or decreases the standard of living in the country.
Change in Living Standard
Less aid
More aidSpecific Country
![Page 15: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/15.jpg)
LivingStandards
Aid
What the relationship looks like when you estimate the policy impact using all of the data from many countries.
Change in Living
Standard
Change in Aid
The relationship focusing on one country over time.
Between Country
Within Country
![Page 16: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/16.jpg)
LivingStandards
Aid
The fixed effect model does this by examine changes that occur within-group over time.
Change in Living Standard
Change in Aid
By adding an intercept for each group, you are putting them on the same axis so now you can estimate a common slope while taking into account the effects of the unique history/culture of the groups.
![Page 17: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/17.jpg)
Cross-Section Variation (Levels)
![Page 18: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/18.jpg)
Regression Model:
eDosagebbBP 10
![Page 19: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/19.jpg)
Within Group Variation
![Page 20: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/20.jpg)
Another Example
![Page 21: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/21.jpg)
Why are the slopes the same?
Price
MakeMileage
![Page 22: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/22.jpg)
When to use Fixed Effects?
Y
Time-InvariantGroup-Level
TraitPolicyVariable
![Page 23: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/23.jpg)
The “Fixed Effect” is a catch-all variable for anything about the group that is “fixed” across time
• “Culture”• Race• Gender• IQ• Management or Productivity• Ability
Y
Fixed TraitX1
Even if we cannotmeasure it,
we can get rid of it!
![Page 24: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/24.jpg)
Isolating Change Over Time
Change in Y
Change in X
![Page 25: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/25.jpg)
GenderbEdubbIncome o 21
How it works mathematically:
GenderbEdubbIncome
GenderaEduaaIncome
GenderaEduaaIncome
tttt
tttt
210
1121101
2222102
If any covariate is time-invariant:
![Page 26: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/26.jpg)
“Fixed Effects” Regression Model
eSbSbSbDosagebBP 321 4321
![Page 27: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/27.jpg)
“Fixed Effects” Regression Model
eSbSbSbDosagebBP 321 4321
Note – there is no intercept term! Why is this?
321 SSSC
Perfect Multicollinearity
C S1 S2 S31 1 0 01 1 0 01 0 1 01 0 1 01 0 0 11 0 0 1
![Page 28: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/28.jpg)
Management Bias (Mundlak, 1965)
Ag Inputs
FarmProductivity
Organizational Culture
Agricultural Inputs
Farm Productivity b
β
![Page 29: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/29.jpg)
Bias Can go in the Other Direction
X
Y
![Page 30: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/30.jpg)
Difference in Fit
ΔX ΔYXt=1
Xt=2
Yt=1
Yt=2
![Page 31: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/31.jpg)
Difference in Fit
![Page 32: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/32.jpg)
Requires Panel Data
X Y Gender
1 8 Male
3 6 Female
2 5 Female
2 3 Male
ID X Y Observation (Time)
A 1 8 1
A 3 6 2
B 2 5 1
B 2 3 2
Time Y
1 8
2 6
3 5
4 3
Cross Section
Panel Data
Time Series
![Page 33: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/33.jpg)
Data for the Homework
8 9 10 11 12
91
01
11
21
3
Return on Investments to Infrastructure by State, 1970-1986
Public Infrastructure (log)
Gro
ss E
con
om
ic A
ctiv
ity (
log
)
-0.4 -0.2 0.0 0.2 0.4
-0.2
-0.1
0.0
0.1
0.2
0.3
0.4
Return on Infrastructure Investments for Six States, 1970-1986
Public Infrastructure (residuals)
Gro
ss E
co
no
mic
Activity (
resid
ua
ls)
![Page 34: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/34.jpg)
Data for the Homework
8 9 10 11 12
91
01
11
21
3
Return on Investments to Infrastructure by State, 1970-1986
Public Infrastructure (log)
Gro
ss E
con
om
ic A
ctiv
ity (
log
)
-0.4 -0.2 0.0 0.2 0.4
-0.2
-0.1
0.0
0.1
0.2
0.3
0.4
Return on Infrastructure Investments for Six States, 1970-1986
Public Infrastructure (residuals)
Gro
ss E
co
no
mic
Activity (
resid
ua
ls)
![Page 35: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/35.jpg)
Why does this happen?
EconomicGrowth
StateCharacteristics
PublicSpendingOn Infrastructure
EconomicGrowth
PublicInfrastructure
Tax Base
?
Tech Boom
+
+
+
![Page 36: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/36.jpg)
Running a Fixed Effects Model in SPSS
![Page 37: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/37.jpg)
Running a Fixed Effects Model in SPSS
![Page 38: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/38.jpg)
Running a Fixed Effects Model in SPSS
Uncheck this
![Page 39: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/39.jpg)
Running a Fixed Effects Model in SPSS
![Page 40: Fixed Effects Models Evaluation Research (8521) Prof. Jesse Lecy 1.](https://reader033.fdocuments.us/reader033/viewer/2022042718/56649f2f5503460f94c49f88/html5/thumbnails/40.jpg)
General Linear ModelCommand
Linear Regressionwith Dummies
and no Intercept