TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back...
Transcript of TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back...
![Page 1: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/1.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
The Importance of GPA Requirements for VET Educationand Low-income Students
Jesper Eriksen1 Shaun M. Dougherty2
1Aalborg University
2Vanderbilt University
Cedefop/OECD SymposiumOctober 2019, Paris
1 / 14
![Page 2: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/2.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
CTE/VET Education
• What we mean by CTE/VET in this project: Secondary education withemphasis on skills directly relevant to the labor market
• System features vary by country
• Apprenticeship/school based, secondary/tertiary, length, ...
• A general goal
• Provide non-academic path to labor market attachment
• Important for students less likely to attain good High school/college degrees
• Big policy question
• What program structures increase continued program enrollment and labormarket attachment?
2 / 14
![Page 3: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/3.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Research Question
Research Question
• What is the effect of non-binding GPA screening at VET entry on studentretention rates?
This Paper
• Danish Reform from 2014: Minimum GPA requirement
• Short term goal: Increase quality of students and increase maintainedenrollment
• Long term goal: Increased application rates
• Full population Danish administrative data, 2009-2017
• Estimation procedure to identify causal effects
3 / 14
![Page 4: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/4.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Results
Main Findings
• Initial effects of screening is fewer accepted low-SES students
• GPA screening leads to lower 1st month enrollment rates
• Negative/no demand side response from firms hiring apprentices
• Firms’ appear to respond fast to changes policy changes
• Demand side behavior also shaped by supply-side policies
Policy Implications
• Reforms should should consider (unintended) socio-economic impacts
• Screening metrics for VET entry should be aligned with apprenticeship metrics
4 / 14
![Page 5: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/5.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Results
Main Findings
• Initial effects of screening is fewer accepted low-SES students
• GPA screening leads to lower 1st month enrollment rates
• Negative/no demand side response from firms hiring apprentices
• Firms’ appear to respond fast to changes policy changes
• Demand side behavior also shaped by supply-side policies
Policy Implications
• Reforms should should consider (unintended) socio-economic impacts
• Screening metrics for VET entry should be aligned with apprenticeship metrics
4 / 14
![Page 6: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/6.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Literature
• VET Graduation and Returns
• Böckerman et al (2018), Brunner et al (2019), Dougherty (2018), Festerer et al.(2008), Hanushek et al (2017), Hemelt, et al (2018), Kemple & Willner (2008),Krueger & Kumar (2004), Silliman & Virtanen (2019), Wolter & Ryan (2011)
• Features of VET systems and at risk students
• Culpepper (2003, 2007), Dougherty & Macdonald (2019), Dougherty et al(2019), Dustman & Schönberg (2009), Hall & Soskice (2001), Ryan et al(2013), Visser (2009), Wolter & Ryan (2011)
5 / 14
![Page 7: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/7.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
The Vocational Education Setting
Source: Danish Ministry of Education, 2019.
6 / 14
![Page 8: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/8.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
The Vocational Education Setting
VET in Denmark
• 18 percent of a youth cohort applied to VET in 2014
• 3-4 years, often leading to labor market entry
• General structure for 4-year programs
• Year 1: School based introduction and search for apprenticeship
• Year 2-4: Apprenticeship and school based learning
• Exceptions: Short-term nursery educations and business degrees obtained in<3 years
• Also include apprenticeships and were affected by reform
7 / 14
![Page 9: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/9.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
The Vocational Education Setting
Reform of 2014
• Reform content:1
• Before: All students applying to VET accepted
• After: Pass Math and Danish in primary school OR retake test to pass
• Purpose: Increase quality of students in program to
1 Short term: Increase maintained enrollment
2 Long term: Increase application rate
Important: We only evaluate short term effects
1Additional content: Changed structure of first year, split of students above 25 from studentsdirectly from primary school. Will not be affecting our estimates.
8 / 14
![Page 10: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/10.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
The Vocational Education Setting
Reform of 2014
• Reform content:1
• Before: All students applying to VET accepted
• After: Pass Math and Danish in primary school OR retake test to pass
• Purpose: Increase quality of students in program to
1 Short term: Increase maintained enrollment
2 Long term: Increase application rate
Important: We only evaluate short term effects
1Additional content: Changed structure of first year, split of students above 25 from studentsdirectly from primary school. Will not be affecting our estimates.
8 / 14
![Page 11: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/11.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Data and Evaluation
Danish Administrative Data
• Primary School grades by subject
• Applications to secondary education programs
• Maintained enrollment spells
• Child and parental demographics - including age, gender, income, labormarket participation, ...
Evaluation
• Approach: Comparing students just above/below GPA threshold for2011-2016 cohorts
• Outcomes: Maintained enrollment at 1, 6, 12, and 15 months into VETprogram
9 / 14
![Page 12: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/12.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Data and Evaluation
Danish Administrative Data
• Primary School grades by subject
• Applications to secondary education programs
• Maintained enrollment spells
• Child and parental demographics - including age, gender, income, labormarket participation, ...
Evaluation
• Approach: Comparing students just above/below GPA threshold for2011-2016 cohorts
• Outcomes: Maintained enrollment at 1, 6, 12, and 15 months into VETprogram
9 / 14
![Page 13: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/13.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
The StudentsSample: 2011-2016 VET applicants from 9th/10th grade, 73,314 observations
Applications Student backgrounds10 / 14
![Page 14: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/14.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Main Results - Graphical DiD representation
• Month 1: Reform leads to a 30 pct-point drop in students participation
• Month 6: Effect remains, but 10 pct-points higher maintained enrollmentacross GPA
• Month 12: Apprenticeship requirement starts. Drop for 2014 cohort belowthreshold, no effect later on
Dropouts Model
11 / 14
![Page 15: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/15.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Main Results - Graphical DiD representation
• Month 1: Reform leads to a 30 pct-point drop in students participation
• Month 6: Effect remains, but 10 pct-points higher maintained enrollmentacross GPA
• Month 12: Apprenticeship requirement starts. Drop for 2014 cohort belowthreshold, no effect later on
Dropouts Model
11 / 14
![Page 16: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/16.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Main Results - Graphical DiD representation
• Month 1: Reform leads to a 30 pct-point drop in students participation
• Month 6: Effect remains, but 10 pct-points higher maintained enrollmentacross GPA
• Month 12: Apprenticeship requirement starts. Drop for 2014 cohort belowthreshold, no effect later on
Dropouts Model
11 / 14
![Page 17: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/17.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Main Results - Graphical DiD representation
• Month 1: Reform leads to a 30 pct-point drop in students participation
• Month 6: Effect remains, but 10 pct-points higher maintained enrollmentacross GPA
• Month 12: Apprenticeship requirement starts. Drop for 2014 cohort belowthreshold, no effect later on
Dropouts Model
11 / 14
![Page 18: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/18.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Main Findings (2) - Event Study representation
Event study effects estimated with GPA bandwidth of 2 and standard errors clustered at primary school.
• Month 1: Fewer low-SES students enter program
• Month 12: Demand side (firms) respond - also fewer low-SES students
• GPA appears to be ’wrong’ screening mechanism
12 / 14
![Page 19: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/19.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Conclusion
Conclusions
• Initial effects of screening is fewer accepted low-SES students
• GPA screening leads to lower 1st month enrollment rates
• Negative/no demand side response from firms hiring apprentices
• Firms’ appear to respond fast to changes policy changes
• Demand side behavior also shaped by supply-side policies
Policy Implications
• Reforms should should consider (unintended) socio-economic impacts
• Screening metrics for VET entry should be aligned with apprenticeship metrics
13 / 14
![Page 20: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/20.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Conclusion
Conclusions
• Initial effects of screening is fewer accepted low-SES students
• GPA screening leads to lower 1st month enrollment rates
• Negative/no demand side response from firms hiring apprentices
• Firms’ appear to respond fast to changes policy changes
• Demand side behavior also shaped by supply-side policies
Policy Implications
• Reforms should should consider (unintended) socio-economic impacts
• Screening metrics for VET entry should be aligned with apprenticeship metrics
13 / 14
![Page 21: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/21.jpg)
GPARequirements
EriksenDougherty
Introduction
Setting, Reform,and Data
Results
Conclusion
Thank you
Jesper EriksenAalborg [email protected]
Shaun DoughertyVanderbilt University
Cedefop/OECD SymposiumOctober 2019, Paris
14 / 14
![Page 22: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/22.jpg)
GPARequirements
EriksenDougherty
Appendix
15 / 14
![Page 23: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/23.jpg)
GPARequirements
EriksenDougherty
Primary School Students’ Applications
Sample includes all students with application information from the application system.
• The figure shows primary school students’ first priority education choice atthe end of compulsory 9th grade and optional 10th grade.
Back to data section
16 / 14
![Page 24: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/24.jpg)
GPARequirements
EriksenDougherty
Number of students with VET as first priority
Back to data section
17 / 14
![Page 25: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/25.jpg)
GPARequirements
EriksenDougherty
Number of students with VET as first priority
Back to data section
18 / 14
![Page 26: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/26.jpg)
GPARequirements
EriksenDougherty
The Students (2)
Back
19 / 14
![Page 27: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/27.jpg)
GPARequirements
EriksenDougherty
Dropouts
Back to DiD
20 / 14
![Page 28: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/28.jpg)
GPARequirements
EriksenDougherty
Understanding results - A Model of effort and signallingIntuition of model
• Students have enrolled in VET and search for apprenticeship positions
• Have academic ability signal from primary school
• Effort in search depends on (1) effort’s effect on search-success, and (2)outside options (primary school signal)
• Firms pick students as apprentices
• Screen applicants on search effort - effect of effort increases in students’productivity heterogeneity
• Equilibrium student intake: Perfect Bayesian Nash equilibrium (firms’expectations about number of applicants and their effort satisfied)
• Model takeaways
• If effort is importance for search success, low GPA students put in higher effortand get more apprenticeships
• If firms’ get signal of more productive students then they screen less, low GPAstudents lowers effort - GPA-Enrollment gradient weakens
Back to DiD21 / 14
![Page 29: TheImportanceofGPARequirementsforVETEducation Introduction ... · Dougherty TheStudents(2) Back 19/14. GPA Requirements Eriksen Dougherty Dropouts BacktoDiD 20/14. GPA Requirements](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8dd7bd225ac815961a59d2/html5/thumbnails/29.jpg)
GPARequirements
EriksenDougherty
Understanding results - A Model of effort and signalling
0Screeningby
firm
1
Share of good apprentices (λ)
λ̄
Willingn
essto
payforeff
ort
0
Cost of effort
θ1
θ0
Firm’s stop screen-ing and type θ1 actas θ0
Back to DiD
22 / 14