PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce...

23
PERFORMANCE PERFORMANCE ACCOUNTABILITY: ACCOUNTABILITY: WIA YOUTH PERFORMANCE WIA YOUTH PERFORMANCE MEASURES MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey Sar Levitan Center for Public Policy Study Johns Hopkins University National Youth Employment Coalition May 2000

Transcript of PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce...

Page 1: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

PERFORMANCE PERFORMANCE ACCOUNTABILITY:ACCOUNTABILITY:

WIA YOUTH PERFORMANCE WIA YOUTH PERFORMANCE MEASURESMEASURES

John J. Heldrich Center for Workforce Development

Rutgers, the State University of New Jersey

Sar Levitan Center for Public Policy Study

Johns Hopkins University

National Youth Employment Coalition

May 2000

Page 2: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

2

Required Youth Council RoleRequired Youth Council Role

• Planning youth workforce activities • Establish linkages with other organizations serving

youth• Consider full range of issues that can have an impact

on the success of youth in the labor market• Assist Workforce Investment Board in:

- Selecting eligible providers

- Negotiating local performance goals

Page 3: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

3

WIA Youth Programs WIA Youth Programs A Comprehensive, Long-Term Approach

• Preparing youth to succeed in the labor

market

• Improving educational achievement levels

• Providing a sustained support system

• Providing leadership and citizenship

development

Page 4: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

4

Youth Performance Measures Promote and Encourage:

• Youth development approaches

• Long-term attachment

• Collaboration

• Further education and training, both before and during employment

• A continuum of services that lead to skill attainment, educational advancement, credentials and job placement

Page 5: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

5

Youth Performance Measures A New Approach

• Different measures for different age groups– Older Youth = 19 to 21 at entry – Younger Youth = 14 to 18 at entry

• Different points in time – While receiving services – After services were received (with UI: not

always immediately after) – 6 months after services

• New data source -- UI wage records

Page 6: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

Youth Performance MeasuresYouth Performance Measures

Older Youth -- Youth 19-21 at entry

Entered Employment Rate

Employment Retention Rate

Earnings Change

Credential Rate

Page 7: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

Youth Performance MeasuresYouth Performance Measures

Younger Youth -- Youth 14-18 at entry

Skill Attainment Rate

Diploma or Equivalent Attainment Rate

Retention Rate

Page 8: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

Youth Performance MeasuresYouth Performance Measures

Customer Satisfaction

Both older and younger youth and employers working with youth programs

are included in the two customer satisfaction measures.

Page 9: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

9

Older Youth

Entered Employment Rate

Measures the number of youth who didn’t have a job before services and got a job after services

Measures what happens right after services

Recognizes enrollment in education: Youth who exit but are in post-secondary education or advanced training are not included in the measure.

Page 10: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

10

Older Youth

Employment Retention Rate

Measures the number of youth who had a job after leaving services and still had a job 6 months later

Longer-term measure (6 months after services)

Recognizes enrollment in education: Youth who are in post-secondary education or advanced training 6 months after exit are not included in the measure.

Page 11: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

11

Older Youth

Earnings ChangeCompares earnings youth had 6 months before services to 6 months after services

Longer-term measure (6 months after services)

Recognizes enrollment in education: Youth who exit but are in post-secondary education or advanced training 6 months after exit are not included in the measure.

Page 12: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

12

Older Youth

Credential RateMeasures the number of youth in employment, post-secondary education or training who acquire a recognized credential during services or within 6 months after services

Longer-term measure (6 months after services)

Recognizes and rewards attainment of credentials

“Recognized credentials” defined locally by state

Page 13: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

13

Younger Youth

Skill Attainment Rate

Measures the attainment of basic, work readiness or occupational skills while receiving services

“Real time” -- measures what’s happening while youth are receiving services

Rewards flexible intermediate goals

Compares achievement to planned achievement

Page 14: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

14

Younger Youth

Diploma or Equivalent Attainment Rate

Of those who enter without a diploma or equivalent, measures the number of youth who receive one by the time they leave services or right after leaving services. In-school youth who leave services and are still in school are excluded from this measure.

Recognizes importance of high school diploma/equivalent

Page 15: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

15

Younger Youth

Retention RateMeasures the proportion of youth who are in the following activities 6 months after they leave services:Post-secondary education

Qualified apprenticeships

Employment

Advanced training

Military service

Longer-term measure (6 months after services)

Recognizes variety of positive outcomes for youth

Page 16: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

16

Performance Goals

• Goals should reflect the vision and priorities of the Youth Council and local Workforce Investment Board

• Goals should be realistic and attainable

• Goals will be negotiated between the State and each local Workforce Investment Board

Page 17: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

17

Performance Goals (cont’d)

• For incentives, states must achieve at least 100% score for each program area, with no measures below 80% of goal -- states may hold workforce investment areas to the same requirements

• Incentives and sanctions linked to attainment of goals

• States may be sanctioned if performance below 80% on any measure

Page 18: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

18

Year 1 of WIAPerformance Measures Avg. Perf. Level

Older Youth

Entered Employment Rate 63%

Employment Retention Rate 77%

Earnings Change in Six Months $3,150

Credential Rate 50%

Younger Youth

Skill Attainment Rate 72%

Diploma or Equivalent Attainment Rate 55%

Retention Rate 54%

Page 19: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

19

How Measures Promote Long-Term Attachment and Collaboration

• Youth need not exit from WIA based on program or funding source. They may continue in adult WIA or partner services.

• Exit-based measures apply to all programs only after final exit -- allowing a full range of services.

• Once a youth registers for WIA youth services, the program can get credit for partner outcomes (as long as a Memorandum of Understanding is in place).

• The more partners you have, the greater the chance for success!

Page 20: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

20

On a scale of 1 to 10, how much consideration do you believe should be given to WIA youth performance measures when Councils design

their youth delivery systems?

Little or no importance Great importance

1 2 3 4 5 6 7 8 9 10

What do you think?What do you think?

Page 21: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

21

Implications for Program Design• Flexibility for Youth Council in designing

programs that meet community’s needs

• Emphasis on longer-term programs, with consistent case management, support and follow-up

• Collaborate with partners and formalize with Memoranda of Understanding

• Focus on skill attainment, educational advancement, credentials and job placement

Page 22: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

22

Effect on Program Management• Information system needed for day-to-day

management and to project performance on longer-term measures

• Case management system needed to constantly track/follow participants

• Benchmarks/goals for vendors need to be clearly defined

• Strong network of vendors and partners needed

Page 23: PERFORMANCE ACCOUNTABILITY: WIA YOUTH PERFORMANCE MEASURES John J. Heldrich Center for Workforce Development Rutgers, the State University of New Jersey.

23

Performance Measures

• Help to define desired outcomes

• Can be negotiated based on economic conditions, characteristics of participants, or program design

• Should reflect program design -- not drive it