Common Measures for the Workforce Investment Act (WIA)

An equal opportunity employer/program. Auxiliary aids and services are available upon request to individuals with disabilities. All voice telephone numbers on this document may be reached by persons using TTY/TDD equipment via the Florida Relay Service at

711.

Workforce Summit 2005 2

• An equal opportunity employer/program. Auxiliary aids and services are available upon request to individuals with disabilities. All voice telephone numbers on this document may be reached by persons using TTY/TDD equipment via the Florida Relay Service at 711.

33

Common Measures

44

Establishing CommonEstablishing Common MeasuresMeasures• President’s Management Agenda• Affects six agencies (29 programs)

– Department of Labor– Department of Education– Department of Health and Human Svcs.– Department of Veterans Affairs– Department of the Interior– Department of Housing and Urban Development

• TEGL 17-05 issued on February 17, 2006– Rescinds TEGLs 28-04 and 15-03– Policy applies to DOL funded programs only– July 1, 2005, implementation for W-P, VETS and

WIA; October 1, 2005, implementation for TAA

55

Benefits of Common MeasuresBenefits of Common Measures• Focus on the core purposes of the workforce

system; employment for adults and skill gain for youth

• Break down barriers to integration resulting from different definitions, data and reports for each workforce program

• Resolve questions raised by GAO and other oversight agencies regarding the consistency and reliability of data

• Reduce confusion among our customers and stakeholders who want to know about results

66

The Common MeasuresThe Common Measures• Adult measures: (Adults and DWs)

– Entered employment– Employment retention – Earnings increase (PY 05) – Average Earnings (PY 06)

• Youth and lifelong learning measures: (Ages 14-21)– Placement in employment or education– Attainment of a degree or certificate– Literacy or numeracy gains

77

The Common Measures and Revised The Common Measures and Revised Reporting Requirements forReporting Requirements for

WIA ProgramsWIA Programs

88

• Common measure outcomes will be collected through revised reports

• Common measure definitions replace existing program-specific performance measure definitions where possible

• Efficiency measures to be computed at Federal level only

Roll-Out of Common MeasuresRoll-Out of Common Measures

99

Earnings gain

Employment retention rate at

six months

WIA AdultWIA Adult Core Performance

Measures

Adult CommonAdult Common Performance

MeasuresAdult entered

employment rate

Adult employment retention rate

Adult earnings increase (PY 05)

Adult average earnings (PY 06)

Entered employment rate

Employment and credential rate

WIA Adult Program MeasuresWIA Adult Program Measures

Roll-Out of Common MeasuresRoll-Out of Common Measures

Note: Regions have negotiated performance goals for entered employment, retention, earnings gain & credential for PY05 and PY06.

Note: Regions have negotiated performance goals for entered employment, retention, earnings gain & credential for PY05 and PY06.

1010

Earnings replacement

Employment retention rate at

six months

WIA Dislocated WorkerWIA Dislocated Worker

Performance Measures

Adult CommonAdult Common Performance

MeasuresAdult entered

employment rate

Adult employment retention rate

Adult earnings increase (PY 05)

Adult average earnings (PY 06)

Entered employment rate

Employment and credential rate

WIA Dislocated Worker Program MeasuresWIA Dislocated Worker Program Measures

Roll-Out of Common MeasuresRoll-Out of Common Measures

Note: Regions have negotiated performance goals for entered employment, retention, earnings gain and credential measures for PY05 and PY06.

Note: Regions have negotiated performance goals for entered employment, retention, earnings gain and credential measures for PY05 and PY06.

1111

WIA Youth Program MeasuresWIA Youth Program Measures

Roll-Out of Common MeasuresRoll-Out of Common MeasuresYouth Common Performance MeasuresYouth Common Performance Measures

States have negotiated performance goals for WIA programs according to Federal measures for PY 2005 and PY 2006

Younger Youth Skill attainment rate Diploma attainment rate Retention rate

Older Youth Entered employment Employment retention Earnings change Employment and credential rate

1212

WIA Youth Program MeasuresWIA Youth Program Measures

Roll-Out of Common MeasuresRoll-Out of Common Measures

Youth Common Performance MeasuresYouth Common Performance Measures

• Placement in employment or education/ advanced training (PY05)• Attainment of a degree or certificate (PY05)• Literacy and Numeracy gains (PY06)

As of 06/15/2006 there has been no negotiated performance As of 06/15/2006 there has been no negotiated performance goals for the youth common measures.goals for the youth common measures.

1313

Key ConceptsKey Concepts

1414

Program ParticipationProgram Participation

• A participant is a person who is determined eligible to participate in a program and receives a service funded by the program in a physical location

• The date of participation is the date of the first service after eligibility determination

• Individuals who receive services that are accessed by virtual means outside of the program’s facility need not, but may, be treated as participants

1515

Program ParticipationProgram Participation

• Generally, all participants will be taken into account when computing performance outcomes under the common measures

• Two types of participants may be excluded from the performance calculations:

• Participants who do not voluntarily disclose valid Social Security numbers

• Participants who are excluded from the calculations by law (death, health/medical, institutionalized, etc.)

1616

• At a minimum, data needed from self-service participants: social security number (SSN) employment status at the point of

participation.• Upon request of a customer’s SSN, the

customer must also be offered the opportunity to provide Equal Employment/demographic information.

Minimum Data Needed from Self-Minimum Data Needed from Self-Service ParticipantsService Participants

1717

Program ExitProgram Exit

Exit (for reporting purposes) occurs when . . .• Participant does not receive a service or partner

service for 90 consecutive calendar days;• Participant has no planned gap in service; and• Participant is not scheduled for future services

Date of exit is applied retroactively to the last day of service funded by the program or partner program

The State has the capability to track partner services in order to extend the date of exit

1818

Program ExitProgram Exit

• Days included in any planned gap in services do not count when determining the exit date

– Delay before the beginning of training– Health condition or providing care for

a family member with a health condition

– Temporary move from the area– All gaps in service must be documented

1919

Exclusions from PerformanceExclusions from Performance• Exclusions from all common measures:

– Persons institutionalized (exceptions are detained Responsible Reintegration of Youthful Offenders and disabled individuals residing in institutions)

– Persons unable to continue due to health/medical or family care reasons

– Deceased – Reservists called to active duty– Relocated to a mandated residential program (youth only)

• To be excluded from performance calculations, the event must be expected to last 90 days or more

2020

Calculating Outcomes Calculating Outcomes Adult Measures Adult Measures

2121

AdultAdult Entered EmploymentEntered Employment

• Employment at participation is based on information from the individual -- not wage records

• Exclude adults employed at the time of participation

• Include adults employed at the time of participation who are on layoff notice

• Supplemental data will not be used in Florida• Wage records only will be used to determine

employment in the quarter after exit

Computing

Outcomes

Number employed in quarter after exit

Number of exiters

Of those not employed at participation:

2222

YESYES Numerator

Denominator

Excluded YES

Employed in quarter after exit?

NO

Employed at participation?

AdultAdult Entered EmploymentEntered Employment

NO

2323

AdultAdult Employment RetentionEmployment Retention

• Based on those employed in quarter after exit• Employment in the 1st, 2nd and 3rd quarters after exit does

not have to be with the same employer• Must be employed in both the 2nd and 3rd quarters after

exit to count as retained• Only UI Wage records will be used• Supplemental data will not be used in Florida

Computing Outcomes

Of those employed in the quarter after exit:

Number employed in both the 2nd and 3rd quarters after exit

Number of exiters

2424

Employed in quarter after exit?

YES

Employed in 2nd and 3rd qtr. after exit?

YESYES Numerator

Denominator

ExcludedNO

AdultAdult Employment RetentionEmployment Retention

NO

2525

Adult Earnings IncreaseAdult Earnings Increase

• For program year 05-06 only• Only wage records may be used for determining

pre-program and post-program earnings• Includes same population as the adult retention measure• Likely to be negative for dislocated workers

-Number exiters

Of those employed in the quarter after exit:Earnings in 2nd

and 3rd quarter after exit

Earnings in 2nd and 3rd quarter prior to participation

Computing Outcomes

2626

Employed in qtr. after exit?

Excluded

Included

NO

YES

Adult Earnings IncreaseAdult Earnings Increase

2727

Adult Average Earnings Adult Average Earnings

• Effective July 1, 2006• Only wage records may be used for determining

average earnings• Includes same population as the adult retention measure

Number exiters

Of those employed in the first, second, and third quarters after exit:

Total earnings in the 2nd quarter plus total earnings in the 3rd quarter after exit

Computing Outcomes

2828

Employed in qtr. after exit?Excluded

Employed in 2nd qtr. after exit?

Included

NO

Employed in 3rd qtr. after exit?

YES

Adult Average EarningsAdult Average Earnings

NO

NO

NO

YES

YES

2929

Calculating Outcomes Calculating Outcomes Youth Measures Youth Measures

3030

Youth Measures RequirementsYouth Measures Requirements

• Reporting for Program Year ending June 2006:

– 7 current WIA youth measures (4 OY and 3 YY) – negotiate on these for accountability

– First 2 youth common measures (placement and certificate)

– Lit/Num common measure required for new youth enrolled beginning July 1, 2006

– No negotiation on Lit/Num measure in PY 05

3131

Youth Common Measures Youth Common Measures

• Placement in Employment, Education, or Training• Attainment of a Degree/Certificate• Literacy/Numeracy Gains

Note: Youth Common Measures include all youth, no longer a distinction between younger/older youth

3232

Placement In Employment or Placement In Employment or EducationEducation

Number of youth in employment, military service, enrolled in post-secondary education, advanced

training, or occupational skills training in the quarter after exit

Number of exiters

Of those who are not in post-secondary education, employment, or the military at participation:

Computing Outcomes

3333

Youth and Lifelong LearningYouth and Lifelong Learning

Placement In Employment or Placement In Employment or EducationEducation

• Excludes youth in employment, military service, or post-secondary education at participation

• Includes youth in secondary education at exit• Employment, military and education status at

participation are based on information from the youth

3434

Youth and Lifelong LearningYouth and Lifelong Learning

Placement in Employment or Placement in Employment or EducationEducation

• Employment and military service in the 1st quarter after exit is based on UI wage data

• Includes first quarter after exit only

• Currently no common measures for retention or earnings change

3535

NO

YES

YES Numerator

Denominator

NO

Did the qualifying outcome occur in the 1st quarter

after exit?

Youth and Lifelong LearningYouth and Lifelong Learning

Placement in Employment or Placement in Employment or EducationEducation

In post-secondary education, employment, or the military at

participation?ExcludedYES

3636

Attainment of Degree or CertificateAttainment of Degree or Certificate

Computing Outcomes

Of those enrolled in education at participation or any time during the program:

Number attaining a diploma, GED or certificate by the end of the 3rd

quarter after exit

Number of exiters

3737

Youth and Lifelong LearningYouth and Lifelong Learning

Attainment of Degree or CertificateAttainment of Degree or Certificate

• Education refers to secondary school, post-secondary school, adult education, or any organized program of study approved by the Florida Department of Education

• Includes youth in secondary school at exit• Outcome can be attained during participation• Diploma is any credential the Florida Department

of Education accepts as equivalent to a high school diploma

3838

Youth and Lifelong LearningYouth and Lifelong Learning

Attainment of Degree or CertificateAttainment of Degree or Certificate

– awarded in recognition of an attainment of measurable technical or occupational skills necessary to gain employment or advance within an occupation.

– Technical or occupational skills are based on standards developed or endorsed by employers.

– Recognition of generic pre-employment and/or work readiness skills are not considered certificates.

• Definition applies only to youth attainment of degree or certificate common measure

• Defining “certificate”…

Computing

Outcomes

3939

Definition of Certificate (cont.)Definition of Certificate (cont.)

• Awarding Institutions include:– A State educational agency– Institution of higher education– Professional, industry or employer organization or a

product manufacturer– Registered apprenticeship program– Public regulatory agency– A program approved by the Dept of Veterans Affairs– Office of Job Corps– Indian Tribe Higher Education Institution

4040

NO

Enrolled in education at participation or any time

during the program?ExcludedNO

YES

Attained diploma, GED or certificate by the end

of the 3rd quarter after exit?

Youth And Lifelong LearningYouth And Lifelong Learning Attainment of Degree or CertificateAttainment of Degree or Certificate

YES Numerator

Denominator

YES

4141

Youth and Lifelong LearningYouth and Lifelong Learning

Literacy or Numeracy GainsLiteracy or Numeracy Gains

Number who completed a

year of participation

Of those out-of-school youth who are basic skills deficient:

Number who increase one or more educational functioning levels

Number who exit before completing

a year of participation

+Computin

g Outcome

s

4242

Youth and Lifelong LearningYouth and Lifelong Learning

Literacy or Numeracy GainsLiteracy or Numeracy Gains

• Excludes youth who are not basic skills deficient• Excludes youth who are in-school• Includes individuals with learning disabilities • To be in the numerator, an individual must advance

one or more Adult Basic Education (ABE) or English as a Second Language (ESL) functioning levels

4343

Tests cross-walked with ABE and ESL levels include:– Comprehensive Adult Student Assessment

Instrument (CASAS)– Test of Adult Basic Education (TABE)– Adult Basic Learning Examination (ABLE)– Student Performance Levels for ESL– Basic English Skills Test (BEST) for ESL– WorkKeys (for the top 3 ABE levels)

Youth and Lifelong LearningYouth and Lifelong Learning

Literacy or Numeracy GainsLiteracy or Numeracy Gains

4444

• Individuals should be pre-tested within 60 days of the participation date or obtain a pre-test completed by a partner agency within 6 months of the participation date may be used

• Requires the use of the same standardized test for both pre and post assessments

• Individuals with disabilities should be accommodated according to guidelines associated with the assessment tool and state law or policies

• Individuals should be post-tested by the end of one year of participation and compared to pre-test results obtained during the initial assessment

Youth and Lifelong LearningYouth and Lifelong Learning

Literacy or Numeracy GainsLiteracy or Numeracy Gains

4545

• If a youth continues to be basic skills deficient after the first 12 months of participation, then s/he should continue to receive training in literacy and/or numeracy skills until they become basic skills sufficient

• Participants should be post-tested and included in the measure at the completion of the 2nd year

• Only included in measure a second time if they complete a full 2nd year in program

Youth and Lifelong LearningYouth and Lifelong Learning

Literacy or Numeracy GainsLiteracy or Numeracy Gains

Computing

Outcomes

4646

If you have questions:If you have questions:

Antonio L. CarterSenior Management Analyst SupervisorOne-Stop & Program SupportDepartment of Economic Opportunity(850)245-7406tony.carter@deo.myflorida.com

4747

The End