INAM EVALUATION

Paul T. Bucci PhD, LLC

Westat, Inc.

GEM Software Development, Inc.

Program Design

• Needs Assessment• Gap Analysis• Barriers to Employment• Program to Fill the Gap• Program Evaluation

PTB Evaluation Team

• PTB – Overall evaluation conceptualization and project management and coordination. Focus on institutional and consortium organization and development.

• Westat – research and evaluation expertise (quantitative and qualitative analysis)

• GEM – development and management of the INAM online longitudinal database

Evaluation Plan

Two Study Groups

1. Participant Cohort – has education plan and participates in tweaked curriculum (certificates and degree programs) or NCRC certificate

2. Comparison Cohorts

a. Prior cohorts

b. Students at comparable INAM institutions that have not yet adopted changes

c. Non-participating TAA-eligible and veterans

Evaluation Plan

Two Studies

1. Implementation Study (primarily qualitative) focusing on the implementation process, the participation, contributions of the INAM partners, and improvements over the past 

2. Outcomes Study (primarily quantitative) focusing on

a. the academic and employment outcomes for participants as compared to non-participant comparison cohorts

b. Impact variance by program or student characteristics

Longitudinal Database

1. Student Level Data

a. Demographic

b. Performance

c. Participation

2. Enables tracking a student from program entry, through program participation, and into further education and/or employment

Key Research Questions

• To what extent was the INAM model implemented?• To what extent are the curricula aligned to state workforce

needs?• To what extent has there been sharing among the INAM

partners?• To what extent has INAM developed and institutionalized

innovative practices and capacity-building?• To what extent have participant outcomes been achieved?• How do participant outcomes compare to non-participant

outcomes?• To what extent have employers and other stakeholders

been involved?

INAM EVALUATION

Paul T. Bucci PhD, LLC

Westat, Inc.

GEM Software Development, Inc.