BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE,...

38
TAIR Conference March 3, 2020 BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, AND EFFICIENT. MAKING A DIFFERENCE Daniel J Chupe-O’Hanlon MS, Institutional Effectiveness Analyst, Austin Community College Dr. Steven LaNasa, Director, National Higher Education Benchmarking Institute TAIR 2020 Conference San Antonio, Texas

Transcript of BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE,...

Page 1: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR Conference March 3, 2020

BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, AND EFFICIENT.

MAKING A DIFFERENCE

Daniel J Chupe-O’Hanlon MS, Institutional Effectiveness Analyst, Austin Community CollegeDr. Steven LaNasa, Director, National Higher Education Benchmarking Institute

TAIR 2020 ConferenceSan Antonio, Texas

Page 2: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Session Objectives:Participants in this session will learn:■ The benchmarking process■ Benchmarking considerations■ Benchmarks for credit and noncredit programs■ How to create national, regional and peer comparison

reports based on normed benchmarks■ Institutional examples of how benchmarking are used to

demonstrate accountability, improve effectiveness, increase student success and make informed decisions

Page 3: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

What is benchmarking?

… the process of measuring an organization's internal processes then identifying, understanding, and adapting outstanding practices from other organizations considered to be best-in-class. (www.benchnet.com/wib.htm)

Benchmarking is an important component of continuous improvement and quality initiatives, including Six Sigma.(https://www.thebalancecareers.com/overview-and-examples-of-benchmarking-in-business-2275114)

Page 4: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Types of Benchmarking■ Internal

– Evaluating internal data to compare performance at different points in time to identify gaps or areas for improvement

■ Competitive– Collecting and evaluating data about peers to identify how you

compare

■ Strategic– Comparing your performance to best practices or to national data

Page 5: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

ATD Data & Analytics Summit, September 12, 2019

Benchmarking Can Be Used

■ Accreditation■ Strategic Planning■ Monitor KPI Progress■ Reporting to

Constituents■ Performance Funding

■ To Set Realistic Goals■ To Inform Decisions■ To Improve Processes■ To Find Best Practices■ To Show Strengths &

Opportunities for Improvement

Page 6: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

ATD Data & Analytics Summit, September 12, 2019

Sample Sources of Benchmark Data■ IPEDS

– Data Feedback Report

https://nces.ed.gov/ipeds/datacenter/Expt/SelectComparisonInstitution.aspx

– College Navigatorhttps://nces.ed.gov/collegenavigator/

– Data Center (customized reports)

– https://nces.ed.gov/ipeds/datacenter/InstitutionByName.aspx

Page 7: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

ATD Data & Analytics Summit, September 12, 2019

Sample Sources of Benchmark Data■ National Surveys:

– CCSSE/SENSEhttp://www.ccsse.org/survey/national3.cfm

https://www.ccsse.org/sense/survey/nationalbenchmark.cfm

– Noel-Levitzhttps://www.ruffalonl.com/complete-enrollment-management/student-success/student-satisfaction-assessment/

– NHEBI (NCCBP & Cost & Productivity Project)

https://nccbp.org/benchmarking-institute

■ State Resources■ Associations

Page 8: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Benchmarking Steps

Planning Identify what is to be

benchmarkedIdentify peer institutions

Analysis Collecting and benchmarking

the data

Determine performance gaps and set

targets

Action Develop action plans

Implement specific actions

and monitor progress

Page 9: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Identify What to Benchmark

■ Key Performance Indicators■ Strategic Plan■ Mission & Vision Statements■ Values Statement

Look at your college sources.

Page 10: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Identify Who To Benchmark Against

■ Types of Peers: Select the type of institutions you want to include in your peer group

– Comparable: Institutions that are similar to yours

– Competitive: Institutions that compete for the same target populations (students, employees, etc.)

– Aspirational: Institutions that are high performing or have best practices in different areas

Page 11: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Identify Peers: Examples■ Examples of Peer Groups: Often, there are natural peer

groups that already exist.

– State or groups within a state

– Regional groups

– IPEDS peers

– By characteristics (size, urban/rural, minority composition, etc.)

Page 12: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

IPEDS peer analysis

Page 13: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

State Peers

Page 14: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Benchmarking Steps

Planning Identify what is to be

benchmarkedIdentify peer institutions

Analysis Collecting and benchmarking

the dataDetermine

performance

Action Develop action plans

Implement specific actions

and monitor progress

Page 15: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR Conference March 3, 2020

INSTITUTIONAL EXAMPLE: AUSTIN COMMUNITY COLLEGE

Page 16: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

How ACC Uses Benchmarking■ Strategic Planning Metrics

– THECB Accountability System– THECB Almanac– NCCBP– IPEDS– CCSSE/SENSE– Noel-Levitz

Page 17: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for
Page 18: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for
Page 19: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR Conference March 3, 2020

NATIONAL HIGHER EDUCATION BENCHMARKING INSTITUTE (NHEBI)

Page 20: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

■ Mission: Improving higher education through benchmarking

■ Vision: Impacting higher education to maximize student success

■ Sources of national benchmarks provided by the Benchmarking Institute

The Benchmarking Institute

Page 21: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Benchmark Institute Participants Since Inception

30

3

42

17

1

1

1414

2

11

21

4

1

12

30

15

38

611

16

5

26 19

19

7

1310

12

1534 2416

22

3 9

7

6720

74

3 16

1

Page 22: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

NCCBP

www.nccbp.org

• Provides a comprehensive set of benchmarks for core community college activities

– Completion & Transfer– Academic Year Snapshot of

Outcomes– Retention & Persistence– Student Performance– Satisfaction and Engagement– Job Market, Business and

Industry– Other Institutional

Effectiveness Metrics

Page 23: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Cost and Productivity Project

www.costandproductivity.org

• Provides presidents, chief academic officers, deans and institutional researchers with benchmarks at the discipline level

– Instructional costs (salaries and benefits)

– Faculty workload– Class size

Page 24: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Benchmarking Steps

Planning Identify what is to be

benchmarkedIdentify peer institutions

Analysis Collecting and benchmarking

the dataDetermine

performance

Action Develop action plans

Implement specific actions

and monitor progress

Page 25: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Performance Metrics: Where do you stand?

XYZ

Page 26: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Performance Metrics: How Do You Compare?

XYZ

XYZ

Page 27: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Performance Metrics: What’s the Impact?

XYZ

XYZ

Page 28: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Cost Per Credit HourRegistered Nursing 51.38

Page 29: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Performance Metrics: Inputs Driving RevenueCost Benchmarks Applied to Departmental Productivity

Page 30: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Page 31: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Benchmarking Steps

Planning Identify what is to be

benchmarkedIdentify peer institutions

Analysis Collecting and benchmarking

the data

Determine performance gaps and set

targets

Action Develop action plans

Implement specific actions

and monitor progress

Page 32: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Why to Use the NCCBP?■ Comparison to over 250 other community colleges■ Strategic planning and selection of KPIs■ Accreditation■ Internal and external accountability activities■ Institutional transparency■ Documentation of student success■ State Performance Funding

Page 33: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

Southern Association of College & Schools (SACS)

Page 34: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Crosswalk: Using NCCBP Data for SACSCOC Accreditation

Page 35: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

New Institutional Accreditation Report:

SACSCOC Example

Page 36: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

ATD Data & Analytics Summit, September 12, 2019

Learn More about Benchmarking and Best Practices

Benchmarkinginstitute.org

May 5-7

Page 37: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR, March 2020

Keep up with the Benchmarking Institute

@EdBenchmarkJoin the National Higher Education Benchmarking Institute Group

Page 38: BENCHMARKING YOURSELF, HOW TO MAKE IT EASY, SIMPLE, …texas-air.org/wp...NCCBP-Benchmarking-presentation.pdf · The benchmarking process Benchmarking considerations Benchmarks for

TAIR Conference March 3, 2020

QUESTIONS?