Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80...

36
Kupe Kupersmith, CBAP President, Senior Instructor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . WE GET IT. WE’LL HELP YOU GET IT TOO. Defining and Measuring Expected Project Value (KPIs)

Transcript of Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80...

Page 1: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

Kupe Kupersmith, CBAP

President, Senior Instructor

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

WE GET IT. WE’LL HELP YOU GET IT TOO.

Defining and Measuring

Expected Project Value (KPIs)

Page 2: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Tweeting Today?

@Kupe

@B2T_Training

#BAOT

Page 3: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Making Learning Stick

People lose 50 – 80 percent of what they’ve learned after one day! This figure jumps to 97 percent after just 30 days.

Page 4: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Learning Objectives

• Explain the value validation model. Apply it to: Confirm the problem Ensure the solution proposed actually meets the need Validate the desired outcome with stakeholders

• Get introduced to and describe the 4-part KPI Impact Analysis Framework™

• Identify ways to measure and monitor your solution in real time to validate it is performing and meeting the desired outcome.

Page 5: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Is Your Business OK?

Page 6: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Performance Measures

KPI’s: those performance measures that are key to identifying that a solution is, or is not performing successfully

• a smaller subset of all the performance measures

• providers of early feedback

Success or Failure?!

Page 7: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Measurable Doesn’t Mean Helpful

There’s plenty that can be measured – the question is, what should be measured?

Why measure at all?

Page 8: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . How Do You Know If You’re OK?

Page 9: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Results to Desired Outcome

Example results for improved health:• Lower Blood pressure

• Decreased weight

• Improved Fitness

• Healthier Diet

• Taking vitamins regularly

• Improved sleep

• Reduced Stress

Page 10: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . The Keys to Creating Success

Predicting – and planning for – solution successrequires:• Visualizing success, and articulating it as a

desired outcome

• Identifying the results that will drive the desired outcome

• Recognizing the key performance conditions that must exist or be delivered for solution success to be achieved

• Identifying metrics that measure the solution’s success

Page 11: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

1. Identify desired business success

2. Derive solution option results

3. Identify Key Performance Conditions

4. Select Key Performance Indicators (KPIs)

Process to Derive KPIs

Business Success

Solution Option Success

Performance Success

KPIs

Page 12: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . The Value Validation Cycle

Put Your Ladder Against “The Right Wall”

Fills

SuccessProblem

Solution

OutcomeValue

Need or Goal

Solved by

Delivers

Provides

Impactedby

Desired

Page 13: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Case Study: Example

Sales manager has requested a new Sales Pipeline report so that they can determine why they are not selling more training programs.

Page 14: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Value Validation Cycle: Requested Solution

Not enough calls by

some sales people

Pipeline report to

show sales by person

# of Calls by Sales Person

Maintain or increase call

volume

More Sales of training program

Solved by

Delivers

Provides

Fills

Impactedby

Desired

Page 15: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Value Validation Cycle: New Solution

Organizations not requesting

additional training or

referring our program

Program extension to

address retention and

use

Training being applied by students

Increased referrals and Customers requesting

more training

More Sales of Training Program

Solved by

Delivers

Provides

Fills

Impactedby

Desired

Page 16: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Solution Measurement Variations

Pipeline Report:

• Measuring Calls by sales person

• Measure # of Leads generated by marketing campaigns

Program Extension:

• Participation by students

• Application of training to projects

• Recommendation to peers

Page 17: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

1. Identify desired business success

2. Derive solution option results

3. Identify Key Performance Conditions

4. Select Key Performance Indicators (KPIs)

Process to Derive KPIs

Business Success

Solution Option Success

Performance Success

KPIs

Page 18: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Identify Results Required for Success

If the desired outcome is clear:• A series of conclusions or decisions result in an outcome.

• Specific conclusions or decisions lead to the desired outcome.

Desired

Outcome

Solution Must

Support These

MustDrive

TheseResults

ToAchieve

Critical Needs

Before

It Will

Drive Results

Page 19: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Solution Results are Derived

A distinct pattern of results drive

a solution to success.

Appreciates

Solution

Option as

Valuable;

Believes

Solution

Meets Needs

Solution is Needed & Option Identified

Solution Option Is Used

Solution Option Worked (Operated)

Solution Option Enabled & Delivered

Solution Option Provided Value & Benefits

Page 20: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Training Program Extension Results

Customers Need our Program

Customers Buy our Program

Students participate in Program Extension

Students Apply what they Learned

Receive Referrals and Callsfor more Training

Sell More Training Programs

Success

Page 21: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Desired Outcome

Create your Ladder to Success

The KPI Impact Analysis FrameworkTM

Result

Result

Result

Result

Success

Solu

tio

n P

erfo

rman

ce

• Key Performance Conditions

• Key Performance Conditions

• Key Performance Conditions

• Key Performance Conditions

• Key Performance Conditions

• Key Performance Conditions

• Key Performance Conditions

• Key Performance Conditions

Solu

tio

n P

erfo

rman

ce

Solu

tio

n P

erfo

rman

ce

Solu

tio

n P

erfo

rman

ce

Page 22: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

1. Identify desired business success

2. Derive solution option results

3. Identify Key Performance Conditions

4. Select Key Performance Indicators (KPIs)

Process to Derive KPIs

Business Success

Solution Option Success

Performance Success

KPIs

Page 23: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Performance Conditions

Solution = Training Program Extension

What conditions need to be in the solution so it performs effectively to support my needs for results?

Customers Need our Program

Customers Buy our Program

Students Participate in Program Extension

Students Apply what they Learned

Page 24: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Conditions Enable the Solution

Solution = Training Program Extension

Customers Need our Program

Customers Buy our Program

Students Participate in Program Extension

Students Apply what they Learned

• Program details accessible to customers

• Ability to request program

• Option to customize

• Contracting process in place

• Qualified instructors available

• Training locations available

• Pre-call process with managers

• Have a template for student action plans

• Technology in place to conduct retention program

• Students are using techniques from class

• Students are asking questions from mentors

• Quality of work is increasing

• Consistency on projects is increasing

Page 25: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . From Conditions to Measurements

Solution = Training Program Extension

Key Performance Conditions

Corresponding Measures

• Program details accessible to customers

• Ability to request program

• Option to customize

• # of website visits• # of proposals submitted

• # of request received

• % of customized versus standard training requested

Page 26: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

• # of pre-call discussion occurring

• # of students talking with managers

• % of students participating in retention program

• # of website visits• # of proposals

submitted• # of request

received• % of customized

versus standard training requested

• # of contracts processed

• % of time qualified instructor is available when needed

• % of time training has to be rescheduled due to location issues

Measuring Success

• % of students using techniques from class within 60 days

• # of mentoring hours requested by students Quality of work survey scores

• Consistency on projects survey scores

Customers Need our Program

Customers Buy our Program

Students Participate in Program Extension

Students Apply what they Learned

Page 27: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . KPIs are Measures

Each measure must be translated into a clearly defined metric. • Measure: The standard or system for measurement that is

quantifiable Ex: KPI*: “User Satisfaction Ratings on User Experience”

• Metric: The real-valued or quantified function of measurement Ex: KPI-Related Metric: “UX Satisfaction Score= ‘Rating Given’ on a standard 1-10 scale where 10

is outstanding and 1 is terrible”

• Project objective (SMART-ly defined) Ex: “Achieve an average UX Satisfaction rating of > 7 by 2nd Quarter next year”

Page 28: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

1. Identify desired business success

2. Derive solution option results

3. Identify Key Performance Conditions

4. Select Key Performance Indicators (KPIs)

Process to Derive KPIs

Business Success

Solution Option Success

Performance Success

KPIs

Page 29: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Key Indicators of Performance

Select KPIs by identifying those measures that would be “key” to identifying that a solution is (or is not) performing.

Consider measures that would indicate:• A delayed or inefficient process or solution

• A roadblock in the process or solution

• Excessive costs in the process or solution

• Idle or ineffective solution

Page 30: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

No Single KPI Will Predict or Prove Solution Success

Look for combinations of KPIs that will provide

more insight or perspective.

X Y Z

Page 31: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Measurements in Context

Y: Solution delivery &

performance

X: Need for solution

Z: Solution

outcome & value

Questions KPIs must answer:

Page 32: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Training Program Extension Results

Customers Need our Program

Customers Buy our Program

Students participate in Program Extension

Students Apply what they Learned

Receive Referrals and Calls for more Training

Sell More Training Programs

• # of website visits

• # of proposals submitted

• # of request received

• % of customized versus standard training requested

• # of contracts processed

• % of time qualified instructor is available when needed

• % of time training has to be rescheduled due to location issues

• # of pre-call discussion occurring

• # of students talking with managers

• % of students participating in retention program

• % of students using techniques from class within 60 days

• # of mentoring hours requested by students

• Quality of work survey scores

• Consistency on projects survey scores

• # of referrals• # of

additional training programs sold to existing customers

Success

Page 33: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Evaluate Success, Interpret Results

How is the Solution Performing?

• Review instances and trends of KPI results

• Assess results and evaluate outcomes

• Determine business impacts and conclusions

• Identify issues and root causes Don’t decide to enhance until you know

Page 34: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . What did you learn?

Page 35: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Final Thoughts: It’s All About Value

• Validate the business outcome before designing a solution

• Then, architect success : identify right results to get there

• Focus on critical needs; define conditions needed to support them and drive results

• Identify measures & select KPIs

• Measure progress & analyze data for insights: so what?

• Create improvement strategies based on performance gaps

Page 36: Defining and Measuring Expected Project Value (KPIs) · Making Learning Stick People lose 50 –80 percent of what they’ve learned after one day! This figure jumps to 97 percent

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Stay Connected

[email protected]

twitter.com/Kupe

linkedin.com/in/kupetheba

“Like” us on Facebook